2024-09-13T18:30:05.558 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T18:30:05.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:30:05.670 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904000 branch: wip-rishabh-testing-20240910.100730-reef description: fs/upgrade/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/quincy 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/iozone}} email: null first_in_suite: false job_id: '7904000' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'install ceph/quincy latest ' name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: dry_run: true install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 targets: smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN71x9yEqD0KaQm9aB+Boje3RC9P67N3uyAfiGMPbCpkGXVnsPRLFqlukOpPeq2YJ/07A59xvNppFZSIy0ZPzfk= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOF4LO/act/SjAUcfkgr3q6+LPN8Ivxlus78UKr9kAB1P+NiFPLyDB4G2xp3IcFmlJTti1iYqStgPZoQlNKze+k= tasks: - install: branch: quincy exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing quincy' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client quincy - print: '**** done ceph' - ceph-fuse: null - ceph-fuse: client.0: mounted: false - print: '**** done unmount client.0' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph.healthy: null - ceph-fuse: client.0: null - print: '**** done remount client.0' - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end - if not is_fuse() then reject() end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T18:30:05.670 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T18:30:05.672 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T18:30:05.672 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T18:30:05.674 INFO:teuthology.task.internal:Checking packages... 2024-09-13T18:30:05.701 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T18:30:05.701 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:30:05.701 INFO:teuthology.packaging:ref: None 2024-09-13T18:30:05.701 INFO:teuthology.packaging:tag: None 2024-09-13T18:30:05.701 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:30:05.701 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:30:05.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:30:05.856 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860.g6c6b083f 2024-09-13T18:30:05.857 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T18:30:05.864 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T18:30:05.864 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T18:30:05.869 INFO:teuthology.task.internal:Saving configuration 2024-09-13T18:30:05.885 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T18:30:05.891 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T18:30:05.924 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904000', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:25:05.026213', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN71x9yEqD0KaQm9aB+Boje3RC9P67N3uyAfiGMPbCpkGXVnsPRLFqlukOpPeq2YJ/07A59xvNppFZSIy0ZPzfk='} 2024-09-13T18:30:05.955 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904000', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:25:05.024960', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOF4LO/act/SjAUcfkgr3q6+LPN8Ivxlus78UKr9kAB1P+NiFPLyDB4G2xp3IcFmlJTti1iYqStgPZoQlNKze+k='} 2024-09-13T18:30:05.955 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T18:30:05.962 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-13T18:30:05.962 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['client.0'] 2024-09-13T18:30:05.962 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T18:30:06.033 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fca52d73be0>, signals=[15]) 2024-09-13T18:30:06.033 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T18:30:06.039 INFO:teuthology.task.internal:Opening connections... 2024-09-13T18:30:06.039 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2024-09-13T18:30:06.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:30:06.133 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-09-13T18:30:06.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:30:06.214 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T18:30:06.221 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2024-09-13T18:30:06.239 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2024-09-13T18:30:06.240 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-09-13T18:30:06.298 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2024-09-13T18:30:06.298 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9" 2024-09-13T18:30:06.298 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2024-09-13T18:30:06.298 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2024-09-13T18:30:06.298 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9" 2024-09-13T18:30:06.298 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9" 2024-09-13T18:30:06.298 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T18:30:06.298 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2024-09-13T18:30:06.298 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon" 2024-09-13T18:30:06.298 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T18:30:06.298 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2024-09-13T18:30:06.298 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T18:30:06.298 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T18:30:06.299 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T18:30:06.299 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-09-13T18:30:06.326 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-09-13T18:30:06.345 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-09-13T18:30:06.345 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-09-13T18:30:06.403 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-09-13T18:30:06.403 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-09-13T18:30:06.403 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-09-13T18:30:06.403 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-09-13T18:30:06.403 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-09-13T18:30:06.403 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-09-13T18:30:06.403 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T18:30:06.403 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-09-13T18:30:06.403 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-09-13T18:30:06.403 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T18:30:06.404 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-09-13T18:30:06.404 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T18:30:06.404 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T18:30:06.404 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T18:30:06.404 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-09-13T18:30:06.435 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T18:30:06.443 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T18:30:06.448 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T18:30:06.448 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:30:06.451 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:30:06.467 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T18:30:06.472 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T18:30:06.472 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:30:06.509 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:30:06.717 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T18:30:06.787 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T18:30:06.800 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T18:30:06.800 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'client.0': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T18:30:06.801 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:30:06.801 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:30:06.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:06.818 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-09-13T18:30:06.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:06.819 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-13T18:30:06.876 INFO:teuthology.orchestra.run.smithi097.stdout:5.14.0-503.el9.x86_64 2024-09-13T18:30:06.877 INFO:teuthology.task.kernel:Running kernel on smithi097: 5.14.0-503.el9.x86_64 2024-09-13T18:30:06.877 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum install -y kernel 2024-09-13T18:30:06.878 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-503.el9.x86_64 2024-09-13T18:30:06.878 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.14.0-503.el9.x86_64 2024-09-13T18:30:06.878 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2024-09-13T18:30:10.468 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-13T18:30:11.538 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-13T18:30:12.502 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-13T18:30:16.055 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 20 MB 00:03 2024-09-13T18:30:18.252 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-13T18:30:19.878 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-13T18:30:20.397 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-13T18:30:20.707 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-13T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-13T18:30:23.052 INFO:teuthology.orchestra.run.smithi097.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-13T18:30:26.154 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-13T18:30:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T18:30:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T18:30:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T18:30:28.260 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T18:30:28.261 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-13T18:30:28.261 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T18:30:28.261 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T18:30:28.261 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T18:30:28.261 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-13T18:30:28.261 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T18:30:28.261 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T18:30:28.261 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T18:30:28.261 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:30:28.261 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T18:30:28.261 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T18:30:28.261 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-09-13T18:30:28.261 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:30:28.262 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 79 M 2024-09-13T18:30:28.262 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 126 M 2024-09-13T18:30:28.262 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T18:30:28.623 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 278 kB/s | 23 kB 00:00 2024-09-13T18:30:28.624 INFO:teuthology.orchestra.run.smithi097.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-13T18:30:29.314 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-13T18:30:29.664 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 31 MB/s | 35 MB 00:01 2024-09-13T18:30:30.115 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 19 MB/s | 29 MB 00:01 2024-09-13T18:30:30.115 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:30:30.115 INFO:teuthology.orchestra.run.smithi142.stdout:Total 42 MB/s | 79 MB 00:01 2024-09-13T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T18:30:30.731 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-13T18:30:30.740 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-13T18:30:30.740 INFO:teuthology.orchestra.run.smithi097.stdout: Package Architecture Version Repository Size 2024-09-13T18:30:30.741 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-13T18:30:30.741 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-13T18:30:30.741 INFO:teuthology.orchestra.run.smithi097.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T18:30:30.741 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-13T18:30:30.741 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T18:30:30.741 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T18:30:30.741 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T18:30:30.741 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:30:30.741 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-13T18:30:30.741 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-13T18:30:30.741 INFO:teuthology.orchestra.run.smithi097.stdout:Install 4 Packages 2024-09-13T18:30:30.742 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:30:30.742 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 79 M 2024-09-13T18:30:30.742 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 126 M 2024-09-13T18:30:30.742 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-13T18:30:30.794 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T18:30:30.959 INFO:teuthology.orchestra.run.smithi097.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 264 kB/s | 23 kB 00:00 2024-09-13T18:30:31.137 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T18:30:31.138 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T18:30:31.334 INFO:teuthology.orchestra.run.smithi097.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-13T18:30:31.729 INFO:teuthology.orchestra.run.smithi097.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-13T18:30:32.052 INFO:teuthology.orchestra.run.smithi097.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-13T18:30:32.052 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:30:32.052 INFO:teuthology.orchestra.run.smithi097.stdout:Total 60 MB/s | 79 MB 00:01 2024-09-13T18:30:32.085 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T18:30:32.085 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T18:30:32.737 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-13T18:30:33.074 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-13T18:30:33.074 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-13T18:30:34.028 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-13T18:30:34.029 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-13T18:30:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T18:30:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:30:35.264 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:30:36.486 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-13T18:30:37.153 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:30:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:30:38.058 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:30:38.189 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:30:40.172 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:30:43.030 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:30:43.064 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:30:44.978 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:30:45.013 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:30:47.969 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:30:49.846 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:31:25.884 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:31:25.924 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:31:26.283 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:31:26.283 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:31:26.283 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:31:26.284 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:31:27.135 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:31:27.135 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:31:27.135 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T18:31:27.135 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T18:31:27.135 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T18:31:27.135 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T18:31:27.135 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T18:31:27.135 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:31:27.135 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T18:31:27.512 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:31:27.610 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:31:27.611 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:31:27.611 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T18:31:27.611 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:31:27.611 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:31:27.611 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-13T18:31:27.611 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:31:27.612 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:31:27.670 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:31:27.670 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:31:27.670 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-09-13T18:31:27.712 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-09-13T18:31:27.713 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-09-13T18:31:27.713 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-09-13T18:31:27.713 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 82.el9 2024-09-13T18:31:27.713 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-09-13T18:31:27.713 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T18:31:27.713 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-09-13T18:31:27.713 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8274670 2024-09-13T18:31:27.713 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-09-13T18:31:27.713 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T18:31:27.713 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T18:31:27.713 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T18:31:27.713 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T18:31:27.713 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-09-13T18:31:27.714 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-09-13T18:31:27.714 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T18:31:27.714 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-09-13T18:31:27.714 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-09-13T18:31:27.714 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:31:27.714 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T18:31:27.714 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T18:31:27.714 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T18:31:27.714 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-09-13T18:31:27.714 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:31:27.714 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T18:31:27.715 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T18:31:27.715 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 5.14.0-505.el9.x86_64 2024-09-13T18:31:27.715 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T18:31:28.013 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:31:28.053 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:31:28.321 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:31:28.321 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:31:28.321 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:31:28.321 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:31:28.372 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-09-13T18:31:29.134 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:31:29.134 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:31:29.134 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-13T18:31:29.134 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T18:31:29.135 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T18:31:29.135 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T18:31:29.135 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T18:31:29.135 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:31:29.135 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-13T18:31:29.515 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:31:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:31:29.598 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:31:29.598 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T18:31:29.598 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:31:29.598 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:31:29.598 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T18:31:29.598 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:31:29.599 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:31:29.657 INFO:teuthology.orchestra.run.smithi097.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:31:29.658 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:31:29.658 DEBUG:teuthology.orchestra.run.smithi097:> sudo rpm -qi grub2-tools 2024-09-13T18:31:29.689 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T18:31:29.690 INFO:teuthology.orchestra.run.smithi097.stdout:Name : grub2-tools 2024-09-13T18:31:29.690 INFO:teuthology.orchestra.run.smithi097.stdout:Epoch : 1 2024-09-13T18:31:29.690 INFO:teuthology.orchestra.run.smithi097.stdout:Version : 2.06 2024-09-13T18:31:29.690 INFO:teuthology.orchestra.run.smithi097.stdout:Release : 82.el9 2024-09-13T18:31:29.690 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: x86_64 2024-09-13T18:31:29.690 INFO:teuthology.orchestra.run.smithi097.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T18:31:29.690 INFO:teuthology.orchestra.run.smithi097.stdout:Group : Unspecified 2024-09-13T18:31:29.690 INFO:teuthology.orchestra.run.smithi097.stdout:Size : 8274670 2024-09-13T18:31:29.690 INFO:teuthology.orchestra.run.smithi097.stdout:License : GPLv3+ 2024-09-13T18:31:29.690 INFO:teuthology.orchestra.run.smithi097.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:Packager : builder@centos.org 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:Vendor : CentOS 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:Summary : Support tools for GRUB. 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:Description : 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:hardware devices. 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:31:29.691 INFO:teuthology.orchestra.run.smithi097.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T18:31:29.692 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T18:31:29.692 INFO:teuthology.task.kernel:Updating grub on smithi097 to boot 5.14.0-505.el9.x86_64 2024-09-13T18:31:29.693 DEBUG:teuthology.orchestra.run.smithi097:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T18:31:29.723 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-09-13T18:31:29.725 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-09-13T18:31:29.767 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.gO0sJVP3KG 2024-09-13T18:31:29.767 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gO0sJVP3KG 2024-09-13T18:31:29.845 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.gO0sJVP3KG 2024-09-13T18:31:29.995 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.gO0sJVP3KG is 6KB 2024-09-13T18:31:30.044 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.gO0sJVP3KG 2024-09-13T18:31:30.059 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T18:31:30.122 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T18:31:30.122 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T18:31:30.122 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T18:31:30.122 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T18:31:30.124 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T18:31:30.263 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-09-13T18:31:30.343 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2024-09-13T18:31:31.665 INFO:teuthology.orchestra.run.smithi097.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T18:31:31.701 INFO:teuthology.orchestra.run.smithi097.stderr:done 2024-09-13T18:31:31.704 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-13T18:31:31.719 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.B8JrrUHpsj 2024-09-13T18:31:31.720 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.B8JrrUHpsj 2024-09-13T18:31:31.785 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.B8JrrUHpsj 2024-09-13T18:31:31.931 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.B8JrrUHpsj is 6KB 2024-09-13T18:31:31.982 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.B8JrrUHpsj 2024-09-13T18:31:31.997 DEBUG:teuthology.orchestra.run.smithi097:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T18:31:32.060 INFO:teuthology.orchestra.run.smithi097.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T18:31:32.060 INFO:teuthology.orchestra.run.smithi097.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T18:31:32.060 INFO:teuthology.orchestra.run.smithi097.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T18:31:32.060 INFO:teuthology.orchestra.run.smithi097.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T18:31:32.061 DEBUG:teuthology.orchestra.run.smithi097:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T18:31:32.215 DEBUG:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2024-09-13T18:32:00.293 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T18:32:00.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-13T18:32:00.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:32:02.220 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T18:32:02.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-13T18:32:02.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:32:36.925 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-09-13T18:32:45.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-13T18:32:45.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:33:00.333 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T18:33:04.321 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-09-13T18:33:09.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-13T18:33:09.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:33:09.679 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-13T18:33:10.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-13T18:33:10.060 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-13T18:33:10.061 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-13T18:33:10.076 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-505.el9.x86_64 2024-09-13T18:33:10.076 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T18:33:10.076 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:33:10.077 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T18:33:11.077 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-09-13T18:33:11.077 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:33:11.154 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-09-13T18:33:11.183 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:16.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-13T18:33:16.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:33:16.739 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-09-13T18:33:17.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-13T18:33:17.089 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T18:33:17.089 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-09-13T18:33:17.104 INFO:teuthology.orchestra.run.smithi097.stdout:5.14.0-505.el9.x86_64 2024-09-13T18:33:17.104 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T18:33:17.104 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:33:17.104 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T18:33:18.105 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T18:33:18.105 DEBUG:teuthology.orchestra.run.smithi097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:33:18.206 INFO:teuthology.orchestra.run.smithi097.stdout:ttyS1 2024-09-13T18:33:18.231 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:18.232 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T18:33:18.254 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T18:33:18.254 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:33:18.257 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:33:18.278 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T18:33:18.336 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T18:33:18.582 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T18:33:18.583 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:33:18.586 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:33:18.882 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T18:33:18.889 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T18:33:18.889 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:33:18.892 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:33:18.920 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:33:18.923 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:33:18.930 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:33:18.935 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:33:18.937 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T18:33:18.944 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T18:33:18.944 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:33:18.976 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:33:19.005 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T18:33:19.016 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T18:33:19.016 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:33:19.044 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:33:19.063 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:33:19.148 DEBUG:teuthology.orchestra.run.smithi097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:33:19.190 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:33:19.283 DEBUG:teuthology.orchestra.run.smithi097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:33:19.311 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:33:19.311 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:33:19.376 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:33:19.430 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:33:19.472 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:33:19.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:33:19.603 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:33:19.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:33:19.671 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2024-09-13T18:33:19.673 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-09-13T18:33:19.716 INFO:teuthology.orchestra.run.smithi097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:33:19.765 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:33:20.131 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T18:33:20.139 INFO:teuthology.task.internal:Starting timer... 2024-09-13T18:33:20.139 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T18:33:20.150 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T18:33:20.159 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-13T18:33:20.159 DEBUG:teuthology.orchestra.run.smithi097:> sudo service auditd rotate 2024-09-13T18:33:20.237 INFO:teuthology.orchestra.run.smithi097.stdout:Rotating logs: 2024-09-13T18:33:20.239 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-09-13T18:33:20.321 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-09-13T18:33:20.323 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T18:33:20.323 DEBUG:teuthology.orchestra.run.smithi097:> /usr/sbin/getenforce 2024-09-13T18:33:20.345 INFO:teuthology.orchestra.run.smithi097.stdout:Permissive 2024-09-13T18:33:20.346 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-09-13T18:33:20.378 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-09-13T18:33:20.378 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi097.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-09-13T18:33:20.378 DEBUG:teuthology.orchestra.run.smithi097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:33:20.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:33:20.410 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:33:20.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:33:20.445 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T18:33:20.445 DEBUG:teuthology.orchestra.run.smithi097:> sudo /usr/sbin/setenforce permissive 2024-09-13T18:33:20.488 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-09-13T18:33:20.519 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T18:33:20.528 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T18:33:20.532 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T18:33:20.675 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T18:33:20.685 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T18:33:20.686 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi097.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T18:37:05.380 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi097.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-09-13T18:37:05.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-13T18:37:05.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:37:05.487 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-09-13T18:37:05.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-13T18:37:05.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-13T18:37:05.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:37:05.649 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-13T18:37:05.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-13T18:37:05.736 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T18:37:05.746 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T18:37:05.746 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:37:05.747 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:37:05.749 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:37:05.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:37:05.775 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:37:05.789 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:37:05.806 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:37:05.814 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: ntpd: command not found 2024-09-13T18:37:05.821 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:37:05.825 INFO:teuthology.orchestra.run.smithi097.stdout:506 Cannot talk to daemon 2024-09-13T18:37:05.839 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:37:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-09-13T18:37:05.853 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:37:05.856 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-09-13T18:37:05.870 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:37:05.884 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:37:05.909 INFO:teuthology.orchestra.run.smithi097.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:37:05.913 INFO:teuthology.orchestra.run.smithi097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:37:05.913 INFO:teuthology.orchestra.run.smithi097.stdout:=============================================================================== 2024-09-13T18:37:05.913 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:37:05.913 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:37:05.913 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:37:05.913 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:37:05.946 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:37:05.950 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:37:05.950 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-13T18:37:05.950 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:37:05.950 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:37:05.950 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:37:05.950 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:37:05.951 INFO:teuthology.run_tasks:Running task install... 2024-09-13T18:37:05.960 DEBUG:teuthology.task.install:project ceph 2024-09-13T18:37:05.960 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T18:37:05.960 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:37:05.960 INFO:teuthology.task.install:Using flavor: default 2024-09-13T18:37:05.966 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T18:37:05.966 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2024-09-13T18:37:05.966 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:37:05.966 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:37:05.967 INFO:teuthology.packaging:ref: None 2024-09-13T18:37:05.967 INFO:teuthology.packaging:tag: None 2024-09-13T18:37:05.967 INFO:teuthology.packaging:branch: quincy 2024-09-13T18:37:05.967 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:37:05.967 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T18:37:05.969 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:37:05.969 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:37:05.969 INFO:teuthology.packaging:ref: None 2024-09-13T18:37:05.969 INFO:teuthology.packaging:tag: None 2024-09-13T18:37:05.969 INFO:teuthology.packaging:branch: quincy 2024-09-13T18:37:05.969 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:37:05.970 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T18:37:06.187 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/ 2024-09-13T18:37:06.187 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1629.geb16b97b 2024-09-13T18:37:06.229 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/ 2024-09-13T18:37:06.229 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1629.geb16b97b 2024-09-13T18:37:06.310 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:37:06.310 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:37:06.310 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:37:06.335 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2024-09-13T18:37:06.336 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:37:06.336 INFO:teuthology.packaging:ref: None 2024-09-13T18:37:06.336 INFO:teuthology.packaging:tag: None 2024-09-13T18:37:06.336 INFO:teuthology.packaging:branch: quincy 2024-09-13T18:37:06.336 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:37:06.336 DEBUG:teuthology.orchestra.run.smithi097:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:37:06.347 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:37:06.347 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:37:06.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:37:06.375 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2024-09-13T18:37:06.375 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:37:06.375 INFO:teuthology.packaging:ref: None 2024-09-13T18:37:06.375 INFO:teuthology.packaging:tag: None 2024-09-13T18:37:06.375 INFO:teuthology.packaging:branch: quincy 2024-09-13T18:37:06.376 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:37:06.376 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:37:06.400 DEBUG:teuthology.orchestra.run.smithi097:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:37:06.441 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:37:06.475 DEBUG:teuthology.orchestra.run.smithi097:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:37:06.518 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:37:06.539 INFO:teuthology.orchestra.run.smithi097.stdout:check_obsoletes = 1 2024-09-13T18:37:06.541 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum clean all 2024-09-13T18:37:06.582 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-09-13T18:37:06.584 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-09-13T18:37:06.773 INFO:teuthology.orchestra.run.smithi097.stdout:45 files removed 2024-09-13T18:37:06.799 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2024-09-13T18:37:06.819 INFO:teuthology.orchestra.run.smithi142.stdout:45 files removed 2024-09-13T18:37:06.846 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2024-09-13T18:37:07.358 INFO:teuthology.orchestra.run.smithi097.stdout:ceph packages for x86_64 279 kB/s | 77 kB 00:00 2024-09-13T18:37:07.389 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 299 kB/s | 77 kB 00:00 2024-09-13T18:37:07.625 INFO:teuthology.orchestra.run.smithi097.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-13T18:37:07.673 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-13T18:37:07.893 INFO:teuthology.orchestra.run.smithi097.stdout:ceph source packages 7.7 kB/s | 1.8 kB 00:00 2024-09-13T18:37:07.948 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 7.5 kB/s | 1.8 kB 00:00 2024-09-13T18:37:08.593 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-13T18:37:09.598 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.2 MB 00:01 2024-09-13T18:37:10.636 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-13T18:37:11.491 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-13T18:37:14.820 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-13T18:37:16.321 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-13T18:37:17.177 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-13T18:37:17.617 INFO:teuthology.orchestra.run.smithi097.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-13T18:37:18.618 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-13T18:37:19.639 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-13T18:37:22.989 INFO:teuthology.orchestra.run.smithi097.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-13T18:37:25.069 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-13T18:37:25.305 INFO:teuthology.orchestra.run.smithi097.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:37:25.306 INFO:teuthology.orchestra.run.smithi097.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:37:25.327 INFO:teuthology.orchestra.run.smithi097.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T18:37:25.328 INFO:teuthology.orchestra.run.smithi097.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T18:37:25.328 INFO:teuthology.orchestra.run.smithi097.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T18:37:25.382 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-13T18:37:25.396 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================= 2024-09-13T18:37:25.396 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-13T18:37:25.396 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================= 2024-09-13T18:37:25.396 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-13T18:37:25.396 INFO:teuthology.orchestra.run.smithi097.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T18:37:25.396 INFO:teuthology.orchestra.run.smithi097.stdout: ceph x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 6.5 k 2024-09-13T18:37:25.396 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 5.0 M 2024-09-13T18:37:25.397 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-fuse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 813 k 2024-09-13T18:37:25.397 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 1.4 M 2024-09-13T18:37:25.397 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 3.4 M 2024-09-13T18:37:25.397 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 7.4 M 2024-09-13T18:37:25.397 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-rook noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 47 k 2024-09-13T18:37:25.397 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-radosgw x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 14 M 2024-09-13T18:37:25.397 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-test x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 48 M 2024-09-13T18:37:25.397 INFO:teuthology.orchestra.run.smithi097.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T18:37:25.397 INFO:teuthology.orchestra.run.smithi097.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T18:37:25.397 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-devel x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 25 k 2024-09-13T18:37:25.397 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 636 k 2024-09-13T18:37:25.398 INFO:teuthology.orchestra.run.smithi097.stdout: librados-devel x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 126 k 2024-09-13T18:37:25.398 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T18:37:25.398 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cephfs x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 157 k 2024-09-13T18:37:25.398 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 320 k 2024-09-13T18:37:25.398 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rbd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 296 k 2024-09-13T18:37:25.398 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rgw x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 99 k 2024-09-13T18:37:25.398 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-fuse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 82 k 2024-09-13T18:37:25.398 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-mirror x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.9 M 2024-09-13T18:37:25.398 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-nbd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 165 k 2024-09-13T18:37:25.398 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrading: 2024-09-13T18:37:25.398 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T18:37:25.398 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T18:37:25.398 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T18:37:25.399 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T18:37:25.399 INFO:teuthology.orchestra.run.smithi097.stdout: librados2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 3.1 M 2024-09-13T18:37:25.399 INFO:teuthology.orchestra.run.smithi097.stdout: librbd1 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.9 M 2024-09-13T18:37:25.399 INFO:teuthology.orchestra.run.smithi097.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T18:37:25.399 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T18:37:25.399 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-13T18:37:25.399 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-common x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 23 M 2024-09-13T18:37:25.399 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 24 k 2024-09-13T18:37:25.399 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mds x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.1 M 2024-09-13T18:37:25.399 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 240 k 2024-09-13T18:37:25.399 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mon x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 3.9 M 2024-09-13T18:37:25.400 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-osd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 15 M 2024-09-13T18:37:25.400 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 15 k 2024-09-13T18:37:25.400 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-selinux x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 25 k 2024-09-13T18:37:25.400 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:37:25.400 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:37:25.400 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:37:25.400 INFO:teuthology.orchestra.run.smithi097.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:37:25.400 INFO:teuthology.orchestra.run.smithi097.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:37:25.400 INFO:teuthology.orchestra.run.smithi097.stdout: libcephsqlite x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 163 k 2024-09-13T18:37:25.400 INFO:teuthology.orchestra.run.smithi097.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:37:25.400 INFO:teuthology.orchestra.run.smithi097.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:37:25.400 INFO:teuthology.orchestra.run.smithi097.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:37:25.400 INFO:teuthology.orchestra.run.smithi097.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:37:25.401 INFO:teuthology.orchestra.run.smithi097.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:37:25.401 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 458 k 2024-09-13T18:37:25.401 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:37:25.401 INFO:teuthology.orchestra.run.smithi097.stdout: librgw2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 4.9 M 2024-09-13T18:37:25.401 INFO:teuthology.orchestra.run.smithi097.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:37:25.401 INFO:teuthology.orchestra.run.smithi097.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T18:37:25.401 INFO:teuthology.orchestra.run.smithi097.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:37:25.401 INFO:teuthology.orchestra.run.smithi097.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:37:25.401 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:37:25.401 INFO:teuthology.orchestra.run.smithi097.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:37:25.401 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:37:25.401 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 45 k 2024-09-13T18:37:25.401 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 120 k 2024-09-13T18:37:25.402 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:37:25.402 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:37:25.402 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:37:25.402 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:37:25.402 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:37:25.402 INFO:teuthology.orchestra.run.smithi097.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:37:25.402 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:37:25.402 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:37:25.402 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:37:25.402 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:37:25.402 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:37:25.402 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:37:25.402 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:37:25.403 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:37:25.403 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T18:37:25.403 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:37:25.403 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:37:25.403 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:37:25.403 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:37:25.403 INFO:teuthology.orchestra.run.smithi097.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:37:25.403 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:37:25.403 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:37:25.403 INFO:teuthology.orchestra.run.smithi097.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:37:25.403 INFO:teuthology.orchestra.run.smithi097.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T18:37:25.403 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:37:25.404 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:37:25.404 INFO:teuthology.orchestra.run.smithi097.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:37:25.404 INFO:teuthology.orchestra.run.smithi097.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:37:25.404 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:37:25.404 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:37:25.404 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:37:25.404 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:37:25.404 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:37:25.404 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:37:25.404 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:37:25.404 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:37:25.405 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:37:25.405 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:37:25.405 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:37:25.405 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:37:25.405 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:37:25.405 INFO:teuthology.orchestra.run.smithi097.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:37:25.405 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:37:25.405 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:37:25.405 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:37:25.405 INFO:teuthology.orchestra.run.smithi097.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:37:25.405 INFO:teuthology.orchestra.run.smithi097.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:37:25.405 INFO:teuthology.orchestra.run.smithi097.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:37:25.405 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:37:25.406 INFO:teuthology.orchestra.run.smithi097.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T18:37:25.406 INFO:teuthology.orchestra.run.smithi097.stdout:Installing weak dependencies: 2024-09-13T18:37:25.406 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T18:37:25.406 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:37:25.406 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-13T18:37:25.406 INFO:teuthology.orchestra.run.smithi097.stdout:======================================================================================= 2024-09-13T18:37:25.406 INFO:teuthology.orchestra.run.smithi097.stdout:Install 105 Packages 2024-09-13T18:37:25.406 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrade 8 Packages 2024-09-13T18:37:25.406 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:37:25.407 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 196 M 2024-09-13T18:37:25.407 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-13T18:37:25.949 INFO:teuthology.orchestra.run.smithi097.stdout:(1/113): ceph-17.2.7-1629.geb16b97b.el9.x86_64. 32 kB/s | 6.5 kB 00:00 2024-09-13T18:37:26.141 INFO:teuthology.orchestra.run.smithi097.stdout:(2/113): ceph-fuse-17.2.7-1629.geb16b97b.el9.x8 4.1 MB/s | 813 kB 00:00 2024-09-13T18:37:26.291 INFO:teuthology.orchestra.run.smithi097.stdout:(3/113): ceph-mds-17.2.7-1629.geb16b97b.el9.x86 14 MB/s | 2.1 MB 00:00 2024-09-13T18:37:26.417 INFO:teuthology.orchestra.run.smithi097.stdout:(4/113): ceph-mgr-17.2.7-1629.geb16b97b.el9.x86 11 MB/s | 1.4 MB 00:00 2024-09-13T18:37:26.642 INFO:teuthology.orchestra.run.smithi097.stdout:(5/113): ceph-base-17.2.7-1629.geb16b97b.el9.x8 5.5 MB/s | 5.0 MB 00:00 2024-09-13T18:37:26.717 INFO:teuthology.orchestra.run.smithi097.stdout:(6/113): ceph-mon-17.2.7-1629.geb16b97b.el9.x86 13 MB/s | 3.9 MB 00:00 2024-09-13T18:37:27.093 INFO:teuthology.orchestra.run.smithi097.stdout:(7/113): ceph-common-17.2.7-1629.geb16b97b.el9. 17 MB/s | 23 MB 00:01 2024-09-13T18:37:27.143 INFO:teuthology.orchestra.run.smithi097.stdout:(8/113): ceph-selinux-17.2.7-1629.geb16b97b.el9 507 kB/s | 25 kB 00:00 2024-09-13T18:37:27.384 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:37:27.385 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:37:27.405 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T18:37:27.406 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T18:37:27.406 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T18:37:27.460 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T18:37:27.477 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-13T18:37:27.477 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-13T18:37:27.477 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-13T18:37:27.477 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T18:37:27.477 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T18:37:27.477 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 6.5 k 2024-09-13T18:37:27.477 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 5.0 M 2024-09-13T18:37:27.477 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 813 k 2024-09-13T18:37:27.478 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 1.4 M 2024-09-13T18:37:27.478 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 3.4 M 2024-09-13T18:37:27.478 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 7.4 M 2024-09-13T18:37:27.478 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 47 k 2024-09-13T18:37:27.478 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 14 M 2024-09-13T18:37:27.478 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 48 M 2024-09-13T18:37:27.478 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T18:37:27.478 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T18:37:27.478 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 25 k 2024-09-13T18:37:27.478 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 636 k 2024-09-13T18:37:27.478 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 126 k 2024-09-13T18:37:27.478 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T18:37:27.478 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 157 k 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 320 k 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 296 k 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 99 k 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 82 k 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.9 M 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 165 k 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 3.1 M 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.9 M 2024-09-13T18:37:27.479 INFO:teuthology.orchestra.run.smithi142.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T18:37:27.480 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T18:37:27.480 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-13T18:37:27.480 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 23 M 2024-09-13T18:37:27.480 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 24 k 2024-09-13T18:37:27.480 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.1 M 2024-09-13T18:37:27.480 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 240 k 2024-09-13T18:37:27.480 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 3.9 M 2024-09-13T18:37:27.480 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 15 M 2024-09-13T18:37:27.480 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 15 k 2024-09-13T18:37:27.480 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 25 k 2024-09-13T18:37:27.480 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:37:27.480 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:37:27.480 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 163 k 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 458 k 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 4.9 M 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T18:37:27.481 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 45 k 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 120 k 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:37:27.482 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:37:27.483 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:37:27.484 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T18:37:27.484 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:37:27.484 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:37:27.484 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:37:27.484 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:37:27.484 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:37:27.484 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:37:27.484 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:37:27.484 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:37:27.484 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:37:27.484 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:37:27.484 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:37:27.484 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T18:37:27.486 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-09-13T18:37:27.486 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T18:37:27.486 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:37:27.486 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T18:37:27.486 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-13T18:37:27.486 INFO:teuthology.orchestra.run.smithi142.stdout:Install 105 Packages 2024-09-13T18:37:27.486 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 8 Packages 2024-09-13T18:37:27.486 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:37:27.486 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 196 M 2024-09-13T18:37:27.487 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T18:37:27.501 INFO:teuthology.orchestra.run.smithi097.stdout:(9/113): ceph-radosgw-17.2.7-1629.geb16b97b.el9 18 MB/s | 14 MB 00:00 2024-09-13T18:37:27.552 INFO:teuthology.orchestra.run.smithi097.stdout:(10/113): libcephfs-devel-17.2.7-1629.geb16b97b 501 kB/s | 25 kB 00:00 2024-09-13T18:37:27.643 INFO:teuthology.orchestra.run.smithi097.stdout:(11/113): libcephfs2-17.2.7-1629.geb16b97b.el9. 6.8 MB/s | 636 kB 00:00 2024-09-13T18:37:27.727 INFO:teuthology.orchestra.run.smithi097.stdout:(12/113): libcephsqlite-17.2.7-1629.geb16b97b.e 1.9 MB/s | 163 kB 00:00 2024-09-13T18:37:27.812 INFO:teuthology.orchestra.run.smithi142.stdout:(1/113): ceph-17.2.7-1629.geb16b97b.el9.x86_64. 32 kB/s | 6.5 kB 00:00 2024-09-13T18:37:27.877 INFO:teuthology.orchestra.run.smithi097.stdout:(13/113): ceph-osd-17.2.7-1629.geb16b97b.el9.x8 12 MB/s | 15 MB 00:01 2024-09-13T18:37:27.902 INFO:teuthology.orchestra.run.smithi097.stdout:(14/113): librados-devel-17.2.7-1629.geb16b97b. 721 kB/s | 126 kB 00:00 2024-09-13T18:37:27.945 INFO:teuthology.orchestra.run.smithi097.stdout:(15/113): libradosstriper1-17.2.7-1629.geb16b97 6.7 MB/s | 458 kB 00:00 2024-09-13T18:37:28.028 INFO:teuthology.orchestra.run.smithi097.stdout:(16/113): python3-ceph-argparse-17.2.7-1629.geb 540 kB/s | 45 kB 00:00 2024-09-13T18:37:28.145 INFO:teuthology.orchestra.run.smithi097.stdout:(17/113): librgw2-17.2.7-1629.geb16b97b.el9.x86 20 MB/s | 4.9 MB 00:00 2024-09-13T18:37:28.170 INFO:teuthology.orchestra.run.smithi097.stdout:(18/113): python3-ceph-common-17.2.7-1629.geb16 848 kB/s | 120 kB 00:00 2024-09-13T18:37:28.212 INFO:teuthology.orchestra.run.smithi097.stdout:(19/113): python3-cephfs-17.2.7-1629.geb16b97b. 2.3 MB/s | 157 kB 00:00 2024-09-13T18:37:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:(2/113): ceph-fuse-17.2.7-1629.geb16b97b.el9.x8 1.9 MB/s | 813 kB 00:00 2024-09-13T18:37:28.238 INFO:teuthology.orchestra.run.smithi097.stdout:(20/113): python3-rados-17.2.7-1629.geb16b97b.e 4.7 MB/s | 320 kB 00:00 2024-09-13T18:37:28.296 INFO:teuthology.orchestra.run.smithi097.stdout:(21/113): python3-rbd-17.2.7-1629.geb16b97b.el9 3.5 MB/s | 296 kB 00:00 2024-09-13T18:37:28.322 INFO:teuthology.orchestra.run.smithi097.stdout:(22/113): python3-rgw-17.2.7-1629.geb16b97b.el9 1.2 MB/s | 99 kB 00:00 2024-09-13T18:37:28.372 INFO:teuthology.orchestra.run.smithi097.stdout:(23/113): rbd-fuse-17.2.7-1629.geb16b97b.el9.x8 1.1 MB/s | 82 kB 00:00 2024-09-13T18:37:28.481 INFO:teuthology.orchestra.run.smithi097.stdout:(24/113): rbd-nbd-17.2.7-1629.geb16b97b.el9.x86 1.5 MB/s | 165 kB 00:00 2024-09-13T18:37:28.556 INFO:teuthology.orchestra.run.smithi097.stdout:(25/113): ceph-grafana-dashboards-17.2.7-1629.g 326 kB/s | 24 kB 00:00 2024-09-13T18:37:28.587 INFO:teuthology.orchestra.run.smithi142.stdout:(3/113): ceph-base-17.2.7-1629.geb16b97b.el9.x8 5.1 MB/s | 5.0 MB 00:00 2024-09-13T18:37:28.606 INFO:teuthology.orchestra.run.smithi097.stdout:(26/113): rbd-mirror-17.2.7-1629.geb16b97b.el9. 10 MB/s | 2.9 MB 00:00 2024-09-13T18:37:28.748 INFO:teuthology.orchestra.run.smithi097.stdout:(27/113): ceph-mgr-dashboard-17.2.7-1629.geb16b 17 MB/s | 3.4 MB 00:00 2024-09-13T18:37:28.832 INFO:teuthology.orchestra.run.smithi097.stdout:(28/113): ceph-mgr-modules-core-17.2.7-1629.geb 2.8 MB/s | 240 kB 00:00 2024-09-13T18:37:28.837 INFO:teuthology.orchestra.run.smithi142.stdout:(4/113): ceph-mgr-17.2.7-1629.geb16b97b.el9.x86 5.6 MB/s | 1.4 MB 00:00 2024-09-13T18:37:28.907 INFO:teuthology.orchestra.run.smithi097.stdout:(29/113): ceph-mgr-rook-17.2.7-1629.geb16b97b.e 633 kB/s | 47 kB 00:00 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi097.stdout:(30/113): ceph-prometheus-alerts-17.2.7-1629.ge 159 kB/s | 15 kB 00:00 2024-09-13T18:37:29.013 INFO:teuthology.orchestra.run.smithi142.stdout:(5/113): ceph-mds-17.2.7-1629.geb16b97b.el9.x86 2.6 MB/s | 2.1 MB 00:00 2024-09-13T18:37:29.108 INFO:teuthology.orchestra.run.smithi097.stdout:(31/113): fuse-2.9.9-16.el9.x86_64.rpm 737 kB/s | 80 kB 00:00 2024-09-13T18:37:29.238 INFO:teuthology.orchestra.run.smithi142.stdout:(6/113): ceph-mon-17.2.7-1629.geb16b97b.el9.x86 9.8 MB/s | 3.9 MB 00:00 2024-09-13T18:37:29.517 INFO:teuthology.orchestra.run.smithi097.stdout:(32/113): ceph-test-17.2.7-1629.geb16b97b.el9.x 20 MB/s | 48 MB 00:02 2024-09-13T18:37:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:(33/113): ceph-mgr-diskprediction-local-17.2.7- 7.4 MB/s | 7.4 MB 00:01 2024-09-13T18:37:29.692 INFO:teuthology.orchestra.run.smithi097.stdout:(34/113): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-13T18:37:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:(35/113): libquadmath-11.5.0-2.el9.x86_64.rpm 790 kB/s | 191 kB 00:00 2024-09-13T18:37:29.784 INFO:teuthology.orchestra.run.smithi097.stdout:(36/113): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-13T18:37:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:(37/113): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-13T18:37:29.843 INFO:teuthology.orchestra.run.smithi097.stdout:(38/113): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-13T18:37:29.868 INFO:teuthology.orchestra.run.smithi097.stdout:(39/113): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-13T18:37:29.894 INFO:teuthology.orchestra.run.smithi097.stdout:(40/113): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-13T18:37:29.919 INFO:teuthology.orchestra.run.smithi097.stdout:(41/113): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-13T18:37:29.977 INFO:teuthology.orchestra.run.smithi097.stdout:(42/113): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-09-13T18:37:29.988 INFO:teuthology.orchestra.run.smithi142.stdout:(7/113): ceph-common-17.2.7-1629.geb16b97b.el9. 9.5 MB/s | 23 MB 00:02 2024-09-13T18:37:30.047 INFO:teuthology.orchestra.run.smithi097.stdout:(43/113): flexiblas-3.0.4-8.el9.x86_64.rpm 470 kB/s | 33 kB 00:00 2024-09-13T18:37:30.078 INFO:teuthology.orchestra.run.smithi097.stdout:(44/113): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-09-13T18:37:30.120 INFO:teuthology.orchestra.run.smithi097.stdout:(45/113): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-13T18:37:30.147 INFO:teuthology.orchestra.run.smithi142.stdout:(8/113): ceph-radosgw-17.2.7-1629.geb16b97b.el9 16 MB/s | 14 MB 00:00 2024-09-13T18:37:30.162 INFO:teuthology.orchestra.run.smithi097.stdout:(46/113): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-09-13T18:37:30.164 INFO:teuthology.orchestra.run.smithi142.stdout:(9/113): ceph-selinux-17.2.7-1629.geb16b97b.el9 143 kB/s | 25 kB 00:00 2024-09-13T18:37:30.204 INFO:teuthology.orchestra.run.smithi097.stdout:(47/113): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-09-13T18:37:30.214 INFO:teuthology.orchestra.run.smithi142.stdout:(10/113): libcephfs-devel-17.2.7-1629.geb16b97b 499 kB/s | 25 kB 00:00 2024-09-13T18:37:30.229 INFO:teuthology.orchestra.run.smithi097.stdout:(48/113): librabbitmq-0.11.0-7.el9.x86_64.rpm 677 kB/s | 45 kB 00:00 2024-09-13T18:37:30.271 INFO:teuthology.orchestra.run.smithi097.stdout:(49/113): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-13T18:37:30.298 INFO:teuthology.orchestra.run.smithi142.stdout:(11/113): libcephfs2-17.2.7-1629.geb16b97b.el9. 7.5 MB/s | 636 kB 00:00 2024-09-13T18:37:30.321 INFO:teuthology.orchestra.run.smithi097.stdout:(50/113): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-13T18:37:30.363 INFO:teuthology.orchestra.run.smithi097.stdout:(51/113): openblas-0.3.26-2.el9.x86_64.rpm 928 kB/s | 38 kB 00:00 2024-09-13T18:37:30.373 INFO:teuthology.orchestra.run.smithi142.stdout:(12/113): libcephsqlite-17.2.7-1629.geb16b97b.e 2.1 MB/s | 163 kB 00:00 2024-09-13T18:37:30.422 INFO:teuthology.orchestra.run.smithi097.stdout:(52/113): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-13T18:37:30.532 INFO:teuthology.orchestra.run.smithi142.stdout:(13/113): ceph-osd-17.2.7-1629.geb16b97b.el9.x8 10 MB/s | 15 MB 00:01 2024-09-13T18:37:30.557 INFO:teuthology.orchestra.run.smithi142.stdout:(14/113): librados-devel-17.2.7-1629.geb16b97b. 688 kB/s | 126 kB 00:00 2024-09-13T18:37:30.590 INFO:teuthology.orchestra.run.smithi142.stdout:(15/113): libradosstriper1-17.2.7-1629.geb16b97 7.7 MB/s | 458 kB 00:00 2024-09-13T18:37:30.641 INFO:teuthology.orchestra.run.smithi142.stdout:(16/113): python3-ceph-argparse-17.2.7-1629.geb 907 kB/s | 45 kB 00:00 2024-09-13T18:37:30.716 INFO:teuthology.orchestra.run.smithi142.stdout:(17/113): python3-ceph-common-17.2.7-1629.geb16 1.6 MB/s | 120 kB 00:00 2024-09-13T18:37:30.764 INFO:teuthology.orchestra.run.smithi097.stdout:(53/113): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.2 MB/s | 3.0 MB 00:00 2024-09-13T18:37:30.833 INFO:teuthology.orchestra.run.smithi142.stdout:(18/113): librgw2-17.2.7-1629.geb16b97b.el9.x86 18 MB/s | 4.9 MB 00:00 2024-09-13T18:37:30.856 INFO:teuthology.orchestra.run.smithi097.stdout:(54/113): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-13T18:37:30.858 INFO:teuthology.orchestra.run.smithi142.stdout:(19/113): python3-cephfs-17.2.7-1629.geb16b97b. 1.1 MB/s | 157 kB 00:00 2024-09-13T18:37:30.883 INFO:teuthology.orchestra.run.smithi142.stdout:(20/113): python3-rados-17.2.7-1629.geb16b97b.e 6.2 MB/s | 320 kB 00:00 2024-09-13T18:37:30.889 INFO:teuthology.orchestra.run.smithi097.stdout:(55/113): python3-jsonpatch-1.21-16.el9.noarch. 775 kB/s | 26 kB 00:00 2024-09-13T18:37:30.908 INFO:teuthology.orchestra.run.smithi142.stdout:(21/113): python3-rbd-17.2.7-1629.geb16b97b.el9 5.8 MB/s | 296 kB 00:00 2024-09-13T18:37:30.923 INFO:teuthology.orchestra.run.smithi097.stdout:(56/113): python3-jsonpointer-2.0-4.el9.noarch. 574 kB/s | 19 kB 00:00 2024-09-13T18:37:30.934 INFO:teuthology.orchestra.run.smithi142.stdout:(22/113): python3-rgw-17.2.7-1629.geb16b97b.el9 1.9 MB/s | 99 kB 00:00 2024-09-13T18:37:30.959 INFO:teuthology.orchestra.run.smithi142.stdout:(23/113): rbd-fuse-17.2.7-1629.geb16b97b.el9.x8 1.6 MB/s | 82 kB 00:00 2024-09-13T18:37:30.999 INFO:teuthology.orchestra.run.smithi097.stdout:(57/113): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-13T18:37:31.009 INFO:teuthology.orchestra.run.smithi142.stdout:(24/113): rbd-nbd-17.2.7-1629.geb16b97b.el9.x86 3.2 MB/s | 165 kB 00:00 2024-09-13T18:37:31.032 INFO:teuthology.orchestra.run.smithi097.stdout:(58/113): python3-markupsafe-1.1.1-12.el9.x86_6 1.0 MB/s | 35 kB 00:00 2024-09-13T18:37:31.076 INFO:teuthology.orchestra.run.smithi142.stdout:(25/113): rbd-mirror-17.2.7-1629.geb16b97b.el9. 21 MB/s | 2.9 MB 00:00 2024-09-13T18:37:31.093 INFO:teuthology.orchestra.run.smithi142.stdout:(26/113): ceph-grafana-dashboards-17.2.7-1629.g 293 kB/s | 24 kB 00:00 2024-09-13T18:37:31.302 INFO:teuthology.orchestra.run.smithi142.stdout:(27/113): ceph-mgr-dashboard-17.2.7-1629.geb16b 15 MB/s | 3.4 MB 00:00 2024-09-13T18:37:31.361 INFO:teuthology.orchestra.run.smithi142.stdout:(28/113): ceph-mgr-modules-core-17.2.7-1629.geb 4.0 MB/s | 240 kB 00:00 2024-09-13T18:37:31.436 INFO:teuthology.orchestra.run.smithi142.stdout:(29/113): ceph-mgr-rook-17.2.7-1629.geb16b97b.e 634 kB/s | 47 kB 00:00 2024-09-13T18:37:31.541 INFO:teuthology.orchestra.run.smithi097.stdout:(59/113): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-09-13T18:37:31.570 INFO:teuthology.orchestra.run.smithi142.stdout:(30/113): ceph-mgr-diskprediction-local-17.2.7- 16 MB/s | 7.4 MB 00:00 2024-09-13T18:37:31.595 INFO:teuthology.orchestra.run.smithi142.stdout:(31/113): ceph-prometheus-alerts-17.2.7-1629.ge 92 kB/s | 15 kB 00:00 2024-09-13T18:37:31.641 INFO:teuthology.orchestra.run.smithi097.stdout:(60/113): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-09-13T18:37:31.695 INFO:teuthology.orchestra.run.smithi142.stdout:(32/113): fuse-2.9.9-16.el9.x86_64.rpm 639 kB/s | 80 kB 00:00 2024-09-13T18:37:31.750 INFO:teuthology.orchestra.run.smithi097.stdout:(61/113): openblas-openmp-0.3.26-2.el9.x86_64.r 3.6 MB/s | 4.9 MB 00:01 2024-09-13T18:37:31.775 INFO:teuthology.orchestra.run.smithi097.stdout:(62/113): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-09-13T18:37:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:(63/113): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-13T18:37:31.842 INFO:teuthology.orchestra.run.smithi097.stdout:(64/113): python3-prettytable-0.7.2-27.el9.noar 631 kB/s | 42 kB 00:00 2024-09-13T18:37:31.901 INFO:teuthology.orchestra.run.smithi097.stdout:(65/113): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-13T18:37:31.943 INFO:teuthology.orchestra.run.smithi097.stdout:(66/113): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-13T18:37:31.985 INFO:teuthology.orchestra.run.smithi097.stdout:(67/113): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-13T18:37:32.027 INFO:teuthology.orchestra.run.smithi097.stdout:(68/113): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-09-13T18:37:32.069 INFO:teuthology.orchestra.run.smithi097.stdout:(69/113): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-13T18:37:32.202 INFO:teuthology.orchestra.run.smithi097.stdout:(70/113): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-13T18:37:32.261 INFO:teuthology.orchestra.run.smithi097.stdout:(71/113): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-13T18:37:32.262 INFO:teuthology.orchestra.run.smithi142.stdout:(33/113): ceph-test-17.2.7-1629.geb16b97b.el9.x 23 MB/s | 48 MB 00:02 2024-09-13T18:37:32.303 INFO:teuthology.orchestra.run.smithi097.stdout:(72/113): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-13T18:37:32.321 INFO:teuthology.orchestra.run.smithi142.stdout:(34/113): libquadmath-11.5.0-2.el9.x86_64.rpm 306 kB/s | 191 kB 00:00 2024-09-13T18:37:32.346 INFO:teuthology.orchestra.run.smithi142.stdout:(35/113): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-13T18:37:32.353 INFO:teuthology.orchestra.run.smithi097.stdout:(73/113): gperftools-libs-2.9.1-3.el9.x86_64.rp 6.0 MB/s | 308 kB 00:00 2024-09-13T18:37:32.378 INFO:teuthology.orchestra.run.smithi097.stdout:(74/113): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T18:37:32.387 INFO:teuthology.orchestra.run.smithi142.stdout:(36/113): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-13T18:37:32.404 INFO:teuthology.orchestra.run.smithi097.stdout:(75/113): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-13T18:37:32.429 INFO:teuthology.orchestra.run.smithi097.stdout:(76/113): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-13T18:37:32.429 INFO:teuthology.orchestra.run.smithi142.stdout:(37/113): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-13T18:37:32.454 INFO:teuthology.orchestra.run.smithi097.stdout:(77/113): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-09-13T18:37:32.463 INFO:teuthology.orchestra.run.smithi142.stdout:(38/113): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-13T18:37:32.479 INFO:teuthology.orchestra.run.smithi097.stdout:(78/113): python3-certifi-2023.05.07-4.el9.noar 568 kB/s | 14 kB 00:00 2024-09-13T18:37:32.488 INFO:teuthology.orchestra.run.smithi142.stdout:(39/113): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-13T18:37:32.496 INFO:teuthology.orchestra.run.smithi097.stdout:(79/113): python3-cheroot-8.6.0-4.el9.noarch.rp 10 MB/s | 172 kB 00:00 2024-09-13T18:37:32.514 INFO:teuthology.orchestra.run.smithi142.stdout:(40/113): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-13T18:37:32.530 INFO:teuthology.orchestra.run.smithi097.stdout:(80/113): python3-cherrypy-18.6.1-2.el9.noarch. 11 MB/s | 358 kB 00:00 2024-09-13T18:37:32.555 INFO:teuthology.orchestra.run.smithi097.stdout:(81/113): python3-google-auth-2.34.0-1.el9.noar 8.6 MB/s | 220 kB 00:00 2024-09-13T18:37:32.581 INFO:teuthology.orchestra.run.smithi097.stdout:(82/113): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-13T18:37:32.597 INFO:teuthology.orchestra.run.smithi142.stdout:(41/113): python3-cryptography-36.0.1-4.el9.x86 4.4 MB/s | 1.2 MB 00:00 2024-09-13T18:37:32.623 INFO:teuthology.orchestra.run.smithi142.stdout:(42/113): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-13T18:37:32.648 INFO:teuthology.orchestra.run.smithi097.stdout:(83/113): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.2 MB/s | 5.1 MB 00:01 2024-09-13T18:37:32.673 INFO:teuthology.orchestra.run.smithi097.stdout:(84/113): python3-jaraco-classes-3.2.1-5.el9.no 192 kB/s | 18 kB 00:00 2024-09-13T18:37:32.706 INFO:teuthology.orchestra.run.smithi142.stdout:(43/113): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-09-13T18:37:32.707 INFO:teuthology.orchestra.run.smithi097.stdout:(85/113): python3-jaraco-functools-3.5.0-2.el9. 750 kB/s | 19 kB 00:00 2024-09-13T18:37:32.732 INFO:teuthology.orchestra.run.smithi097.stdout:(86/113): python3-jaraco-text-3.2.0-6.el9.noarc 853 kB/s | 20 kB 00:00 2024-09-13T18:37:32.757 INFO:teuthology.orchestra.run.smithi097.stdout:(87/113): python3-jaraco-collections-3.0.0-8.el 211 kB/s | 23 kB 00:00 2024-09-13T18:37:32.783 INFO:teuthology.orchestra.run.smithi097.stdout:(88/113): python3-jwt+crypto-2.4.0-1.el9.noarch 180 kB/s | 9.0 kB 00:00 2024-09-13T18:37:32.798 INFO:teuthology.orchestra.run.smithi142.stdout:(44/113): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-13T18:37:32.808 INFO:teuthology.orchestra.run.smithi097.stdout:(89/113): python3-jwt-2.4.0-1.el9.noarch.rpm 816 kB/s | 41 kB 00:00 2024-09-13T18:37:32.833 INFO:teuthology.orchestra.run.smithi097.stdout:(90/113): python3-logutils-0.3.5-21.el9.noarch. 1.8 MB/s | 46 kB 00:00 2024-09-13T18:37:32.848 INFO:teuthology.orchestra.run.smithi142.stdout:(45/113): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-13T18:37:32.859 INFO:teuthology.orchestra.run.smithi097.stdout:(91/113): python3-more-itertools-8.12.0-2.el9.n 3.1 MB/s | 79 kB 00:00 2024-09-13T18:37:32.874 INFO:teuthology.orchestra.run.smithi142.stdout:(46/113): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-09-13T18:37:32.892 INFO:teuthology.orchestra.run.smithi097.stdout:(92/113): python3-pecan-1.4.2-3.el9.noarch.rpm 8.1 MB/s | 272 kB 00:00 2024-09-13T18:37:32.907 INFO:teuthology.orchestra.run.smithi142.stdout:(47/113): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-13T18:37:32.918 INFO:teuthology.orchestra.run.smithi097.stdout:(93/113): python3-portend-3.1.0-2.el9.noarch.rp 656 kB/s | 16 kB 00:00 2024-09-13T18:37:32.924 INFO:teuthology.orchestra.run.smithi142.stdout:(48/113): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-09-13T18:37:32.943 INFO:teuthology.orchestra.run.smithi097.stdout:(94/113): python3-kubernetes-26.1.0-2.el9.noarc 6.4 MB/s | 1.0 MB 00:00 2024-09-13T18:37:32.960 INFO:teuthology.orchestra.run.smithi097.stdout:(95/113): python3-pyOpenSSL-21.0.0-1.el9.noarch 2.1 MB/s | 90 kB 00:00 2024-09-13T18:37:32.966 INFO:teuthology.orchestra.run.smithi142.stdout:(49/113): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-13T18:37:32.977 INFO:teuthology.orchestra.run.smithi097.stdout:(96/113): python3-repoze-lru-0.7-16.el9.noarch. 914 kB/s | 31 kB 00:00 2024-09-13T18:37:33.002 INFO:teuthology.orchestra.run.smithi097.stdout:(97/113): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-13T18:37:33.019 INFO:teuthology.orchestra.run.smithi097.stdout:(98/113): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-13T18:37:33.025 INFO:teuthology.orchestra.run.smithi142.stdout:(50/113): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-13T18:37:33.036 INFO:teuthology.orchestra.run.smithi097.stdout:(99/113): python3-tempora-5.0.0-2.el9.noarch.rp 1.0 MB/s | 36 kB 00:00 2024-09-13T18:37:33.050 INFO:teuthology.orchestra.run.smithi142.stdout:(51/113): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-13T18:37:33.061 INFO:teuthology.orchestra.run.smithi097.stdout:(100/113): python3-webob-1.8.8-2.el9.noarch.rpm 5.4 MB/s | 230 kB 00:00 2024-09-13T18:37:33.067 INFO:teuthology.orchestra.run.smithi142.stdout:(52/113): openblas-0.3.26-2.el9.x86_64.rpm 919 kB/s | 38 kB 00:00 2024-09-13T18:37:33.086 INFO:teuthology.orchestra.run.smithi097.stdout:(101/113): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-13T18:37:33.120 INFO:teuthology.orchestra.run.smithi097.stdout:(102/113): python3-zc-lockfile-2.0-10.el9.noarc 597 kB/s | 20 kB 00:00 2024-09-13T18:37:33.146 INFO:teuthology.orchestra.run.smithi097.stdout:(103/113): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-13T18:37:33.204 INFO:teuthology.orchestra.run.smithi097.stdout:(104/113): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-13T18:37:33.421 INFO:teuthology.orchestra.run.smithi097.stdout:(105/113): librados2-17.2.7-1629.geb16b97b.el9. 11 MB/s | 3.1 MB 00:00 2024-09-13T18:37:33.509 INFO:teuthology.orchestra.run.smithi142.stdout:(53/113): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.7 MB/s | 3.0 MB 00:00 2024-09-13T18:37:33.580 INFO:teuthology.orchestra.run.smithi097.stdout:(106/113): librbd1-17.2.7-1629.geb16b97b.el9.x8 7.8 MB/s | 2.9 MB 00:00 2024-09-13T18:37:33.651 INFO:teuthology.orchestra.run.smithi142.stdout:(54/113): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-13T18:37:33.672 INFO:teuthology.orchestra.run.smithi097.stdout:(107/113): NetworkManager-1.49.90-1.el9.x86_64. 9.3 MB/s | 2.3 MB 00:00 2024-09-13T18:37:33.693 INFO:teuthology.orchestra.run.smithi142.stdout:(55/113): python3-jsonpatch-1.21-16.el9.noarch. 616 kB/s | 26 kB 00:00 2024-09-13T18:37:33.713 INFO:teuthology.orchestra.run.smithi097.stdout:(108/113): NetworkManager-team-1.49.90-1.el9.x8 979 kB/s | 41 kB 00:00 2024-09-13T18:37:33.734 INFO:teuthology.orchestra.run.smithi142.stdout:(56/113): python3-jsonpointer-2.0-4.el9.noarch. 462 kB/s | 19 kB 00:00 2024-09-13T18:37:33.755 INFO:teuthology.orchestra.run.smithi097.stdout:(109/113): NetworkManager-tui-1.49.90-1.el9.x86 5.8 MB/s | 249 kB 00:00 2024-09-13T18:37:33.797 INFO:teuthology.orchestra.run.smithi097.stdout:(110/113): NetworkManager-libnm-1.49.90-1.el9.x 8.3 MB/s | 1.8 MB 00:00 2024-09-13T18:37:33.839 INFO:teuthology.orchestra.run.smithi097.stdout:(111/113): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-13T18:37:33.851 INFO:teuthology.orchestra.run.smithi142.stdout:(57/113): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-13T18:37:33.894 INFO:teuthology.orchestra.run.smithi142.stdout:(58/113): python3-markupsafe-1.1.1-12.el9.x86_6 837 kB/s | 35 kB 00:00 2024-09-13T18:37:33.898 INFO:teuthology.orchestra.run.smithi097.stdout:(112/113): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-13T18:37:35.244 INFO:teuthology.orchestra.run.smithi142.stdout:(59/113): openblas-openmp-0.3.26-2.el9.x86_64.r 2.3 MB/s | 4.9 MB 00:02 2024-09-13T18:37:35.302 INFO:teuthology.orchestra.run.smithi142.stdout:(60/113): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-09-13T18:37:35.419 INFO:teuthology.orchestra.run.smithi142.stdout:(61/113): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 250 kB 00:00 2024-09-13T18:37:35.469 INFO:teuthology.orchestra.run.smithi142.stdout:(62/113): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-09-13T18:37:35.519 INFO:teuthology.orchestra.run.smithi142.stdout:(63/113): python3-packaging-20.9-5.el9.noarch.r 770 kB/s | 77 kB 00:00 2024-09-13T18:37:35.536 INFO:teuthology.orchestra.run.smithi142.stdout:(64/113): python3-prettytable-0.7.2-27.el9.noar 633 kB/s | 42 kB 00:00 2024-09-13T18:37:35.637 INFO:teuthology.orchestra.run.smithi142.stdout:(65/113): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-13T18:37:35.687 INFO:teuthology.orchestra.run.smithi142.stdout:(66/113): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-13T18:37:35.720 INFO:teuthology.orchestra.run.smithi142.stdout:(67/113): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-09-13T18:37:35.746 INFO:teuthology.orchestra.run.smithi142.stdout:(68/113): python3-requests-oauthlib-1.3.0-12.el 918 kB/s | 54 kB 00:00 2024-09-13T18:37:35.796 INFO:teuthology.orchestra.run.smithi142.stdout:(69/113): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-09-13T18:37:35.980 INFO:teuthology.orchestra.run.smithi142.stdout:(70/113): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-13T18:37:36.072 INFO:teuthology.orchestra.run.smithi142.stdout:(71/113): xmlstarlet-1.6.1-20.el9.x86_64.rpm 697 kB/s | 64 kB 00:00 2024-09-13T18:37:36.130 INFO:teuthology.orchestra.run.smithi142.stdout:(72/113): zlib-devel-1.2.11-41.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-09-13T18:37:36.181 INFO:teuthology.orchestra.run.smithi142.stdout:(73/113): gperftools-libs-2.9.1-3.el9.x86_64.rp 6.0 MB/s | 308 kB 00:00 2024-09-13T18:37:36.206 INFO:teuthology.orchestra.run.smithi142.stdout:(74/113): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T18:37:36.231 INFO:teuthology.orchestra.run.smithi142.stdout:(75/113): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-13T18:37:36.256 INFO:teuthology.orchestra.run.smithi142.stdout:(76/113): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-13T18:37:36.282 INFO:teuthology.orchestra.run.smithi142.stdout:(77/113): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-09-13T18:37:36.307 INFO:teuthology.orchestra.run.smithi142.stdout:(78/113): python3-certifi-2023.05.07-4.el9.noar 563 kB/s | 14 kB 00:00 2024-09-13T18:37:36.332 INFO:teuthology.orchestra.run.smithi142.stdout:(79/113): python3-cheroot-8.6.0-4.el9.noarch.rp 6.7 MB/s | 172 kB 00:00 2024-09-13T18:37:36.366 INFO:teuthology.orchestra.run.smithi142.stdout:(80/113): python3-cherrypy-18.6.1-2.el9.noarch. 11 MB/s | 358 kB 00:00 2024-09-13T18:37:36.391 INFO:teuthology.orchestra.run.smithi142.stdout:(81/113): python3-google-auth-2.34.0-1.el9.noar 8.6 MB/s | 220 kB 00:00 2024-09-13T18:37:36.416 INFO:teuthology.orchestra.run.smithi142.stdout:(82/113): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-13T18:37:36.442 INFO:teuthology.orchestra.run.smithi142.stdout:(83/113): python3-jaraco-classes-3.2.1-5.el9.no 715 kB/s | 18 kB 00:00 2024-09-13T18:37:36.467 INFO:teuthology.orchestra.run.smithi142.stdout:(84/113): python3-jaraco-collections-3.0.0-8.el 925 kB/s | 23 kB 00:00 2024-09-13T18:37:36.492 INFO:teuthology.orchestra.run.smithi142.stdout:(85/113): python3-jaraco-functools-3.5.0-2.el9. 783 kB/s | 19 kB 00:00 2024-09-13T18:37:36.517 INFO:teuthology.orchestra.run.smithi142.stdout:(86/113): python3-jaraco-text-3.2.0-6.el9.noarc 793 kB/s | 20 kB 00:00 2024-09-13T18:37:36.543 INFO:teuthology.orchestra.run.smithi142.stdout:(87/113): python3-jwt+crypto-2.4.0-1.el9.noarch 364 kB/s | 9.0 kB 00:00 2024-09-13T18:37:36.568 INFO:teuthology.orchestra.run.smithi142.stdout:(88/113): python3-jwt-2.4.0-1.el9.noarch.rpm 1.6 MB/s | 41 kB 00:00 2024-09-13T18:37:36.618 INFO:teuthology.orchestra.run.smithi142.stdout:(89/113): python3-kubernetes-26.1.0-2.el9.noarc 21 MB/s | 1.0 MB 00:00 2024-09-13T18:37:36.644 INFO:teuthology.orchestra.run.smithi142.stdout:(90/113): python3-logutils-0.3.5-21.el9.noarch. 1.8 MB/s | 46 kB 00:00 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi142.stdout:(91/113): python3-more-itertools-8.12.0-2.el9.n 3.1 MB/s | 79 kB 00:00 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi142.stdout:(92/113): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.8 MB/s | 5.1 MB 00:02 2024-09-13T18:37:37.154 INFO:teuthology.orchestra.run.smithi097.stdout:(113/113): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.3 MB/s | 16 MB 00:04 2024-09-13T18:37:37.154 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:37:37.154 INFO:teuthology.orchestra.run.smithi097.stdout:Total 17 MB/s | 196 MB 00:11 2024-09-13T18:37:37.157 INFO:teuthology.orchestra.run.smithi142.stdout:(93/113): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-09-13T18:37:37.157 INFO:teuthology.orchestra.run.smithi142.stdout:(94/113): python3-pyOpenSSL-21.0.0-1.el9.noarch 3.8 MB/s | 90 kB 00:00 2024-09-13T18:37:37.157 INFO:teuthology.orchestra.run.smithi142.stdout:(95/113): python3-portend-3.1.0-2.el9.noarch.rp 218 kB/s | 16 kB 00:00 2024-09-13T18:37:37.157 INFO:teuthology.orchestra.run.smithi142.stdout:(96/113): python3-repoze-lru-0.7-16.el9.noarch. 918 kB/s | 31 kB 00:00 2024-09-13T18:37:37.157 INFO:teuthology.orchestra.run.smithi142.stdout:(97/113): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T18:37:37.158 INFO:teuthology.orchestra.run.smithi142.stdout:(98/113): python3-routes-2.5.1-5.el9.noarch.rpm 2.7 MB/s | 188 kB 00:00 2024-09-13T18:37:37.158 INFO:teuthology.orchestra.run.smithi142.stdout:(99/113): python3-tempora-5.0.0-2.el9.noarch.rp 711 kB/s | 36 kB 00:00 2024-09-13T18:37:37.158 INFO:teuthology.orchestra.run.smithi142.stdout:(100/113): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-13T18:37:37.158 INFO:teuthology.orchestra.run.smithi142.stdout:(101/113): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T18:37:37.158 INFO:teuthology.orchestra.run.smithi142.stdout:(102/113): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-13T18:37:37.158 INFO:teuthology.orchestra.run.smithi142.stdout:(103/113): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-13T18:37:37.159 INFO:teuthology.orchestra.run.smithi142.stdout:(104/113): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-13T18:37:37.240 INFO:teuthology.orchestra.run.smithi142.stdout:(105/113): librados2-17.2.7-1629.geb16b97b.el9. 13 MB/s | 3.1 MB 00:00 2024-09-13T18:37:37.332 INFO:teuthology.orchestra.run.smithi142.stdout:(106/113): librbd1-17.2.7-1629.geb16b97b.el9.x8 11 MB/s | 2.9 MB 00:00 2024-09-13T18:37:37.507 INFO:teuthology.orchestra.run.smithi142.stdout:(107/113): NetworkManager-libnm-1.49.90-1.el9.x 10 MB/s | 1.8 MB 00:00 2024-09-13T18:37:37.549 INFO:teuthology.orchestra.run.smithi142.stdout:(108/113): NetworkManager-team-1.49.90-1.el9.x8 985 kB/s | 41 kB 00:00 2024-09-13T18:37:37.590 INFO:teuthology.orchestra.run.smithi142.stdout:(109/113): NetworkManager-tui-1.49.90-1.el9.x86 5.8 MB/s | 249 kB 00:00 2024-09-13T18:37:37.657 INFO:teuthology.orchestra.run.smithi142.stdout:(110/113): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-13T18:37:37.699 INFO:teuthology.orchestra.run.smithi142.stdout:(111/113): NetworkManager-1.49.90-1.el9.x86_64. 5.0 MB/s | 2.3 MB 00:00 2024-09-13T18:37:37.750 INFO:teuthology.orchestra.run.smithi142.stdout:(112/113): openssl-libs-3.2.2-6.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-09-13T18:37:37.774 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-13T18:37:37.896 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-13T18:37:37.897 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-13T18:37:38.266 INFO:teuthology.orchestra.run.smithi142.stdout:(113/113): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.4 MB/s | 16 MB 00:02 2024-09-13T18:37:38.271 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:37:38.271 INFO:teuthology.orchestra.run.smithi142.stdout:Total 18 MB/s | 196 MB 00:10 2024-09-13T18:37:39.122 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T18:37:39.245 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T18:37:39.246 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T18:37:39.794 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-13T18:37:39.795 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-13T18:37:41.150 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T18:37:41.151 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T18:37:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-13T18:37:44.811 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/121 2024-09-13T18:37:44.849 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/121 2024-09-13T18:37:44.902 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/121 2024-09-13T18:37:44.935 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/121 2024-09-13T18:37:44.961 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/121 2024-09-13T18:37:45.011 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/121 2024-09-13T18:37:45.322 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/121 2024-09-13T18:37:45.438 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 8/121 2024-09-13T18:37:45.551 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 8/121 2024-09-13T18:37:45.572 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 9/121 2024-09-13T18:37:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T18:37:46.056 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 9/121 2024-09-13T18:37:46.082 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 10/121 2024-09-13T18:37:46.137 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/121 2024-09-13T18:37:46.164 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 10/121 2024-09-13T18:37:46.175 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/121 2024-09-13T18:37:46.205 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 11/121 2024-09-13T18:37:46.224 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 12/121 2024-09-13T18:37:46.237 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/121 2024-09-13T18:37:46.270 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/121 2024-09-13T18:37:46.296 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/121 2024-09-13T18:37:46.327 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 12/121 2024-09-13T18:37:46.350 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86 13/121 2024-09-13T18:37:46.358 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/121 2024-09-13T18:37:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86 13/121 2024-09-13T18:37:46.657 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/121 2024-09-13T18:37:46.689 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 14/121 2024-09-13T18:37:46.766 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 8/121 2024-09-13T18:37:46.804 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 15/121 2024-09-13T18:37:46.876 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 15/121 2024-09-13T18:37:46.877 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 8/121 2024-09-13T18:37:46.908 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 9/121 2024-09-13T18:37:47.173 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 15/121 2024-09-13T18:37:47.214 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 16/121 2024-09-13T18:37:47.280 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : liboath-2.6.7-2.el9.x86_64 17/121 2024-09-13T18:37:47.308 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 18/121 2024-09-13T18:37:47.367 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 9/121 2024-09-13T18:37:47.394 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 19/121 2024-09-13T18:37:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 10/121 2024-09-13T18:37:47.446 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 20/121 2024-09-13T18:37:47.481 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 21/121 2024-09-13T18:37:47.525 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 22/121 2024-09-13T18:37:47.550 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 10/121 2024-09-13T18:37:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 23/121 2024-09-13T18:37:47.599 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el 24/121 2024-09-13T18:37:47.599 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 11/121 2024-09-13T18:37:47.627 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 12/121 2024-09-13T18:37:47.710 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 12/121 2024-09-13T18:37:47.729 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_6 25/121 2024-09-13T18:37:47.737 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86 13/121 2024-09-13T18:37:47.783 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 26/121 2024-09-13T18:37:47.821 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rsa-4.9-2.el9.noarch 27/121 2024-09-13T18:37:47.857 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 28/121 2024-09-13T18:37:47.894 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_6 29/121 2024-09-13T18:37:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 30/121 2024-09-13T18:37:47.962 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86 13/121 2024-09-13T18:37:47.970 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 31/121 2024-09-13T18:37:48.024 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 32/121 2024-09-13T18:37:48.083 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 14/121 2024-09-13T18:37:48.088 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 33/121 2024-09-13T18:37:48.124 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 34/121 2024-09-13T18:37:48.169 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 35/121 2024-09-13T18:37:48.188 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 15/121 2024-09-13T18:37:48.215 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 36/121 2024-09-13T18:37:48.248 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 37/121 2024-09-13T18:37:48.275 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 15/121 2024-09-13T18:37:48.290 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 38/121 2024-09-13T18:37:48.390 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 39/121 2024-09-13T18:37:48.432 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 40/121 2024-09-13T18:37:48.473 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 41/121 2024-09-13T18:37:48.507 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 42/121 2024-09-13T18:37:48.536 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 43/121 2024-09-13T18:37:48.572 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 44/121 2024-09-13T18:37:48.574 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 15/121 2024-09-13T18:37:48.602 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/121 2024-09-13T18:37:48.614 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 16/121 2024-09-13T18:37:48.636 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/121 2024-09-13T18:37:48.679 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 17/121 2024-09-13T18:37:48.687 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 47/121 2024-09-13T18:37:48.708 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 18/121 2024-09-13T18:37:48.727 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/121 2024-09-13T18:37:48.762 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 49/121 2024-09-13T18:37:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 19/121 2024-09-13T18:37:48.797 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/121 2024-09-13T18:37:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 20/121 2024-09-13T18:37:48.832 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/121 2024-09-13T18:37:48.862 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 21/121 2024-09-13T18:37:48.878 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 52/121 2024-09-13T18:37:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 22/121 2024-09-13T18:37:48.939 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 23/121 2024-09-13T18:37:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-packaging-20.9-5.el9.noarch 53/121 2024-09-13T18:37:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el 24/121 2024-09-13T18:37:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 54/121 2024-09-13T18:37:49.113 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_6 25/121 2024-09-13T18:37:49.166 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 26/121 2024-09-13T18:37:49.204 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 27/121 2024-09-13T18:37:49.240 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 28/121 2024-09-13T18:37:49.278 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_6 29/121 2024-09-13T18:37:49.321 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 30/121 2024-09-13T18:37:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 31/121 2024-09-13T18:37:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 32/121 2024-09-13T18:37:49.483 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 33/121 2024-09-13T18:37:49.524 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 34/121 2024-09-13T18:37:49.570 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 35/121 2024-09-13T18:37:49.616 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 36/121 2024-09-13T18:37:49.649 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 37/121 2024-09-13T18:37:49.699 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 38/121 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 55/121 2024-09-13T18:37:49.800 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 56/121 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 39/121 2024-09-13T18:37:49.841 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 40/121 2024-09-13T18:37:49.880 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 57/121 2024-09-13T18:37:49.881 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 41/121 2024-09-13T18:37:49.915 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 42/121 2024-09-13T18:37:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 43/121 2024-09-13T18:37:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 44/121 2024-09-13T18:37:50.010 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/121 2024-09-13T18:37:50.019 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 58/121 2024-09-13T18:37:50.044 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/121 2024-09-13T18:37:50.059 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/121 2024-09-13T18:37:50.077 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 47/121 2024-09-13T18:37:50.094 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 60/121 2024-09-13T18:37:50.110 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/121 2024-09-13T18:37:50.145 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 49/121 2024-09-13T18:37:50.179 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/121 2024-09-13T18:37:50.192 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 61/121 2024-09-13T18:37:50.214 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/121 2024-09-13T18:37:50.228 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 62/121 2024-09-13T18:37:50.261 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 52/121 2024-09-13T18:37:50.361 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 53/121 2024-09-13T18:37:50.402 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openblas-0.3.26-2.el9.x86_64 63/121 2024-09-13T18:37:50.416 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 54/121 2024-09-13T18:37:50.433 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 64/121 2024-09-13T18:37:50.511 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 65/121 2024-09-13T18:37:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 55/121 2024-09-13T18:37:51.182 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 56/121 2024-09-13T18:37:51.255 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 57/121 2024-09-13T18:37:51.356 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 66/121 2024-09-13T18:37:51.393 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 58/121 2024-09-13T18:37:51.433 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/121 2024-09-13T18:37:51.465 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 67/121 2024-09-13T18:37:51.539 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 60/121 2024-09-13T18:37:51.804 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 61/121 2024-09-13T18:37:51.834 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 62/121 2024-09-13T18:37:52.018 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.26-2.el9.x86_64 63/121 2024-09-13T18:37:52.048 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 64/121 2024-09-13T18:37:52.126 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 65/121 2024-09-13T18:37:52.702 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 68/121 2024-09-13T18:37:52.778 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 66/121 2024-09-13T18:37:52.780 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 69/121 2024-09-13T18:37:52.799 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 70/121 2024-09-13T18:37:52.904 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 67/121 2024-09-13T18:37:53.090 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 71/121 2024-09-13T18:37:53.137 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 72/121 2024-09-13T18:37:53.209 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 72/121 2024-09-13T18:37:53.249 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 73/121 2024-09-13T18:37:53.301 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ply-3.11-14.el9.noarch 74/121 2024-09-13T18:37:53.374 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 75/121 2024-09-13T18:37:53.557 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 76/121 2024-09-13T18:37:53.599 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 77/121 2024-09-13T18:37:53.676 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 78/121 2024-09-13T18:37:53.765 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/121 2024-09-13T18:37:53.810 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/121 2024-09-13T18:37:53.840 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 81/121 2024-09-13T18:37:53.874 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 82/121 2024-09-13T18:37:53.906 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 83/121 2024-09-13T18:37:53.935 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : fuse-2.9.9-16.el9.x86_64 84/121 2024-09-13T18:37:53.966 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.e 85/121 2024-09-13T18:37:54.038 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b. 86/121 2024-09-13T18:37:54.061 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9. 87/121 2024-09-13T18:37:54.244 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 68/121 2024-09-13T18:37:54.326 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 69/121 2024-09-13T18:37:54.345 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 70/121 2024-09-13T18:37:54.636 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 71/121 2024-09-13T18:37:54.692 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 72/121 2024-09-13T18:37:54.765 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 72/121 2024-09-13T18:37:54.804 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 73/121 2024-09-13T18:37:54.854 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 74/121 2024-09-13T18:37:54.908 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 75/121 2024-09-13T18:37:55.092 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 76/121 2024-09-13T18:37:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 77/121 2024-09-13T18:37:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 78/121 2024-09-13T18:37:55.303 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/121 2024-09-13T18:37:55.349 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/121 2024-09-13T18:37:55.378 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 81/121 2024-09-13T18:37:55.412 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 82/121 2024-09-13T18:37:55.443 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 83/121 2024-09-13T18:37:55.489 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-16.el9.x86_64 84/121 2024-09-13T18:37:55.520 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.e 85/121 2024-09-13T18:37:55.592 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b. 86/121 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9. 87/121 2024-09-13T18:37:56.424 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 88/121 2024-09-13T18:37:56.457 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 88/121 2024-09-13T18:37:56.987 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 88/121 2024-09-13T18:37:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 89/121 2024-09-13T18:37:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 89/121 2024-09-13T18:37:57.127 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:37:57.127 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:37:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:37:57.170 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 90/121 2024-09-13T18:37:57.995 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 88/121 2024-09-13T18:37:58.036 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 88/121 2024-09-13T18:37:58.574 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 88/121 2024-09-13T18:37:58.606 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 89/121 2024-09-13T18:37:58.700 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 89/121 2024-09-13T18:37:58.700 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:37:58.701 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:37:58.701 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:37:58.732 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 90/121 2024-09-13T18:38:08.060 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 90/121 2024-09-13T18:38:08.061 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /sys 2024-09-13T18:38:08.061 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /proc 2024-09-13T18:38:08.061 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /mnt 2024-09-13T18:38:08.061 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /var/tmp 2024-09-13T18:38:08.061 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /home 2024-09-13T18:38:08.061 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /root 2024-09-13T18:38:08.061 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /tmp 2024-09-13T18:38:08.061 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.n 91/121 2024-09-13T18:38:09.998 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 90/121 2024-09-13T18:38:09.998 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-09-13T18:38:09.998 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-09-13T18:38:09.998 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-09-13T18:38:09.998 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-09-13T18:38:09.998 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-09-13T18:38:09.998 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-09-13T18:38:09.998 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-09-13T18:38:09.998 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:10.085 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.n 91/121 2024-09-13T18:38:10.113 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb1 92/121 2024-09-13T18:38:10.216 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1629.geb1 92/121 2024-09-13T18:38:10.371 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el 93/121 2024-09-13T18:38:10.399 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 94/121 2024-09-13T18:38:10.423 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 94/121 2024-09-13T18:38:10.423 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:38:10.424 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:38:10.424 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:38:10.424 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:38:10.424 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:10.467 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 95/121 2024-09-13T18:38:10.651 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 95/121 2024-09-13T18:38:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 96/121 2024-09-13T18:38:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 96/121 2024-09-13T18:38:10.708 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:38:10.708 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:38:10.708 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:38:10.708 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:38:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:11.016 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.n 91/121 2024-09-13T18:38:11.085 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 97/121 2024-09-13T18:38:11.108 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 97/121 2024-09-13T18:38:11.108 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:38:11.108 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:38:11.108 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:38:11.109 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:38:11.109 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:12.033 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.n 91/121 2024-09-13T18:38:12.059 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb1 92/121 2024-09-13T18:38:12.162 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1629.geb1 92/121 2024-09-13T18:38:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el 93/121 2024-09-13T18:38:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 94/121 2024-09-13T18:38:12.369 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 94/121 2024-09-13T18:38:12.369 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:38:12.369 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:38:12.369 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:38:12.369 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:38:12.370 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:12.413 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 95/121 2024-09-13T18:38:12.419 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 98/121 2024-09-13T18:38:12.446 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 98/121 2024-09-13T18:38:12.446 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:38:12.446 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:38:12.446 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:38:12.446 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:38:12.446 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:12.595 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 95/121 2024-09-13T18:38:12.622 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 96/121 2024-09-13T18:38:12.645 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 96/121 2024-09-13T18:38:12.646 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:38:12.646 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:38:12.646 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:38:12.646 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:38:12.646 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:13.031 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 97/121 2024-09-13T18:38:13.054 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 97/121 2024-09-13T18:38:13.054 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:38:13.054 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:38:13.055 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:38:13.055 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:38:13.055 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:13.697 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 99/121 2024-09-13T18:38:13.729 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 100/121 2024-09-13T18:38:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 100/121 2024-09-13T18:38:13.807 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:38:13.807 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:38:13.808 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:38:13.808 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:38:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:14.097 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 101/121 2024-09-13T18:38:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 101/121 2024-09-13T18:38:14.120 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:38:14.120 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:38:14.120 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:38:14.120 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:38:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:14.356 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 98/121 2024-09-13T18:38:14.383 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 98/121 2024-09-13T18:38:14.383 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:38:14.383 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:38:14.383 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:38:14.383 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:38:14.384 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:15.622 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 99/121 2024-09-13T18:38:15.658 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 100/121 2024-09-13T18:38:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 100/121 2024-09-13T18:38:15.736 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:38:15.736 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:38:15.736 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:38:15.736 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:38:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:16.026 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 101/121 2024-09-13T18:38:16.049 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 101/121 2024-09-13T18:38:16.050 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:38:16.050 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:38:16.050 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:38:16.050 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:38:16.050 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 102/121 2024-09-13T18:38:18.659 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 103/121 2024-09-13T18:38:18.725 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 104/121 2024-09-13T18:38:18.765 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 105/121 2024-09-13T18:38:18.790 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 106/121 2024-09-13T18:38:18.813 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_ 107/121 2024-09-13T18:38:18.843 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 108/121 2024-09-13T18:38:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 109/121 2024-09-13T18:38:19.882 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 110/121 2024-09-13T18:38:19.961 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 111/121 2024-09-13T18:38:20.049 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flex-2.6.4-9.el9.x86_64 112/121 2024-09-13T18:38:20.082 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : bison-3.7.4-5.el9.x86_64 113/121 2024-09-13T18:38:20.113 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 114/121 2024-09-13T18:38:20.151 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 115/121 2024-09-13T18:38:20.151 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 116/121 2024-09-13T18:38:20.234 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 116/121 2024-09-13T18:38:20.235 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 117/121 2024-09-13T18:38:20.327 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 117/121 2024-09-13T18:38:20.352 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 118/121 2024-09-13T18:38:20.358 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 119/121 2024-09-13T18:38:20.358 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 119/121 2024-09-13T18:38:20.472 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 102/121 2024-09-13T18:38:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 103/121 2024-09-13T18:38:20.537 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 119/121 2024-09-13T18:38:20.537 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 120/121 2024-09-13T18:38:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 104/121 2024-09-13T18:38:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 105/121 2024-09-13T18:38:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 106/121 2024-09-13T18:38:20.622 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 120/121 2024-09-13T18:38:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_ 107/121 2024-09-13T18:38:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 108/121 2024-09-13T18:38:20.684 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 121/121 2024-09-13T18:38:21.517 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 109/121 2024-09-13T18:38:21.722 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 110/121 2024-09-13T18:38:21.812 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 111/121 2024-09-13T18:38:21.901 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.4-9.el9.x86_64 112/121 2024-09-13T18:38:21.934 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.7.4-5.el9.x86_64 113/121 2024-09-13T18:38:21.969 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 114/121 2024-09-13T18:38:22.003 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 115/121 2024-09-13T18:38:22.003 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 116/121 2024-09-13T18:38:22.095 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 116/121 2024-09-13T18:38:22.095 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 117/121 2024-09-13T18:38:22.179 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 117/121 2024-09-13T18:38:22.204 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 118/121 2024-09-13T18:38:22.209 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 119/121 2024-09-13T18:38:22.210 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 119/121 2024-09-13T18:38:22.397 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 119/121 2024-09-13T18:38:22.397 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 120/121 2024-09-13T18:38:22.482 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 120/121 2024-09-13T18:38:22.547 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 121/121 2024-09-13T18:38:25.449 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 121/121 2024-09-13T18:38:25.449 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 1/121 2024-09-13T18:38:25.449 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 2/121 2024-09-13T18:38:25.449 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 3/121 2024-09-13T18:38:25.450 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 4/121 2024-09-13T18:38:25.450 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 5/121 2024-09-13T18:38:25.450 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 6/121 2024-09-13T18:38:25.450 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 7/121 2024-09-13T18:38:25.450 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 8/121 2024-09-13T18:38:25.450 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 9/121 2024-09-13T18:38:25.450 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 10/121 2024-09-13T18:38:25.451 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 11/121 2024-09-13T18:38:25.451 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_ 12/121 2024-09-13T18:38:25.451 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 13/121 2024-09-13T18:38:25.451 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 14/121 2024-09-13T18:38:25.451 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_6 15/121 2024-09-13T18:38:25.451 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86 16/121 2024-09-13T18:38:25.451 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 17/121 2024-09-13T18:38:25.451 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el 18/121 2024-09-13T18:38:25.451 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9. 19/121 2024-09-13T18:38:25.451 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_6 20/121 2024-09-13T18:38:25.452 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 21/121 2024-09-13T18:38:25.452 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 22/121 2024-09-13T18:38:25.452 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 23/121 2024-09-13T18:38:25.452 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 24/121 2024-09-13T18:38:25.452 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 25/121 2024-09-13T18:38:25.452 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 26/121 2024-09-13T18:38:25.452 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b. 27/121 2024-09-13T18:38:25.452 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.n 28/121 2024-09-13T18:38:25.452 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb1 29/121 2024-09-13T18:38:25.452 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el 30/121 2024-09-13T18:38:25.452 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 31/121 2024-09-13T18:38:25.452 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.e 32/121 2024-09-13T18:38:25.453 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 33/121 2024-09-13T18:38:25.453 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 34/121 2024-09-13T18:38:25.453 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 35/121 2024-09-13T18:38:25.453 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 36/121 2024-09-13T18:38:25.453 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 37/121 2024-09-13T18:38:25.453 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ply-3.11-14.el9.noarch 38/121 2024-09-13T18:38:25.453 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 39/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 40/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 41/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : bison-3.7.4-5.el9.x86_64 42/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 43/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 51/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 52/121 2024-09-13T18:38:25.454 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 53/121 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 54/121 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 55/121 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 56/121 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 57/121 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 58/121 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 59/121 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 60/121 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 61/121 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 62/121 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 63/121 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 64/121 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 65/121 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 66/121 2024-09-13T18:38:25.456 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 67/121 2024-09-13T18:38:25.456 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 68/121 2024-09-13T18:38:25.456 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/121 2024-09-13T18:38:25.456 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 70/121 2024-09-13T18:38:25.456 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 71/121 2024-09-13T18:38:25.456 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 72/121 2024-09-13T18:38:25.456 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 73/121 2024-09-13T18:38:25.457 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 74/121 2024-09-13T18:38:25.457 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 75/121 2024-09-13T18:38:25.457 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 76/121 2024-09-13T18:38:25.457 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 77/121 2024-09-13T18:38:25.457 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 78/121 2024-09-13T18:38:25.457 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 79/121 2024-09-13T18:38:25.458 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 80/121 2024-09-13T18:38:25.458 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 81/121 2024-09-13T18:38:25.458 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 82/121 2024-09-13T18:38:25.458 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 83/121 2024-09-13T18:38:25.458 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 84/121 2024-09-13T18:38:25.458 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 85/121 2024-09-13T18:38:25.458 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 86/121 2024-09-13T18:38:25.458 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 87/121 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 88/121 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 89/121 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 90/121 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 91/121 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 92/121 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 93/121 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 94/121 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 95/121 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 96/121 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 97/121 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 98/121 2024-09-13T18:38:25.460 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 99/121 2024-09-13T18:38:25.460 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 100/121 2024-09-13T18:38:25.460 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 101/121 2024-09-13T18:38:25.460 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 102/121 2024-09-13T18:38:25.460 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 103/121 2024-09-13T18:38:25.460 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 104/121 2024-09-13T18:38:25.460 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 105/121 2024-09-13T18:38:25.460 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 106/121 2024-09-13T18:38:25.460 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 107/121 2024-09-13T18:38:25.460 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 108/121 2024-09-13T18:38:25.461 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 109/121 2024-09-13T18:38:25.461 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 110/121 2024-09-13T18:38:25.461 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 111/121 2024-09-13T18:38:25.461 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 112/121 2024-09-13T18:38:25.461 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 113/121 2024-09-13T18:38:25.461 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 114/121 2024-09-13T18:38:25.461 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 115/121 2024-09-13T18:38:25.461 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 116/121 2024-09-13T18:38:25.461 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 117/121 2024-09-13T18:38:25.461 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 118/121 2024-09-13T18:38:25.461 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 119/121 2024-09-13T18:38:25.462 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 120/121 2024-09-13T18:38:27.238 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 121/121 2024-09-13T18:38:27.238 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 1/121 2024-09-13T18:38:27.238 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 2/121 2024-09-13T18:38:27.238 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 3/121 2024-09-13T18:38:27.238 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 4/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 5/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 6/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 7/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 8/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 9/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 10/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 11/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_ 12/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 13/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 14/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_6 15/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86 16/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 17/121 2024-09-13T18:38:27.239 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el 18/121 2024-09-13T18:38:27.240 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9. 19/121 2024-09-13T18:38:27.240 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_6 20/121 2024-09-13T18:38:27.240 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 21/121 2024-09-13T18:38:27.240 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 22/121 2024-09-13T18:38:27.240 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 23/121 2024-09-13T18:38:27.240 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 24/121 2024-09-13T18:38:27.240 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 25/121 2024-09-13T18:38:27.240 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 26/121 2024-09-13T18:38:27.240 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b. 27/121 2024-09-13T18:38:27.240 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.n 28/121 2024-09-13T18:38:27.240 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb1 29/121 2024-09-13T18:38:27.240 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el 30/121 2024-09-13T18:38:27.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 31/121 2024-09-13T18:38:27.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.e 32/121 2024-09-13T18:38:27.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 33/121 2024-09-13T18:38:27.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 34/121 2024-09-13T18:38:27.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 35/121 2024-09-13T18:38:27.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 36/121 2024-09-13T18:38:27.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 37/121 2024-09-13T18:38:27.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 38/121 2024-09-13T18:38:27.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 39/121 2024-09-13T18:38:27.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 40/121 2024-09-13T18:38:27.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 41/121 2024-09-13T18:38:27.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.7.4-5.el9.x86_64 42/121 2024-09-13T18:38:27.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 43/121 2024-09-13T18:38:27.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/121 2024-09-13T18:38:27.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/121 2024-09-13T18:38:27.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/121 2024-09-13T18:38:27.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/121 2024-09-13T18:38:27.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/121 2024-09-13T18:38:27.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/121 2024-09-13T18:38:27.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/121 2024-09-13T18:38:27.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 51/121 2024-09-13T18:38:27.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 52/121 2024-09-13T18:38:27.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 53/121 2024-09-13T18:38:27.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 54/121 2024-09-13T18:38:27.243 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 55/121 2024-09-13T18:38:27.243 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 56/121 2024-09-13T18:38:27.243 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 57/121 2024-09-13T18:38:27.243 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 58/121 2024-09-13T18:38:27.243 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 59/121 2024-09-13T18:38:27.243 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 60/121 2024-09-13T18:38:27.243 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 61/121 2024-09-13T18:38:27.243 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 62/121 2024-09-13T18:38:27.243 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 63/121 2024-09-13T18:38:27.243 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 64/121 2024-09-13T18:38:27.243 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 65/121 2024-09-13T18:38:27.243 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 66/121 2024-09-13T18:38:27.244 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 67/121 2024-09-13T18:38:27.244 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 68/121 2024-09-13T18:38:27.244 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/121 2024-09-13T18:38:27.244 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 70/121 2024-09-13T18:38:27.244 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 71/121 2024-09-13T18:38:27.244 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 72/121 2024-09-13T18:38:27.244 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 73/121 2024-09-13T18:38:27.245 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 74/121 2024-09-13T18:38:27.245 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 75/121 2024-09-13T18:38:27.245 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 76/121 2024-09-13T18:38:27.245 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 77/121 2024-09-13T18:38:27.245 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 78/121 2024-09-13T18:38:27.245 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 79/121 2024-09-13T18:38:27.245 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 80/121 2024-09-13T18:38:27.246 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 81/121 2024-09-13T18:38:27.246 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 82/121 2024-09-13T18:38:27.246 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 83/121 2024-09-13T18:38:27.248 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 84/121 2024-09-13T18:38:27.248 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 85/121 2024-09-13T18:38:27.248 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 86/121 2024-09-13T18:38:27.248 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 87/121 2024-09-13T18:38:27.249 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 88/121 2024-09-13T18:38:27.249 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 89/121 2024-09-13T18:38:27.249 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 90/121 2024-09-13T18:38:27.249 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 91/121 2024-09-13T18:38:27.249 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 92/121 2024-09-13T18:38:27.249 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 93/121 2024-09-13T18:38:27.249 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 94/121 2024-09-13T18:38:27.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 95/121 2024-09-13T18:38:27.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 96/121 2024-09-13T18:38:27.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 97/121 2024-09-13T18:38:27.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 98/121 2024-09-13T18:38:27.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 99/121 2024-09-13T18:38:27.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 100/121 2024-09-13T18:38:27.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 101/121 2024-09-13T18:38:27.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 102/121 2024-09-13T18:38:27.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 103/121 2024-09-13T18:38:27.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 104/121 2024-09-13T18:38:27.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 105/121 2024-09-13T18:38:27.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 106/121 2024-09-13T18:38:27.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 107/121 2024-09-13T18:38:27.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 108/121 2024-09-13T18:38:27.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 109/121 2024-09-13T18:38:27.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 110/121 2024-09-13T18:38:27.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 111/121 2024-09-13T18:38:27.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 112/121 2024-09-13T18:38:27.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 113/121 2024-09-13T18:38:27.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 114/121 2024-09-13T18:38:27.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 115/121 2024-09-13T18:38:27.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 116/121 2024-09-13T18:38:27.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 117/121 2024-09-13T18:38:27.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 118/121 2024-09-13T18:38:27.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 119/121 2024-09-13T18:38:27.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 120/121 2024-09-13T18:38:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 121/121 2024-09-13T18:38:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:27.829 INFO:teuthology.orchestra.run.smithi097.stdout:Upgraded: 2024-09-13T18:38:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T18:38:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T18:38:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T18:38:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T18:38:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T18:38:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T18:38:27.829 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-13T18:38:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T18:38:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T18:38:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T18:38:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T18:38:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T18:38:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T18:38:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T18:38:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T18:38:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T18:38:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:38:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:38:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:38:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T18:38:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:38:27.832 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.832 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.832 INFO:teuthology.orchestra.run.smithi097.stdout: libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.832 INFO:teuthology.orchestra.run.smithi097.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:38:27.832 INFO:teuthology.orchestra.run.smithi097.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:38:27.832 INFO:teuthology.orchestra.run.smithi097.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:38:27.832 INFO:teuthology.orchestra.run.smithi097.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:38:27.832 INFO:teuthology.orchestra.run.smithi097.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:38:27.832 INFO:teuthology.orchestra.run.smithi097.stdout: librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.832 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.832 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:38:27.832 INFO:teuthology.orchestra.run.smithi097.stdout: librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.832 INFO:teuthology.orchestra.run.smithi097.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:38:27.833 INFO:teuthology.orchestra.run.smithi097.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T18:38:27.833 INFO:teuthology.orchestra.run.smithi097.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:38:27.833 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:38:27.833 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:38:27.833 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T18:38:27.833 INFO:teuthology.orchestra.run.smithi097.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:38:27.833 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:38:27.833 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.834 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.834 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.834 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:38:27.834 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:38:27.834 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:38:27.834 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:38:27.834 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:38:27.834 INFO:teuthology.orchestra.run.smithi097.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:38:27.834 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:38:27.834 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:38:27.834 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:38:27.834 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:38:27.834 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:38:27.835 INFO:teuthology.orchestra.run.smithi097.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T18:38:27.836 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:38:27.836 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:38:27.836 INFO:teuthology.orchestra.run.smithi097.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:38:27.836 INFO:teuthology.orchestra.run.smithi097.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:38:27.836 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:38:27.836 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:38:27.836 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:38:27.836 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:38:27.836 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:38:27.836 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.836 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.836 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:38:27.837 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:38:27.837 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:38:27.837 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.837 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:38:27.837 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:38:27.837 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:38:27.837 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:38:27.837 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:38:27.837 INFO:teuthology.orchestra.run.smithi097.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:38:27.837 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:38:27.837 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:38:27.837 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:38:27.837 INFO:teuthology.orchestra.run.smithi097.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:38:27.838 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.838 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.838 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:27.838 INFO:teuthology.orchestra.run.smithi097.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:38:27.838 INFO:teuthology.orchestra.run.smithi097.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:38:27.838 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:38:27.838 INFO:teuthology.orchestra.run.smithi097.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T18:38:27.838 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:27.838 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-13T18:38:28.240 DEBUG:teuthology.parallel:result is None 2024-09-13T18:38:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 121/121 2024-09-13T18:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-09-13T18:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T18:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T18:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T18:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T18:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T18:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T18:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T18:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T18:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T18:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T18:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T18:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T18:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T18:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T18:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T18:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T18:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T18:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T18:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T18:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T18:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T18:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T18:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T18:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:38:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T18:38:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:29.631 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T18:38:30.011 DEBUG:teuthology.parallel:result is None 2024-09-13T18:38:30.012 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:38:30.012 INFO:teuthology.packaging:ref: None 2024-09-13T18:38:30.012 INFO:teuthology.packaging:tag: None 2024-09-13T18:38:30.012 INFO:teuthology.packaging:branch: quincy 2024-09-13T18:38:30.012 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:38:30.012 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T18:38:30.259 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:38:30.285 INFO:teuthology.orchestra.run.smithi097.stdout:17.2.7-1629.geb16b97b.el9 2024-09-13T18:38:30.286 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1629.geb16b97b.el9 2024-09-13T18:38:30.286 INFO:teuthology.task.install:The correct ceph version 17.2.7-1629.geb16b97b is installed. 2024-09-13T18:38:30.288 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:38:30.288 INFO:teuthology.packaging:ref: None 2024-09-13T18:38:30.288 INFO:teuthology.packaging:tag: None 2024-09-13T18:38:30.289 INFO:teuthology.packaging:branch: quincy 2024-09-13T18:38:30.289 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:38:30.289 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T18:38:30.526 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:38:30.549 INFO:teuthology.orchestra.run.smithi142.stdout:17.2.7-1629.geb16b97b.el9 2024-09-13T18:38:30.550 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1629.geb16b97b.el9 2024-09-13T18:38:30.550 INFO:teuthology.task.install:The correct ceph version 17.2.7-1629.geb16b97b is installed. 2024-09-13T18:38:30.552 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T18:38:30.552 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:30.552 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:38:30.584 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:38:30.584 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:38:30.620 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T18:38:30.620 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:30.620 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:38:30.653 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:38:30.720 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:38:30.720 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:38:30.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:38:30.818 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T18:38:30.818 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:30.818 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:38:30.845 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:38:30.912 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:38:30.912 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:38:30.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:38:31.006 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T18:38:31.006 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:31.006 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:38:31.033 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:38:31.099 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:38:31.099 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:38:31.125 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:38:31.191 INFO:teuthology.run_tasks:Running task print... 2024-09-13T18:38:31.198 INFO:teuthology.task.print:**** done installing quincy 2024-09-13T18:38:31.198 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T18:38:31.279 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T18:38:31.280 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2024-09-13T18:38:31.283 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-09-13T18:38:31.308 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T18:38:31.308 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:38:31.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:38:31.374 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T18:38:31.374 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:38:31.415 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:38:31.449 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T18:38:31.449 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T18:38:31.449 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904000', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/upgrade/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/quincy 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/iozone}}', 'email': None, 'first_in_suite': False, 'job_id': '7904000', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': 'install ceph/quincy latest\n'}], 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'dry_run': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'targets': {'smithi097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN71x9yEqD0KaQm9aB+Boje3RC9P67N3uyAfiGMPbCpkGXVnsPRLFqlukOpPeq2YJ/07A59xvNppFZSIy0ZPzfk=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOF4LO/act/SjAUcfkgr3q6+LPN8Ivxlus78UKr9kAB1P+NiFPLyDB4G2xp3IcFmlJTti1iYqStgPZoQlNKze+k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'quincy', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'print': '**** done installing quincy'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client quincy']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'ceph-fuse': {'client.0': {'mounted': False}}}, {'print': '**** done unmount client.0'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph.healthy': None}, {'ceph-fuse': {'client.0': None}}, {'print': '**** done remount client.0'}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end", 'if not is_fuse() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T18:38:31.450 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:38:31.481 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:38:31.496 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:38:31.537 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:38:31.561 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:31.562 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:38:31.615 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:38:31.615 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2024-09-13T18:38:31.670 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:38:31.671 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:38:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-13T18:38:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:38:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:38:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-13 18:38:21.031949031 +0000 2024-09-13T18:38:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-13 18:36:45.119949286 +0000 2024-09-13T18:38:31.671 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-13 18:36:45.119949286 +0000 2024-09-13T18:38:31.671 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-13 18:36:45.119949286 +0000 2024-09-13T18:38:31.671 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:38:31.734 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-13T18:38:31.734 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-13T18:38:31.734 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000179103 s, 2.9 MB/s 2024-09-13T18:38:31.735 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:38:31.792 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2024-09-13T18:38:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:38:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:38:31.848 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T18:38:31.848 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:38:31.848 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:38:31.848 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-13 18:38:21.032949014 +0000 2024-09-13T18:38:31.848 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-13 18:36:45.501943239 +0000 2024-09-13T18:38:31.848 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-13 18:36:45.501943239 +0000 2024-09-13T18:38:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-13 18:36:45.501943239 +0000 2024-09-13T18:38:31.848 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:38:31.910 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-13T18:38:31.911 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-13T18:38:31.911 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000190358 s, 2.7 MB/s 2024-09-13T18:38:31.912 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:38:31.968 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2024-09-13T18:38:32.024 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:38:32.024 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:38:32.024 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-13T18:38:32.024 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:38:32.024 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:38:32.024 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-13 18:38:21.032949014 +0000 2024-09-13T18:38:32.024 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-13 18:36:45.829938046 +0000 2024-09-13T18:38:32.024 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-13 18:36:45.829938046 +0000 2024-09-13T18:38:32.024 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-13 18:36:45.829938046 +0000 2024-09-13T18:38:32.025 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:38:32.087 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-13T18:38:32.087 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-13T18:38:32.088 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000213168 s, 2.4 MB/s 2024-09-13T18:38:32.089 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:38:32.145 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2024-09-13T18:38:32.200 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:38:32.200 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:38:32.200 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-13T18:38:32.201 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:38:32.201 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:38:32.201 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-13 18:38:21.033948998 +0000 2024-09-13T18:38:32.201 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-13 18:36:46.153932917 +0000 2024-09-13T18:38:32.201 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-13 18:36:46.153932917 +0000 2024-09-13T18:38:32.201 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-13 18:36:46.153932917 +0000 2024-09-13T18:38:32.201 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:38:32.263 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-13T18:38:32.263 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-13T18:38:32.263 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000201585 s, 2.5 MB/s 2024-09-13T18:38:32.265 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:38:32.321 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:38:32.321 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:38:32.321 INFO:tasks.ceph:Generating config... 2024-09-13T18:38:32.323 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-13T18:38:32.324 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-09-13T18:38:32.324 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-09-13T18:38:32.324 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T18:38:32.324 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T18:38:32.324 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T18:38:32.325 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T18:38:32.325 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T18:38:32.325 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T18:38:32.325 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T18:38:32.325 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T18:38:32.325 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T18:38:32.326 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T18:38:32.326 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T18:38:32.326 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T18:38:32.326 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T18:38:32.326 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T18:38:32.326 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T18:38:32.326 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T18:38:32.327 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T18:38:32.327 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T18:38:32.327 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T18:38:32.327 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T18:38:32.328 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T18:38:32.328 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T18:38:32.328 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T18:38:32.328 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T18:38:32.328 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T18:38:32.328 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T18:38:32.329 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T18:38:32.329 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T18:38:32.329 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T18:38:32.329 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T18:38:32.329 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T18:38:32.329 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T18:38:32.329 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T18:38:32.329 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T18:38:32.329 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T18:38:32.329 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T18:38:32.329 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T18:38:32.329 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T18:38:32.330 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T18:38:32.330 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T18:38:32.330 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T18:38:32.402 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T18:38:32.405 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T18:38:32.484 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:38:32.549 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.97'), ('mon.b', '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]'), ('mon.c', '[v2:172.21.15.97:3302,v1:172.21.15.97:6791]')] 2024-09-13T18:38:32.549 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790],[v2:172.21.15.97:3302,v1:172.21.15.97:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T18:38:32.550 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:32.550 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:38:32.604 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.97 --addv b '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]' --addv c '[v2:172.21.15.97:3302,v1:172.21.15.97:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:38:32.686 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:38:32.686 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: generated fsid 26171290-0086-4a00-9403-ffac581535bf 2024-09-13T18:38:32.686 INFO:teuthology.orchestra.run.smithi097.stdout:setting min_mon_release = octopus 2024-09-13T18:38:32.686 INFO:teuthology.orchestra.run.smithi097.stdout:epoch 0 2024-09-13T18:38:32.686 INFO:teuthology.orchestra.run.smithi097.stdout:fsid 26171290-0086-4a00-9403-ffac581535bf 2024-09-13T18:38:32.686 INFO:teuthology.orchestra.run.smithi097.stdout:last_changed 2024-09-13T18:38:32.684468+0000 2024-09-13T18:38:32.686 INFO:teuthology.orchestra.run.smithi097.stdout:created 2024-09-13T18:38:32.684468+0000 2024-09-13T18:38:32.687 INFO:teuthology.orchestra.run.smithi097.stdout:min_mon_release 15 (octopus) 2024-09-13T18:38:32.687 INFO:teuthology.orchestra.run.smithi097.stdout:election_strategy: 1 2024-09-13T18:38:32.687 INFO:teuthology.orchestra.run.smithi097.stdout:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-13T18:38:32.687 INFO:teuthology.orchestra.run.smithi097.stdout:1: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.b 2024-09-13T18:38:32.687 INFO:teuthology.orchestra.run.smithi097.stdout:2: [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] mon.c 2024-09-13T18:38:32.687 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T18:38:32.688 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:38:32.744 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 26171290-0086-4a00-9403-ffac581535bf... 2024-09-13T18:38:32.744 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:38:32.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:38:32.826 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2024-09-13T18:38:32.826 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2024-09-13T18:38:32.826 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:38:32.826 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2024-09-13T18:38:32.826 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.826 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2024-09-13T18:38:32.826 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2024-09-13T18:38:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2024-09-13T18:38:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2024-09-13T18:38:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2024-09-13T18:38:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2024-09-13T18:38:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:38:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2024-09-13T18:38:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:38:32.827 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:38:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2024-09-13T18:38:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2024-09-13T18:38:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2024-09-13T18:38:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:38:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:38:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2024-09-13T18:38:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:38:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2024-09-13T18:38:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:38:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:38:32.828 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2024-09-13T18:38:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:38:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2024-09-13T18:38:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2024-09-13T18:38:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2024-09-13T18:38:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2024-09-13T18:38:32.829 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2024-09-13T18:38:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790],[v2:172.21.15.97:3302,v1:172.21.15.97:6791]" 2024-09-13T18:38:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on pool no app = False 2024-09-13T18:38:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: ms bind msgr2 = False 2024-09-13T18:38:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn min per osd = 0 2024-09-13T18:38:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = 26171290-0086-4a00-9403-ffac581535bf 2024-09-13T18:38:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.830 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2024-09-13T18:38:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2024-09-13T18:38:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2024-09-13T18:38:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2024-09-13T18:38:32.830 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.831 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2024-09-13T18:38:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2024-09-13T18:38:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:38:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2024-09-13T18:38:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2024-09-13T18:38:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2024-09-13T18:38:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: bdev async discard = True 2024-09-13T18:38:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: bdev enable discard = True 2024-09-13T18:38:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore allocator = bitmap 2024-09-13T18:38:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2024-09-13T18:38:32.832 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 1/20 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 1/20 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 4/10 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2024-09-13T18:38:32.833 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-13T18:38:32.834 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2024-09-13T18:38:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2024-09-13T18:38:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:38:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2024-09-13T18:38:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2024-09-13T18:38:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:38:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:38:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:38:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:38:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:38:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:38:32.835 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:38:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2024-09-13T18:38:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:38:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:38:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: mon op complaint time = 120 2024-09-13T18:38:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on pool no app = False 2024-09-13T18:38:32.836 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:32.837 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2024-09-13T18:38:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2024-09-13T18:38:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2024-09-13T18:38:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2024-09-13T18:38:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:38:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:38:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: client mount timeout = 600 2024-09-13T18:38:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2024-09-13T18:38:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-13T18:38:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2024-09-13T18:38:32.837 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2024-09-13T18:38:32.837 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2024-09-13T18:38:32.837 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2024-09-13T18:38:32.838 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2024-09-13T18:38:32.838 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2024-09-13T18:38:32.838 INFO:teuthology.orchestra.run.smithi097.stdout:[mds] 2024-09-13T18:38:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds = 20 2024-09-13T18:38:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds balancer = 20 2024-09-13T18:38:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-13T18:38:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug frag = True 2024-09-13T18:38:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug scatterstat = True 2024-09-13T18:38:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: mds op complaint time = 180 2024-09-13T18:38:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: mds verify scatter = True 2024-09-13T18:38:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2024-09-13T18:38:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2024-09-13T18:38:32.838 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2024-09-13T18:38:32.839 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-09-13T18:38:32.839 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-09-13T18:38:32.839 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:38:32.839 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-09-13T18:38:32.839 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-09-13T18:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-09-13T18:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-09-13T18:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-09-13T18:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-09-13T18:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-09-13T18:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-09-13T18:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-09-13T18:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-09-13T18:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-09-13T18:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-09-13T18:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790],[v2:172.21.15.97:3302,v1:172.21.15.97:6791]" 2024-09-13T18:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on pool no app = False 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: ms bind msgr2 = False 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn min per osd = 0 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 26171290-0086-4a00-9403-ffac581535bf 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-09-13T18:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-09-13T18:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-09-13T18:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-09-13T18:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-09-13T18:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-09-13T18:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-09-13T18:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-09-13T18:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-09-13T18:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-09-13T18:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-09-13T18:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: bdev async discard = True 2024-09-13T18:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: bdev enable discard = True 2024-09-13T18:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore allocator = bitmap 2024-09-13T18:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-09-13T18:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-09-13T18:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 1/20 2024-09-13T18:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 1/20 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 4/10 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-09-13T18:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-09-13T18:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-09-13T18:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-09-13T18:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2024-09-13T18:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-09-13T18:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-13T18:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-09-13T18:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-09-13T18:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-09-13T18:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-09-13T18:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-09-13T18:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-09-13T18:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-09-13T18:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.849 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-09-13T18:38:32.849 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:38:32.849 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.849 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:38:32.849 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2024-09-13T18:38:32.849 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on pool no app = False 2024-09-13T18:38:32.849 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:38:32.849 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-09-13T18:38:32.849 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-09-13T18:38:32.849 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-09-13T18:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-09-13T18:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2024-09-13T18:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2024-09-13T18:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-13T18:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-09-13T18:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-09-13T18:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-09-13T18:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2024-09-13T18:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2024-09-13T18:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-09-13T18:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2024-09-13T18:38:32.851 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2024-09-13T18:38:32.851 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds balancer = 20 2024-09-13T18:38:32.851 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-13T18:38:32.851 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2024-09-13T18:38:32.851 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2024-09-13T18:38:32.851 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2024-09-13T18:38:32.851 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2024-09-13T18:38:32.851 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-09-13T18:38:32.851 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-09-13T18:38:32.851 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-09-13T18:38:32.853 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T18:38:32.853 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T18:38:32.942 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T18:38:32.942 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:32.942 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T18:38:32.959 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:32.959 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T18:38:33.013 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2024-09-13T18:38:33.014 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:33.014 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:38:33.014 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:38:33.087 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:33.088 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:38:33.143 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-09-13T18:38:33.143 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:38:33.143 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:38:33.143 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:38:33.184 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:38:33.184 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:38:33.242 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T18:38:33.242 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T18:38:33.242 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:38:33.289 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:38:33.291 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T18:38:33.292 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:38:33.338 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:38:33.340 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T18:38:33.365 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T18:38:33.365 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T18:38:33.414 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T18:38:33.428 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T18:38:33.428 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:38:33.428 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T18:38:33.452 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:38:33.453 INFO:tasks.ceph:role: osd.0 2024-09-13T18:38:33.453 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-13T18:38:33.453 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:38:33.525 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:38:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:38:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:38:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:38:33.525 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:38:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:38:33.525 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:38:33.526 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:38:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:38:33.526 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:38:34.008 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-13T18:38:34.010 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-13T18:38:34.010 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T18:38:34.123 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T18:38:34.154 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T18:38:34.221 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:38:34.221 INFO:tasks.ceph:role: osd.1 2024-09-13T18:38:34.221 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-13T18:38:34.221 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:38:34.292 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:38:34.292 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:38:34.292 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:38:34.292 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:38:34.293 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:38:34.293 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:38:34.293 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:38:34.293 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:38:34.293 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:38:34.293 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:38:34.750 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-13T18:38:34.752 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-13T18:38:34.752 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T18:38:34.826 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T18:38:34.896 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T18:38:34.962 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:38:34.962 INFO:tasks.ceph:role: osd.2 2024-09-13T18:38:34.962 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-13T18:38:34.962 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:38:35.035 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:38:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:38:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:38:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:38:35.035 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:38:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:38:35.036 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:38:35.036 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:38:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:38:35.036 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:38:35.517 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-13T18:38:35.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-13T18:38:35.519 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T18:38:35.620 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T18:38:35.650 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T18:38:35.715 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:38:35.715 INFO:tasks.ceph:role: osd.3 2024-09-13T18:38:35.716 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-13T18:38:35.716 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:38:35.787 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:38:35.787 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:38:35.787 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:38:35.787 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:38:35.787 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:38:35.787 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:38:35.787 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:38:35.788 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:38:35.788 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:38:35.788 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:38:36.296 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-13T18:38:36.298 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-13T18:38:36.298 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T18:38:36.431 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T18:38:36.464 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:38:36.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:36.558+0000 7f746b814440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T18:38:36.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:36.559+0000 7f746b814440 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T18:38:36.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:36.559+0000 7f746b814440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:38:36.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:36.559+0000 7f746b814440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:38:36.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:36.559+0000 7f746b814440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:38:36.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:36.563+0000 7f746b814440 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T18:38:37.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:37.093+0000 7f746b814440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-13T18:38:37.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:37.861+0000 7f746b814440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-13T18:38:38.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:38.626+0000 7f746b814440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-13T18:38:39.428 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:38:39.455 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:38:39.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:39.536+0000 7f17f4e51440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T18:38:39.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:39.536+0000 7f17f4e51440 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T18:38:39.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:39.536+0000 7f17f4e51440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:38:39.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:39.536+0000 7f17f4e51440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:38:39.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:39.536+0000 7f17f4e51440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:38:39.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:39.537+0000 7f17f4e51440 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T18:38:40.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:40.059+0000 7f17f4e51440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-13T18:38:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:40.821+0000 7f17f4e51440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-13T18:38:41.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:41.589+0000 7f17f4e51440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-13T18:38:42.387 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:38:42.458 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:38:42.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:42.542+0000 7fc32d013440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T18:38:42.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:42.542+0000 7fc32d013440 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T18:38:42.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:42.543+0000 7fc32d013440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:38:42.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:42.543+0000 7fc32d013440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:38:42.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:42.543+0000 7fc32d013440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:38:42.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:42.543+0000 7fc32d013440 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T18:38:43.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:43.068+0000 7fc32d013440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-13T18:38:43.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:43.834+0000 7fc32d013440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-13T18:38:44.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:44.596+0000 7fc32d013440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-13T18:38:45.390 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:38:45.416 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:38:45.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:45.495+0000 7ff14fe3b440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T18:38:45.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:45.496+0000 7ff14fe3b440 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T18:38:45.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:45.496+0000 7ff14fe3b440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:38:45.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:45.496+0000 7ff14fe3b440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:38:45.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:45.496+0000 7ff14fe3b440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:38:45.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:45.496+0000 7ff14fe3b440 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T18:38:46.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:46.021+0000 7ff14fe3b440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-13T18:38:46.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:46.785+0000 7ff14fe3b440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-13T18:38:47.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:47.554+0000 7ff14fe3b440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-13T18:38:48.361 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:38:48.432 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T18:38:48.432 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:48.432 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T18:38:48.501 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:48.501 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T18:38:48.569 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:48.569 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T18:38:48.638 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:48.638 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T18:38:48.706 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:48.706 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T18:38:48.773 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:48.773 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T18:38:48.839 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:38:48.839 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T18:38:48.859 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T18:38:48.859 DEBUG:teuthology.orchestra.run.smithi097:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:38:48.904 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.x] 2024-09-13T18:38:48.904 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQCphuRmW2MsERAAuJwgTrFm7JVZSvH1HD5TvQ== 2024-09-13T18:38:48.904 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2024-09-13T18:38:48.904 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQCphuRmAzMYFBAAFdukCY+qYykQ84658rBmRA== 2024-09-13T18:38:48.904 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.0] 2024-09-13T18:38:48.904 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQCshuRmmqVUIRAARSKaK0zIXzFkKppY20WIMw== 2024-09-13T18:38:48.904 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.1] 2024-09-13T18:38:48.904 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQCvhuRmajEHIBAArD4joNizJkThgtffF9MnkQ== 2024-09-13T18:38:48.904 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.2] 2024-09-13T18:38:48.904 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQCyhuRm4G9nIBAA0CivSk8tpXOW0LnsIVlUgQ== 2024-09-13T18:38:48.904 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.3] 2024-09-13T18:38:48.905 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQC1huRmR3qdHRAAsypSqNk7ooO3/hHt0lU0XQ== 2024-09-13T18:38:48.905 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2024-09-13T18:38:48.905 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQCphuRmFzibGBAAR39ggHjLMgqogAhe+JaSLA== 2024-09-13T18:38:48.906 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:38:48.993 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:38:49.042 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:38:49.088 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:38:49.134 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:38:49.179 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:38:49.225 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:38:49.273 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T18:38:49.273 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T18:38:49.297 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:38:49.387 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T18:38:49.411 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T18:38:49.475 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:38:49.565 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T18:38:49.590 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T18:38:49.655 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:38:49.745 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T18:38:49.769 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:38:49.824 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T18:38:49.825 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T18:38:49.825 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T18:38:49.866 INFO:tasks.ceph.mon.a:Started 2024-09-13T18:38:49.867 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T18:38:49.867 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T18:38:49.869 INFO:tasks.ceph.mon.b:Started 2024-09-13T18:38:49.869 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T18:38:49.869 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T18:38:49.871 INFO:tasks.ceph.mon.c:Started 2024-09-13T18:38:49.871 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T18:38:49.871 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T18:38:49.871 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T18:38:49.873 INFO:tasks.ceph.mgr.x:Started 2024-09-13T18:38:49.873 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T18:38:49.873 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T18:38:49.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.977+0000 7ffa2811d640 1 Processor -- start 2024-09-13T18:38:49.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.977+0000 7ffa2811d640 1 -- start start 2024-09-13T18:38:49.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa2811d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffa2012f770 0x7ffa2012fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:49.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa2811d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 0x7ffa2009eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:49.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa256b8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 0x7ffa2009eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:49.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa2811d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa20068220 con 0x7ffa2009f050 2024-09-13T18:38:49.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa2811d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa200693e0 con 0x7ffa2012f770 2024-09-13T18:38:49.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa2811d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200a0000 con 0x7ffa2009e740 2024-09-13T18:38:49.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa256b8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 0x7ffa2009eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:44558/0 (socket says 172.21.15.97:44558) 2024-09-13T18:38:49.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa256b8640 1 -- 172.21.15.97:0/637326365 learned_addr learned my addr 172.21.15.97:0/637326365 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:38:49.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa25eb9640 1 --2- 172.21.15.97:0/637326365 >> v2:172.21.15.97:3300/0 conn(0x7ffa2012f770 0x7ffa2012fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:49.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa256b8640 1 -- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 msgr2=0x7ffa2009eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:38:49.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa25eb9640 1 -- 172.21.15.97:0/637326365 >> v2:172.21.15.97:3300/0 conn(0x7ffa2012f770 msgr2=0x7ffa2012fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:38:49.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa256b8640 1 -- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 msgr2=0x7ffa2009eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:38:49.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa25eb9640 1 -- 172.21.15.97:0/637326365 >> v2:172.21.15.97:3300/0 conn(0x7ffa2012f770 msgr2=0x7ffa2012fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:38:49.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa25eb9640 1 --2- 172.21.15.97:0/637326365 >> v2:172.21.15.97:3300/0 conn(0x7ffa2012f770 0x7ffa2012fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-13T18:38:49.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa256b8640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 0x7ffa2009eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-13T18:38:49.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa25eb9640 1 --2- 172.21.15.97:0/637326365 >> v2:172.21.15.97:3300/0 conn(0x7ffa2012f770 0x7ffa2012fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:38:49.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:49.978+0000 7ffa256b8640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 0x7ffa2009eb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:38:50.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465615581 0 0) 0x7ffa20068220 con 0x7ffa2009f050 2024-09-13T18:38:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa0c0034e0 con 0x7ffa2009f050 2024-09-13T18:38:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 699753027 0 0) 0x7ffa0c0034e0 con 0x7ffa2009f050 2024-09-13T18:38:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 msgr2=0x7ffa2009eb10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:38:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 0x7ffa2009eb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 >> v2:172.21.15.97:3300/0 conn(0x7ffa2012f770 msgr2=0x7ffa2012fb40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:38:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 --2- 172.21.15.97:0/637326365 >> v2:172.21.15.97:3300/0 conn(0x7ffa2012f770 0x7ffa2012fb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa20068e40 con 0x7ffa2009f050 2024-09-13T18:38:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3309352451 0 0) 0x7ffa180017f0 con 0x7ffa2009f050 2024-09-13T18:38:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 >> v1:172.21.15.97:6789/0 conn(0x7ffa2009f050 legacy=0x7ffa201366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa0c0039d0 0x7ffa0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa0c004780 0x7ffa0c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 0x7ffa0c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200693e0 con 0x7ffa0c004780 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200a0000 con 0x7ffa0c0039d0 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c00bb00 con 0x7ffa2009e740 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa256b8640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa0c004780 0x7ffa0c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.174+0000 7ffa25eb9640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa0c0039d0 0x7ffa0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.175+0000 7ffa266ba640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 0x7ffa0c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.175+0000 7ffa256b8640 1 -- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 msgr2=0x7ffa0c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.175+0000 7ffa256b8640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 0x7ffa0c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.175+0000 7ffa256b8640 1 -- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa0c0039d0 msgr2=0x7ffa0c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.175+0000 7ffa256b8640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa0c0039d0 0x7ffa0c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.175+0000 7ffa256b8640 1 -- 172.21.15.97:0/637326365 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c0034e0 con 0x7ffa0c004780 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.175+0000 7ffa266ba640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa2009e740 0x7ffa0c005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.176+0000 7ffa256b8640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa0c004780 0x7ffa0c004bf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffa10006fd0 tx=0x7ffa10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496f10de8fbe0dbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:50.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.176+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1002ac90 con 0x7ffa0c004780 2024-09-13T18:38:50.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.176+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1002ae30 con 0x7ffa0c004780 2024-09-13T18:38:50.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.176+0000 7ffa24eb7640 1 -- 172.21.15.97:0/637326365 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10032690 con 0x7ffa0c004780 2024-09-13T18:38:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.176+0000 7ffa2811d640 1 -- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa0c004780 msgr2=0x7ffa0c004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.176+0000 7ffa2811d640 1 --2- 172.21.15.97:0/637326365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa0c004780 0x7ffa0c004bf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffa10006fd0 tx=0x7ffa10008040 comp rx=0 tx=0).stop 2024-09-13T18:38:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.176+0000 7ffa266ba640 1 -- 172.21.15.97:0/637326365 reap_dead start 2024-09-13T18:38:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.177+0000 7ffa2811d640 1 -- 172.21.15.97:0/637326365 shutdown_connections 2024-09-13T18:38:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.177+0000 7ffa2811d640 1 -- 172.21.15.97:0/637326365 >> 172.21.15.97:0/637326365 conn(0x7ffa20067bd0 msgr2=0x7ffa200a0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.177+0000 7ffa2811d640 1 -- 172.21.15.97:0/637326365 shutdown_connections 2024-09-13T18:38:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.177+0000 7ffa2811d640 1 -- 172.21.15.97:0/637326365 wait complete. 2024-09-13T18:38:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.178+0000 7ffa2811d640 1 Processor -- start 2024-09-13T18:38:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.178+0000 7ffa2811d640 1 -- start start 2024-09-13T18:38:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa2811d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa0c004780 0x7ffa2013ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa2811d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa2013ef70 0x7ffa2011a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa2811d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa2013f340 0x7ffa2011aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa2811d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa201337c0 con 0x7ffa2013ef70 2024-09-13T18:38:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa2811d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2009dcb0 con 0x7ffa2013f340 2024-09-13T18:38:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa2811d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2011c400 con 0x7ffa0c004780 2024-09-13T18:38:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa256b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa2013ef70 0x7ffa2011a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa266ba640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa2013f340 0x7ffa2011aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa256b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa2013ef70 0x7ffa2011a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49172/0 (socket says 172.21.15.97:49172) 2024-09-13T18:38:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa256b8640 1 -- 172.21.15.97:0/1698100872 learned_addr learned my addr 172.21.15.97:0/1698100872 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:38:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa25eb9640 1 --2- 172.21.15.97:0/1698100872 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa0c004780 0x7ffa2013ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa256b8640 1 -- 172.21.15.97:0/1698100872 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa0c004780 msgr2=0x7ffa2013ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa256b8640 1 --2- 172.21.15.97:0/1698100872 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa0c004780 0x7ffa2013ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa256b8640 1 -- 172.21.15.97:0/1698100872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa2013f340 msgr2=0x7ffa2011aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa256b8640 1 --2- 172.21.15.97:0/1698100872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa2013f340 0x7ffa2011aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa256b8640 1 -- 172.21.15.97:0/1698100872 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2011daf0 con 0x7ffa2013ef70 2024-09-13T18:38:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.179+0000 7ffa266ba640 1 --2- 172.21.15.97:0/1698100872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa2013f340 0x7ffa2011aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.180+0000 7ffa256b8640 1 --2- 172.21.15.97:0/1698100872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa2013ef70 0x7ffa2011a4d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffa1002bfd0 tx=0x7ffa10034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.180+0000 7ffa15ffb640 1 -- 172.21.15.97:0/1698100872 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1003d650 con 0x7ffa2013ef70 2024-09-13T18:38:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.180+0000 7ffa15ffb640 1 -- 172.21.15.97:0/1698100872 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1003d7f0 con 0x7ffa2013ef70 2024-09-13T18:38:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.180+0000 7ffa15ffb640 1 -- 172.21.15.97:0/1698100872 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1003dbb0 con 0x7ffa2013ef70 2024-09-13T18:38:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.180+0000 7ffa2811d640 1 -- 172.21.15.97:0/1698100872 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2011de40 con 0x7ffa2013ef70 2024-09-13T18:38:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.180+0000 7ffa2811d640 1 -- 172.21.15.97:0/1698100872 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2011e490 con 0x7ffa2013ef70 2024-09-13T18:38:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.181+0000 7ffa15ffb640 1 -- 172.21.15.97:0/1698100872 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7ffa10046450 con 0x7ffa2013ef70 2024-09-13T18:38:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.181+0000 7ffa15ffb640 1 -- 172.21.15.97:0/1698100872 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ffa1003c6f0 con 0x7ffa2013ef70 2024-09-13T18:38:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.181+0000 7ffa2811d640 1 -- 172.21.15.97:0/1698100872 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa200714b0 con 0x7ffa2013ef70 2024-09-13T18:38:50.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.184+0000 7ffa15ffb640 1 -- 172.21.15.97:0/1698100872 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7ffa100657a0 con 0x7ffa2013ef70 2024-09-13T18:38:50.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.245+0000 7ffa2811d640 1 -- 172.21.15.97:0/1698100872 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ffa2011d790 con 0x7ffa2013ef70 2024-09-13T18:38:50.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.248+0000 7ffa15ffb640 1 -- 172.21.15.97:0/1698100872 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ffa10054020 con 0x7ffa2013ef70 2024-09-13T18:38:50.250 INFO:teuthology.orchestra.run.smithi097.stderr:adjusted tunables profile to default 2024-09-13T18:38:50.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.249+0000 7ffa2811d640 1 -- 172.21.15.97:0/1698100872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa2013ef70 msgr2=0x7ffa2011a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.249+0000 7ffa2811d640 1 --2- 172.21.15.97:0/1698100872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa2013ef70 0x7ffa2011a4d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffa1002bfd0 tx=0x7ffa10034000 comp rx=0 tx=0).stop 2024-09-13T18:38:50.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.249+0000 7ffa2811d640 1 -- 172.21.15.97:0/1698100872 shutdown_connections 2024-09-13T18:38:50.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.249+0000 7ffa2811d640 1 --2- 172.21.15.97:0/1698100872 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa2013f340 0x7ffa2011aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.249+0000 7ffa2811d640 1 --2- 172.21.15.97:0/1698100872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa2013ef70 0x7ffa2011a4d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.249+0000 7ffa2811d640 1 --2- 172.21.15.97:0/1698100872 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa0c004780 0x7ffa2013ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.249+0000 7ffa2811d640 1 -- 172.21.15.97:0/1698100872 >> 172.21.15.97:0/1698100872 conn(0x7ffa20067bd0 msgr2=0x7ffa20130470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:50.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.249+0000 7ffa2811d640 1 -- 172.21.15.97:0/1698100872 shutdown_connections 2024-09-13T18:38:50.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.249+0000 7ffa2811d640 1 -- 172.21.15.97:0/1698100872 wait complete. 2024-09-13T18:38:50.262 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T18:38:50.262 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T18:38:50.263 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:50.263 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T18:38:50.276 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:50.274+0000 7f777c3c3ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:38:50.287 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:50.287 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T18:38:50.318 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:50.315+0000 7f777c3c3ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:38:50.342 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:50.343 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T18:38:50.371 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:50.368+0000 7f777c3c3ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:38:50.395 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-13T18:38:50.395 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T18:38:50.460 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new e3c4b404-1f32-4298-97b5-8d4d3e2a29fe 0 2024-09-13T18:38:50.505 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:50.503+0000 7f777c3c3ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:38:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.596+0000 7f079b878640 1 Processor -- start 2024-09-13T18:38:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.596+0000 7f079b878640 1 -- start start 2024-09-13T18:38:50.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.596+0000 7f079b878640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f07940688c0 0x7f079409d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.596+0000 7f079b878640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0794134740 0x7f0794136b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.596+0000 7f079b878640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07940975a0 con 0x7f079409d2c0 2024-09-13T18:38:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.596+0000 7f079b878640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0794068c90 con 0x7f0794134740 2024-09-13T18:38:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.596+0000 7f079b878640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f079409e410 con 0x7f07940688c0 2024-09-13T18:38:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.596+0000 7f0799614640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f07940688c0 0x7f079409d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.596+0000 7f0798e13640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f079409d2c0 0x7f079409dd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:59382/0 (socket says 172.21.15.97:59382) 2024-09-13T18:38:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.596+0000 7f0799614640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f07940688c0 0x7f079409d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:44640/0 (socket says 172.21.15.97:44640) 2024-09-13T18:38:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.596+0000 7f0798e13640 1 -- 172.21.15.97:0/592334432 learned_addr learned my addr 172.21.15.97:0/592334432 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:38:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.596+0000 7f0799e15640 1 --2- 172.21.15.97:0/592334432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0794134740 0x7f0794136b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.597+0000 7f0799e15640 1 -- 172.21.15.97:0/592334432 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f07940688c0 msgr2=0x7f079409d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.597+0000 7f078bfff640 1 -- 172.21.15.97:0/592334432 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452642201 0 0) 0x7f07940975a0 con 0x7f079409d2c0 2024-09-13T18:38:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.597+0000 7f0799e15640 1 --2- 172.21.15.97:0/592334432 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f07940688c0 0x7f079409d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.597+0000 7f0799e15640 1 -- 172.21.15.97:0/592334432 >> v1:172.21.15.97:6789/0 conn(0x7f079409d2c0 legacy=0x7f079409dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.597+0000 7f0799e15640 1 -- 172.21.15.97:0/592334432 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0794069200 con 0x7f0794134740 2024-09-13T18:38:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.598+0000 7f0799e15640 1 --2- 172.21.15.97:0/592334432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0794134740 0x7f0794136b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f078c009ec0 tx=0x7f078c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8785acaa9438e37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.598+0000 7f078bfff640 1 -- 172.21.15.97:0/592334432 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c031400 con 0x7f0794134740 2024-09-13T18:38:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.598+0000 7f078bfff640 1 -- 172.21.15.97:0/592334432 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c02d050 con 0x7f0794134740 2024-09-13T18:38:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.598+0000 7f078bfff640 1 -- 172.21.15.97:0/592334432 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c031790 con 0x7f0794134740 2024-09-13T18:38:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.598+0000 7f079b878640 1 -- 172.21.15.97:0/592334432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0794134740 msgr2=0x7f0794136b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.598+0000 7f079b878640 1 --2- 172.21.15.97:0/592334432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0794134740 0x7f0794136b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f078c009ec0 tx=0x7f078c009780 comp rx=0 tx=0).stop 2024-09-13T18:38:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.598+0000 7f079b878640 1 -- 172.21.15.97:0/592334432 shutdown_connections 2024-09-13T18:38:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.598+0000 7f079b878640 1 --2- 172.21.15.97:0/592334432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0794134740 0x7f0794136b20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.598+0000 7f079b878640 1 --2- 172.21.15.97:0/592334432 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f07940688c0 0x7f079409d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.598+0000 7f079b878640 1 -- 172.21.15.97:0/592334432 >> 172.21.15.97:0/592334432 conn(0x7f079406f310 msgr2=0x7f07940a29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.599+0000 7f079b878640 1 -- 172.21.15.97:0/592334432 shutdown_connections 2024-09-13T18:38:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.599+0000 7f079b878640 1 -- 172.21.15.97:0/592334432 wait complete. 2024-09-13T18:38:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.599+0000 7f079b878640 1 Processor -- start 2024-09-13T18:38:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.599+0000 7f079b878640 1 -- start start 2024-09-13T18:38:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f079b878640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07940688c0 0x7f0794133440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f079b878640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f079409d2c0 0x7f0794133980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f079b878640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0794134740 0x7f079413e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f079b878640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079409e8a0 con 0x7f0794134740 2024-09-13T18:38:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f079b878640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07940a26b0 con 0x7f07940688c0 2024-09-13T18:38:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f079b878640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0794099720 con 0x7f079409d2c0 2024-09-13T18:38:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f0799614640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07940688c0 0x7f0794133440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f0798e13640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f079409d2c0 0x7f0794133980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f0798e13640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f079409d2c0 0x7f0794133980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:44642/0 (socket says 172.21.15.97:44642) 2024-09-13T18:38:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f0799614640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07940688c0 0x7f0794133440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:48492/0 (socket says 172.21.15.97:48492) 2024-09-13T18:38:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f0799e15640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0794134740 0x7f079413e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f0798e13640 1 -- 172.21.15.97:0/1251911416 learned_addr learned my addr 172.21.15.97:0/1251911416 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:38:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f0799614640 1 -- 172.21.15.97:0/1251911416 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f079409d2c0 msgr2=0x7f0794133980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f0799614640 1 --2- 172.21.15.97:0/1251911416 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f079409d2c0 0x7f0794133980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f0799614640 1 -- 172.21.15.97:0/1251911416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0794134740 msgr2=0x7f079413e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f0799614640 1 --2- 172.21.15.97:0/1251911416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0794134740 0x7f079413e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.600+0000 7f0799614640 1 -- 172.21.15.97:0/1251911416 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c009a20 con 0x7f07940688c0 2024-09-13T18:38:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.601+0000 7f0799614640 1 --2- 172.21.15.97:0/1251911416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07940688c0 0x7f0794133440 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f079000e900 tx=0x7f07900090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.601+0000 7f07897fa640 1 -- 172.21.15.97:0/1251911416 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079000ee90 con 0x7f07940688c0 2024-09-13T18:38:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.601+0000 7f07897fa640 1 -- 172.21.15.97:0/1251911416 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079000c940 con 0x7f07940688c0 2024-09-13T18:38:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.601+0000 7f07897fa640 1 -- 172.21.15.97:0/1251911416 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079000cd00 con 0x7f07940688c0 2024-09-13T18:38:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.601+0000 7f079b878640 1 -- 172.21.15.97:0/1251911416 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0794098270 con 0x7f07940688c0 2024-09-13T18:38:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.601+0000 7f079b878640 1 -- 172.21.15.97:0/1251911416 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0794097af0 con 0x7f07940688c0 2024-09-13T18:38:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.601+0000 7f07897fa640 1 -- 172.21.15.97:0/1251911416 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0790013680 con 0x7f07940688c0 2024-09-13T18:38:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.601+0000 7f07897fa640 1 -- 172.21.15.97:0/1251911416 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f079001c7a0 con 0x7f07940688c0 2024-09-13T18:38:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.602+0000 7f079b878640 1 -- 172.21.15.97:0/1251911416 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07940714b0 con 0x7f07940688c0 2024-09-13T18:38:50.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.604+0000 7f07897fa640 1 -- 172.21.15.97:0/1251911416 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f0790021060 con 0x7f07940688c0 2024-09-13T18:38:50.621 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:50.618+0000 7f777c3c3ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:38:50.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.672+0000 7f079b878640 1 -- 172.21.15.97:0/1251911416 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e3c4b404-1f32-4298-97b5-8d4d3e2a29fe", "id": 0} v 0) v1 -- 0x7f079405e0d0 con 0x7f07940688c0 2024-09-13T18:38:50.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.680+0000 7f07897fa640 1 -- 172.21.15.97:0/1251911416 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e3c4b404-1f32-4298-97b5-8d4d3e2a29fe", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f079002a0b0 con 0x7f07940688c0 2024-09-13T18:38:50.682 INFO:teuthology.orchestra.run.smithi097.stdout:0 2024-09-13T18:38:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.681+0000 7f079b878640 1 -- 172.21.15.97:0/1251911416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07940688c0 msgr2=0x7f0794133440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.681+0000 7f079b878640 1 --2- 172.21.15.97:0/1251911416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07940688c0 0x7f0794133440 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f079000e900 tx=0x7f07900090f0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.681+0000 7f079b878640 1 -- 172.21.15.97:0/1251911416 shutdown_connections 2024-09-13T18:38:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.681+0000 7f079b878640 1 --2- 172.21.15.97:0/1251911416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0794134740 0x7f079413e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.681+0000 7f079b878640 1 --2- 172.21.15.97:0/1251911416 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f079409d2c0 0x7f0794133980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.681+0000 7f079b878640 1 --2- 172.21.15.97:0/1251911416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f07940688c0 0x7f0794133440 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.681+0000 7f079b878640 1 -- 172.21.15.97:0/1251911416 >> 172.21.15.97:0/1251911416 conn(0x7f079406f310 msgr2=0x7f07940a08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.681+0000 7f079b878640 1 -- 172.21.15.97:0/1251911416 shutdown_connections 2024-09-13T18:38:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.681+0000 7f079b878640 1 -- 172.21.15.97:0/1251911416 wait complete. 2024-09-13T18:38:50.694 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 1018877a-7ed4-40a1-bfbc-48dd46f7aeb9 1 2024-09-13T18:38:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.827+0000 7f95ad69a640 1 Processor -- start 2024-09-13T18:38:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.827+0000 7f95ad69a640 1 -- start start 2024-09-13T18:38:50.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95ad69a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f95a806e140 0x7f95a81324e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95ad69a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f95a8132a20 0x7f95a8134e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95ad69a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a806c7c0 con 0x7f95a809f750 2024-09-13T18:38:50.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95ad69a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a809fb20 con 0x7f95a806e140 2024-09-13T18:38:50.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95ad69a640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95a806e510 con 0x7f95a8132a20 2024-09-13T18:38:50.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95a77fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f95a8132a20 0x7f95a8134e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95a6ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f95a809f750 0x7f95a806e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:59390/0 (socket says 172.21.15.97:59390) 2024-09-13T18:38:50.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95a6ffd640 1 -- 172.21.15.97:0/377904088 learned_addr learned my addr 172.21.15.97:0/377904088 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:38:50.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95a67fc640 1 --2- 172.21.15.97:0/377904088 >> v2:172.21.15.97:3300/0 conn(0x7f95a806e140 0x7f95a81324e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95a77fe640 1 -- 172.21.15.97:0/377904088 >> v2:172.21.15.97:3300/0 conn(0x7f95a806e140 msgr2=0x7f95a81324e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:50.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95a77fe640 1 --2- 172.21.15.97:0/377904088 >> v2:172.21.15.97:3300/0 conn(0x7f95a806e140 0x7f95a81324e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95a77fe640 1 -- 172.21.15.97:0/377904088 >> v1:172.21.15.97:6789/0 conn(0x7f95a809f750 legacy=0x7f95a806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95a77fe640 1 -- 172.21.15.97:0/377904088 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a80a0250 con 0x7f95a8132a20 2024-09-13T18:38:50.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95a5ffb640 1 -- 172.21.15.97:0/377904088 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248808207 0 0) 0x7f95a806c7c0 con 0x7f95a809f750 2024-09-13T18:38:50.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.828+0000 7f95a67fc640 1 --2- 172.21.15.97:0/377904088 >> v2:172.21.15.97:3300/0 conn(0x7f95a806e140 0x7f95a81324e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.829+0000 7f95a77fe640 1 --2- 172.21.15.97:0/377904088 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f95a8132a20 0x7f95a8134e00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9598009880 tx=0x7f95980090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f62160bc3a2e550 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.829+0000 7f95a5ffb640 1 -- 172.21.15.97:0/377904088 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959802ac50 con 0x7f95a8132a20 2024-09-13T18:38:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.829+0000 7f95a5ffb640 1 -- 172.21.15.97:0/377904088 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959802adb0 con 0x7f95a8132a20 2024-09-13T18:38:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.829+0000 7f95a5ffb640 1 -- 172.21.15.97:0/377904088 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598032670 con 0x7f95a8132a20 2024-09-13T18:38:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.830+0000 7f95ad69a640 1 -- 172.21.15.97:0/377904088 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f95a8132a20 msgr2=0x7f95a8134e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.830+0000 7f95ad69a640 1 --2- 172.21.15.97:0/377904088 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f95a8132a20 0x7f95a8134e00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9598009880 tx=0x7f95980090f0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.830+0000 7f95ad69a640 1 -- 172.21.15.97:0/377904088 shutdown_connections 2024-09-13T18:38:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.830+0000 7f95ad69a640 1 --2- 172.21.15.97:0/377904088 >> v2:172.21.15.97:3300/0 conn(0x7f95a806e140 0x7f95a81324e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.830+0000 7f95ad69a640 1 --2- 172.21.15.97:0/377904088 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f95a8132a20 0x7f95a8134e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.830+0000 7f95ad69a640 1 -- 172.21.15.97:0/377904088 >> 172.21.15.97:0/377904088 conn(0x7f95a8067b90 msgr2=0x7f95a80a0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.830+0000 7f95ad69a640 1 -- 172.21.15.97:0/377904088 shutdown_connections 2024-09-13T18:38:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.830+0000 7f95ad69a640 1 -- 172.21.15.97:0/377904088 wait complete. 2024-09-13T18:38:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.831+0000 7f95ad69a640 1 Processor -- start 2024-09-13T18:38:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.831+0000 7f95ad69a640 1 -- start start 2024-09-13T18:38:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95ad69a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95a806e140 0x7f95a813c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95ad69a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95a809f750 0x7f95a813cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95ad69a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f95a8132a20 0x7f95a80969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95ad69a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a81355c0 con 0x7f95a806e140 2024-09-13T18:38:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95ad69a640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a812b0e0 con 0x7f95a809f750 2024-09-13T18:38:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95ad69a640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95a806c050 con 0x7f95a8132a20 2024-09-13T18:38:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95a806e140 0x7f95a813c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a77fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f95a8132a20 0x7f95a80969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95a806e140 0x7f95a813c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49200/0 (socket says 172.21.15.97:49200) 2024-09-13T18:38:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a77fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f95a8132a20 0x7f95a80969d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:44652/0 (socket says 172.21.15.97:44652) 2024-09-13T18:38:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a6ffd640 1 -- 172.21.15.97:0/2897365619 learned_addr learned my addr 172.21.15.97:0/2897365619 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:38:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a67fc640 1 --2- 172.21.15.97:0/2897365619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95a809f750 0x7f95a813cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:50.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a67fc640 1 -- 172.21.15.97:0/2897365619 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f95a8132a20 msgr2=0x7f95a80969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a67fc640 1 --2- 172.21.15.97:0/2897365619 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f95a8132a20 0x7f95a80969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a67fc640 1 -- 172.21.15.97:0/2897365619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95a806e140 msgr2=0x7f95a813c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a67fc640 1 --2- 172.21.15.97:0/2897365619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95a806e140 0x7f95a813c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a67fc640 1 -- 172.21.15.97:0/2897365619 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c009a20 con 0x7f95a809f750 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a77fe640 1 --2- 172.21.15.97:0/2897365619 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f95a8132a20 0x7f95a80969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a6ffd640 1 --2- 172.21.15.97:0/2897365619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95a806e140 0x7f95a813c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.832+0000 7f95a67fc640 1 --2- 172.21.15.97:0/2897365619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95a809f750 0x7f95a813cef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f959c009fa0 tx=0x7f959c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.833+0000 7f958effd640 1 -- 172.21.15.97:0/2897365619 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c009d00 con 0x7f95a809f750 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.833+0000 7f958effd640 1 -- 172.21.15.97:0/2897365619 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c00f040 con 0x7f95a809f750 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.833+0000 7f95ad69a640 1 -- 172.21.15.97:0/2897365619 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9598009390 con 0x7f95a809f750 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.833+0000 7f958effd640 1 -- 172.21.15.97:0/2897365619 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c0146b0 con 0x7f95a809f750 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.833+0000 7f95ad69a640 1 -- 172.21.15.97:0/2897365619 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a8099690 con 0x7f95a809f750 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.833+0000 7f958effd640 1 -- 172.21.15.97:0/2897365619 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f959c003020 con 0x7f95a809f750 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.833+0000 7f958effd640 1 -- 172.21.15.97:0/2897365619 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f959c01dc00 con 0x7f95a809f750 2024-09-13T18:38:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.834+0000 7f95ad69a640 1 -- 172.21.15.97:0/2897365619 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a8099440 con 0x7f95a809f750 2024-09-13T18:38:50.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.835+0000 7f958effd640 1 -- 172.21.15.97:0/2897365619 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f959c018020 con 0x7f95a809f750 2024-09-13T18:38:50.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.902+0000 7f95ad69a640 1 -- 172.21.15.97:0/2897365619 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1018877a-7ed4-40a1-bfbc-48dd46f7aeb9", "id": 1} v 0) v1 -- 0x7f95a80714b0 con 0x7f95a809f750 2024-09-13T18:38:50.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.908+0000 7f958effd640 1 -- 172.21.15.97:0/2897365619 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1018877a-7ed4-40a1-bfbc-48dd46f7aeb9", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f959c00ce40 con 0x7f95a809f750 2024-09-13T18:38:50.911 INFO:teuthology.orchestra.run.smithi097.stdout:1 2024-09-13T18:38:50.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.909+0000 7f95ad69a640 1 -- 172.21.15.97:0/2897365619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95a809f750 msgr2=0x7f95a813cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:50.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.909+0000 7f95ad69a640 1 --2- 172.21.15.97:0/2897365619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95a809f750 0x7f95a813cef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f959c009fa0 tx=0x7f959c00b040 comp rx=0 tx=0).stop 2024-09-13T18:38:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.909+0000 7f95ad69a640 1 -- 172.21.15.97:0/2897365619 shutdown_connections 2024-09-13T18:38:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.909+0000 7f95ad69a640 1 --2- 172.21.15.97:0/2897365619 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f95a8132a20 0x7f95a80969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.909+0000 7f95ad69a640 1 --2- 172.21.15.97:0/2897365619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f95a809f750 0x7f95a813cef0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.909+0000 7f95ad69a640 1 --2- 172.21.15.97:0/2897365619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f95a806e140 0x7f95a813c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.909+0000 7f95ad69a640 1 -- 172.21.15.97:0/2897365619 >> 172.21.15.97:0/2897365619 conn(0x7f95a8067b90 msgr2=0x7f95a809d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.909+0000 7f95ad69a640 1 -- 172.21.15.97:0/2897365619 shutdown_connections 2024-09-13T18:38:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:50.909+0000 7f95ad69a640 1 -- 172.21.15.97:0/2897365619 wait complete. 2024-09-13T18:38:50.921 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 482f64f7-168a-4b1c-a6d1-2eecbdc4d76b 2 2024-09-13T18:38:50.974 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:50.971+0000 7f777c3c3ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:38:51.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f581569f640 1 Processor -- start 2024-09-13T18:38:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f581569f640 1 -- start start 2024-09-13T18:38:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f581569f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f581009f060 0x7f581009f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f581569f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f581012f410 0x7f581012f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f581569f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581012fda0 0x7f5810136750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f581569f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5810068db0 con 0x7f581012f410 2024-09-13T18:38:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f581569f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5810068220 con 0x7f581009f060 2024-09-13T18:38:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f581569f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58100693c0 con 0x7f581012fda0 2024-09-13T18:38:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f580f7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581012fda0 0x7f5810136750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f580e7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f581012f410 0x7f581012f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f580e7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f581012f410 0x7f581012f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49212/0 (socket says 172.21.15.97:49212) 2024-09-13T18:38:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f580f7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581012fda0 0x7f5810136750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:44662/0 (socket says 172.21.15.97:44662) 2024-09-13T18:38:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f580e7fc640 1 -- 172.21.15.97:0/3830774502 learned_addr learned my addr 172.21.15.97:0/3830774502 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:38:51.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.012+0000 7f580effd640 1 --2- 172.21.15.97:0/3830774502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f581009f060 0x7f581009f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.013+0000 7f580effd640 1 -- 172.21.15.97:0/3830774502 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581012fda0 msgr2=0x7f5810136750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:51.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.013+0000 7f580effd640 1 --2- 172.21.15.97:0/3830774502 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581012fda0 0x7f5810136750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.013+0000 7f580effd640 1 -- 172.21.15.97:0/3830774502 >> v2:172.21.15.97:3300/0 conn(0x7f581012f410 msgr2=0x7f581012f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:51.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.013+0000 7f580effd640 1 --2- 172.21.15.97:0/3830774502 >> v2:172.21.15.97:3300/0 conn(0x7f581012f410 0x7f581012f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.013+0000 7f580effd640 1 -- 172.21.15.97:0/3830774502 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5810068fe0 con 0x7f581009f060 2024-09-13T18:38:51.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.013+0000 7f580e7fc640 1 --2- 172.21.15.97:0/3830774502 >> v2:172.21.15.97:3300/0 conn(0x7f581012f410 0x7f581012f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:51.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.013+0000 7f580f7fe640 1 --2- 172.21.15.97:0/3830774502 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581012fda0 0x7f5810136750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.013+0000 7f580effd640 1 --2- 172.21.15.97:0/3830774502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f581009f060 0x7f581009f430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5800009880 tx=0x7f58000090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=913a333dc30dea6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.014+0000 7f580dffb640 1 -- 172.21.15.97:0/3830774502 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580002abc0 con 0x7f581009f060 2024-09-13T18:38:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.014+0000 7f580dffb640 1 -- 172.21.15.97:0/3830774502 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580002ad20 con 0x7f581009f060 2024-09-13T18:38:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.014+0000 7f580dffb640 1 -- 172.21.15.97:0/3830774502 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800032670 con 0x7f581009f060 2024-09-13T18:38:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.014+0000 7f581569f640 1 -- 172.21.15.97:0/3830774502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f581009f060 msgr2=0x7f581009f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.014+0000 7f581569f640 1 --2- 172.21.15.97:0/3830774502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f581009f060 0x7f581009f430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5800009880 tx=0x7f58000090f0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.014+0000 7f581569f640 1 -- 172.21.15.97:0/3830774502 shutdown_connections 2024-09-13T18:38:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.014+0000 7f581569f640 1 --2- 172.21.15.97:0/3830774502 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581012fda0 0x7f5810136750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.014+0000 7f581569f640 1 --2- 172.21.15.97:0/3830774502 >> v2:172.21.15.97:3300/0 conn(0x7f581012f410 0x7f581012f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.014+0000 7f581569f640 1 --2- 172.21.15.97:0/3830774502 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f581009f060 0x7f581009f430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.014+0000 7f581569f640 1 -- 172.21.15.97:0/3830774502 >> 172.21.15.97:0/3830774502 conn(0x7f5810067b90 msgr2=0x7f58100a0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.014+0000 7f581569f640 1 -- 172.21.15.97:0/3830774502 shutdown_connections 2024-09-13T18:38:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.014+0000 7f581569f640 1 -- 172.21.15.97:0/3830774502 wait complete. 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.015+0000 7f581569f640 1 Processor -- start 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.015+0000 7f581569f640 1 -- start start 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f581569f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581009f060 0x7f581011c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f581569f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f581012f410 0x7f5810118cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f581569f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f581012fda0 0x7f58101191f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f581569f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581006c4a0 con 0x7f581012fda0 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f581569f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5810068660 con 0x7f581012f410 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f581569f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f581011b8d0 con 0x7f581009f060 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f580effd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581009f060 0x7f581011c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f580effd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581009f060 0x7f581011c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:44678/0 (socket says 172.21.15.97:44678) 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f580effd640 1 -- 172.21.15.97:0/1183243537 learned_addr learned my addr 172.21.15.97:0/1183243537 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f580f7fe640 1 --2- 172.21.15.97:0/1183243537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f581012fda0 0x7f58101191f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f580e7fc640 1 --2- 172.21.15.97:0/1183243537 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f581012f410 0x7f5810118cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f580effd640 1 -- 172.21.15.97:0/1183243537 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f581012f410 msgr2=0x7f5810118cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f580effd640 1 --2- 172.21.15.97:0/1183243537 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f581012f410 0x7f5810118cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f580effd640 1 -- 172.21.15.97:0/1183243537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f581012fda0 msgr2=0x7f58101191f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f580effd640 1 --2- 172.21.15.97:0/1183243537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f581012fda0 0x7f58101191f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f580effd640 1 -- 172.21.15.97:0/1183243537 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5804009450 con 0x7f581009f060 2024-09-13T18:38:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.016+0000 7f580e7fc640 1 --2- 172.21.15.97:0/1183243537 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f581012f410 0x7f5810118cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.017+0000 7f580effd640 1 --2- 172.21.15.97:0/1183243537 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581009f060 0x7f581011c370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5800009360 tx=0x7f5800032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.017+0000 7f57f6ffd640 1 -- 172.21.15.97:0/1183243537 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580003d720 con 0x7f581009f060 2024-09-13T18:38:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.017+0000 7f57f6ffd640 1 -- 172.21.15.97:0/1183243537 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580002ae90 con 0x7f581009f060 2024-09-13T18:38:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.017+0000 7f57f6ffd640 1 -- 172.21.15.97:0/1183243537 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580003dad0 con 0x7f581009f060 2024-09-13T18:38:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.017+0000 7f581569f640 1 -- 172.21.15.97:0/1183243537 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5808009a20 con 0x7f581009f060 2024-09-13T18:38:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.017+0000 7f581569f640 1 -- 172.21.15.97:0/1183243537 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5800009390 con 0x7f581009f060 2024-09-13T18:38:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.017+0000 7f57f6ffd640 1 -- 172.21.15.97:0/1183243537 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f5800039040 con 0x7f581009f060 2024-09-13T18:38:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.017+0000 7f57f6ffd640 1 -- 172.21.15.97:0/1183243537 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f5800046ab0 con 0x7f581009f060 2024-09-13T18:38:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.018+0000 7f581569f640 1 -- 172.21.15.97:0/1183243537 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58100714b0 con 0x7f581009f060 2024-09-13T18:38:51.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.020+0000 7f57f6ffd640 1 -- 172.21.15.97:0/1183243537 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f5800042070 con 0x7f581009f060 2024-09-13T18:38:51.056 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:51.053+0000 7f777c3c3ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:38:51.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.088+0000 7f581569f640 1 -- 172.21.15.97:0/1183243537 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd new", "uuid": "482f64f7-168a-4b1c-a6d1-2eecbdc4d76b", "id": 2} v 0) v1 -- 0x7f581006ecc0 con 0x7f581009f060 2024-09-13T18:38:51.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.093+0000 7f57f6ffd640 1 -- 172.21.15.97:0/1183243537 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "482f64f7-168a-4b1c-a6d1-2eecbdc4d76b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5800037070 con 0x7f581009f060 2024-09-13T18:38:51.096 INFO:teuthology.orchestra.run.smithi097.stdout:2 2024-09-13T18:38:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.094+0000 7f581569f640 1 -- 172.21.15.97:0/1183243537 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581009f060 msgr2=0x7f581011c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.094+0000 7f581569f640 1 --2- 172.21.15.97:0/1183243537 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581009f060 0x7f581011c370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5800009360 tx=0x7f5800032000 comp rx=0 tx=0).stop 2024-09-13T18:38:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.094+0000 7f581569f640 1 -- 172.21.15.97:0/1183243537 shutdown_connections 2024-09-13T18:38:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.094+0000 7f581569f640 1 --2- 172.21.15.97:0/1183243537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f581012fda0 0x7f58101191f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.094+0000 7f581569f640 1 --2- 172.21.15.97:0/1183243537 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f581012f410 0x7f5810118cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.094+0000 7f581569f640 1 --2- 172.21.15.97:0/1183243537 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f581009f060 0x7f581011c370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.094+0000 7f581569f640 1 -- 172.21.15.97:0/1183243537 >> 172.21.15.97:0/1183243537 conn(0x7f5810067b90 msgr2=0x7f581012e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.094+0000 7f581569f640 1 -- 172.21.15.97:0/1183243537 shutdown_connections 2024-09-13T18:38:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.094+0000 7f581569f640 1 -- 172.21.15.97:0/1183243537 wait complete. 2024-09-13T18:38:51.106 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 8f56f301-77c9-400b-b5c3-aace648797a2 3 2024-09-13T18:38:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.198+0000 7f7101c9f640 1 Processor -- start 2024-09-13T18:38:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.198+0000 7f7101c9f640 1 -- start start 2024-09-13T18:38:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f7101c9f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f70fc0a00d0 0x7f70fc12f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f7101c9f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 0x7f70fc1376d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f7101c9f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc06b5b0 con 0x7f70fc12fcb0 2024-09-13T18:38:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f7101c9f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc0a04a0 con 0x7f70fc0a00d0 2024-09-13T18:38:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f7101c9f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc09be40 con 0x7f70fc067820 2024-09-13T18:38:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 0x7f70fc1376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f70fb7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f70fc0a00d0 0x7f70fc12f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 0x7f70fc1376d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:44690/0 (socket says 172.21.15.97:44690) 2024-09-13T18:38:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f70fbfff640 1 -- 172.21.15.97:0/1645326649 learned_addr learned my addr 172.21.15.97:0/1645326649 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:38:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f70fbfff640 1 -- 172.21.15.97:0/1645326649 >> v2:172.21.15.97:3300/0 conn(0x7f70fc0a00d0 msgr2=0x7f70fc12f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f70fbfff640 1 --2- 172.21.15.97:0/1645326649 >> v2:172.21.15.97:3300/0 conn(0x7f70fc0a00d0 0x7f70fc12f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f70fbfff640 1 -- 172.21.15.97:0/1645326649 >> v1:172.21.15.97:6789/0 conn(0x7f70fc12fcb0 legacy=0x7f70fc067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f70fa7fc640 1 -- 172.21.15.97:0/1645326649 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974609121 0 0) 0x7f70fc06b5b0 con 0x7f70fc12fcb0 2024-09-13T18:38:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f70fbfff640 1 -- 172.21.15.97:0/1645326649 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc06ac80 con 0x7f70fc067820 2024-09-13T18:38:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.199+0000 7f70fb7fe640 1 --2- 172.21.15.97:0/1645326649 >> v2:172.21.15.97:3300/0 conn(0x7f70fc0a00d0 0x7f70fc12f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.200+0000 7f70fbfff640 1 --2- 172.21.15.97:0/1645326649 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 0x7f70fc1376d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009f20 tx=0x7f70f4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ea6bdfccf6c1549 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.200+0000 7f70fa7fc640 1 -- 172.21.15.97:0/1645326649 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4031400 con 0x7f70fc067820 2024-09-13T18:38:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.200+0000 7f70fa7fc640 1 -- 172.21.15.97:0/1645326649 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f402d050 con 0x7f70fc067820 2024-09-13T18:38:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.200+0000 7f70fa7fc640 1 -- 172.21.15.97:0/1645326649 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4031790 con 0x7f70fc067820 2024-09-13T18:38:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.201+0000 7f7101c9f640 1 -- 172.21.15.97:0/1645326649 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 msgr2=0x7f70fc1376d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.201+0000 7f7101c9f640 1 --2- 172.21.15.97:0/1645326649 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 0x7f70fc1376d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009f20 tx=0x7f70f4009840 comp rx=0 tx=0).stop 2024-09-13T18:38:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.201+0000 7f7101c9f640 1 -- 172.21.15.97:0/1645326649 shutdown_connections 2024-09-13T18:38:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.201+0000 7f7101c9f640 1 --2- 172.21.15.97:0/1645326649 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 0x7f70fc1376d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.201+0000 7f7101c9f640 1 --2- 172.21.15.97:0/1645326649 >> v2:172.21.15.97:3300/0 conn(0x7f70fc0a00d0 0x7f70fc12f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.201+0000 7f7101c9f640 1 -- 172.21.15.97:0/1645326649 >> 172.21.15.97:0/1645326649 conn(0x7f70fc05e610 msgr2=0x7f70fc09f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.201+0000 7f7101c9f640 1 -- 172.21.15.97:0/1645326649 shutdown_connections 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.201+0000 7f7101c9f640 1 -- 172.21.15.97:0/1645326649 wait complete. 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.202+0000 7f7101c9f640 1 Processor -- start 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.202+0000 7f7101c9f640 1 -- start start 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.202+0000 7f7101c9f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 0x7f70fc11b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.202+0000 7f7101c9f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc0a00d0 0x7f70fc11b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.202+0000 7f7101c9f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70fc12fcb0 0x7f70fc11bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.202+0000 7f7101c9f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc06b0e0 con 0x7f70fc12fcb0 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.202+0000 7f7101c9f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc11f790 con 0x7f70fc0a00d0 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.202+0000 7f7101c9f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc11e610 con 0x7f70fc067820 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.202+0000 7f70fb7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 0x7f70fc11b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.202+0000 7f70fb7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 0x7f70fc11b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:44702/0 (socket says 172.21.15.97:44702) 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.202+0000 7f70fb7fe640 1 -- 172.21.15.97:0/858219321 learned_addr learned my addr 172.21.15.97:0/858219321 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.202+0000 7f70faffd640 1 --2- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc0a00d0 0x7f70fc11b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.202+0000 7f70fbfff640 1 --2- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70fc12fcb0 0x7f70fc11bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f70faffd640 1 -- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 msgr2=0x7f70fc11b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f70faffd640 1 --2- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 0x7f70fc11b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f70faffd640 1 -- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70fc12fcb0 msgr2=0x7f70fc11bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f70faffd640 1 --2- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70fc12fcb0 0x7f70fc11bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f70faffd640 1 -- 172.21.15.97:0/858219321 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f0009390 con 0x7f70fc0a00d0 2024-09-13T18:38:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f70fb7fe640 1 --2- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 0x7f70fc11b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f70fbfff640 1 --2- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70fc12fcb0 0x7f70fc11bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f70faffd640 1 --2- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc0a00d0 0x7f70fc11b6d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00c490 tx=0x7f70ec007c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f70e37fe640 1 -- 172.21.15.97:0/858219321 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec011590 con 0x7f70fc0a00d0 2024-09-13T18:38:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f70e37fe640 1 -- 172.21.15.97:0/858219321 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec011710 con 0x7f70fc0a00d0 2024-09-13T18:38:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f7101c9f640 1 -- 172.21.15.97:0/858219321 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f4009ae0 con 0x7f70fc0a00d0 2024-09-13T18:38:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f70e37fe640 1 -- 172.21.15.97:0/858219321 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec011ad0 con 0x7f70fc0a00d0 2024-09-13T18:38:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f7101c9f640 1 -- 172.21.15.97:0/858219321 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc11f300 con 0x7f70fc0a00d0 2024-09-13T18:38:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f70e37fe640 1 -- 172.21.15.97:0/858219321 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f70ec01c440 con 0x7f70fc0a00d0 2024-09-13T18:38:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.203+0000 7f70e37fe640 1 -- 172.21.15.97:0/858219321 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f70ec0128c0 con 0x7f70fc0a00d0 2024-09-13T18:38:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.204+0000 7f7101c9f640 1 -- 172.21.15.97:0/858219321 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc11ec00 con 0x7f70fc0a00d0 2024-09-13T18:38:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.206+0000 7f70e37fe640 1 -- 172.21.15.97:0/858219321 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f70ec017070 con 0x7f70fc0a00d0 2024-09-13T18:38:51.259 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:51.257+0000 7f777c3c3ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:38:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.274+0000 7f7101c9f640 1 -- 172.21.15.97:0/858219321 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8f56f301-77c9-400b-b5c3-aace648797a2", "id": 3} v 0) v1 -- 0x7f70fc0714b0 con 0x7f70fc0a00d0 2024-09-13T18:38:51.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.279+0000 7f70e37fe640 1 -- 172.21.15.97:0/858219321 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f56f301-77c9-400b-b5c3-aace648797a2", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f70ec01c920 con 0x7f70fc0a00d0 2024-09-13T18:38:51.282 INFO:teuthology.orchestra.run.smithi097.stdout:3 2024-09-13T18:38:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.280+0000 7f7101c9f640 1 -- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc0a00d0 msgr2=0x7f70fc11b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.280+0000 7f7101c9f640 1 --2- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc0a00d0 0x7f70fc11b6d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00c490 tx=0x7f70ec007c50 comp rx=0 tx=0).stop 2024-09-13T18:38:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.280+0000 7f7101c9f640 1 -- 172.21.15.97:0/858219321 shutdown_connections 2024-09-13T18:38:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.280+0000 7f7101c9f640 1 --2- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f70fc12fcb0 0x7f70fc11bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.280+0000 7f7101c9f640 1 --2- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f70fc0a00d0 0x7f70fc11b6d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.280+0000 7f7101c9f640 1 --2- 172.21.15.97:0/858219321 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f70fc067820 0x7f70fc11b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.280+0000 7f7101c9f640 1 -- 172.21.15.97:0/858219321 >> 172.21.15.97:0/858219321 conn(0x7f70fc05e610 msgr2=0x7f70fc12e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.280+0000 7f7101c9f640 1 -- 172.21.15.97:0/858219321 shutdown_connections 2024-09-13T18:38:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.280+0000 7f7101c9f640 1 -- 172.21.15.97:0/858219321 wait complete. 2024-09-13T18:38:51.292 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T18:38:51.293 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T18:38:51.295 INFO:tasks.ceph.osd.0:Started 2024-09-13T18:38:51.295 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T18:38:51.295 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T18:38:51.297 INFO:tasks.ceph.osd.1:Started 2024-09-13T18:38:51.297 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T18:38:51.297 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T18:38:51.299 INFO:tasks.ceph.osd.2:Started 2024-09-13T18:38:51.299 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T18:38:51.300 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T18:38:51.302 INFO:tasks.ceph.osd.3:Started 2024-09-13T18:38:51.302 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:51.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.428+0000 7f5702b5d640 1 Processor -- start 2024-09-13T18:38:51.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.428+0000 7f5702b5d640 1 -- start start 2024-09-13T18:38:51.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f5702b5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc0a1290 0x7f56fc12d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f5702b5d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f56fc12d7c0 0x7f56fc12db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f5702b5d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56fc06da40 con 0x7f56fc09b2a0 2024-09-13T18:38:51.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f5702b5d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56fc06ee70 con 0x7f56fc12d7c0 2024-09-13T18:38:51.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f5702b5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc09cd30 con 0x7f56fc0a1290 2024-09-13T18:38:51.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f57008f9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc0a1290 0x7f56fc12d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f57008f9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc0a1290 0x7f56fc12d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:48556/0 (socket says 172.21.15.97:48556) 2024-09-13T18:38:51.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f57008f9640 1 -- 172.21.15.97:0/3265825076 learned_addr learned my addr 172.21.15.97:0/3265825076 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:38:51.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f56fbfff640 1 --2- 172.21.15.97:0/3265825076 >> v2:172.21.15.97:3300/0 conn(0x7f56fc12d7c0 0x7f56fc12db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f57008f9640 1 -- 172.21.15.97:0/3265825076 >> v2:172.21.15.97:3300/0 conn(0x7f56fc12d7c0 msgr2=0x7f56fc12db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:51.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f57008f9640 1 --2- 172.21.15.97:0/3265825076 >> v2:172.21.15.97:3300/0 conn(0x7f56fc12d7c0 0x7f56fc12db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f57008f9640 1 -- 172.21.15.97:0/3265825076 >> v1:172.21.15.97:6789/0 conn(0x7f56fc09b2a0 legacy=0x7f56fc09b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f57008f9640 1 -- 172.21.15.97:0/3265825076 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc12e0d0 con 0x7f56fc0a1290 2024-09-13T18:38:51.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.429+0000 7f56fbfff640 1 --2- 172.21.15.97:0/3265825076 >> v2:172.21.15.97:3300/0 conn(0x7f56fc12d7c0 0x7f56fc12db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:51.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.430+0000 7f57008f9640 1 --2- 172.21.15.97:0/3265825076 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc0a1290 0x7f56fc12d1e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009940 tx=0x7f56f00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fd1154490538bc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:51.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.430+0000 7f56fb7fe640 1 -- 172.21.15.97:0/3265825076 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f002ad20 con 0x7f56fc0a1290 2024-09-13T18:38:51.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.430+0000 7f56fb7fe640 1 -- 172.21.15.97:0/3265825076 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f002ae80 con 0x7f56fc0a1290 2024-09-13T18:38:51.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.430+0000 7f56fb7fe640 1 -- 172.21.15.97:0/3265825076 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0032670 con 0x7f56fc0a1290 2024-09-13T18:38:51.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.431+0000 7f5702b5d640 1 -- 172.21.15.97:0/3265825076 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc0a1290 msgr2=0x7f56fc12d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.431+0000 7f5702b5d640 1 --2- 172.21.15.97:0/3265825076 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc0a1290 0x7f56fc12d1e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009940 tx=0x7f56f00091d0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.431+0000 7f5702b5d640 1 -- 172.21.15.97:0/3265825076 shutdown_connections 2024-09-13T18:38:51.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.431+0000 7f5702b5d640 1 --2- 172.21.15.97:0/3265825076 >> v2:172.21.15.97:3300/0 conn(0x7f56fc12d7c0 0x7f56fc12db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.431+0000 7f5702b5d640 1 --2- 172.21.15.97:0/3265825076 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc0a1290 0x7f56fc12d1e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.431+0000 7f5702b5d640 1 -- 172.21.15.97:0/3265825076 >> 172.21.15.97:0/3265825076 conn(0x7f56fc067820 msgr2=0x7f56fc0a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:51.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.431+0000 7f5702b5d640 1 -- 172.21.15.97:0/3265825076 shutdown_connections 2024-09-13T18:38:51.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.431+0000 7f5702b5d640 1 -- 172.21.15.97:0/3265825076 wait complete. 2024-09-13T18:38:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.432+0000 7f5702b5d640 1 Processor -- start 2024-09-13T18:38:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.432+0000 7f5702b5d640 1 -- start start 2024-09-13T18:38:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.432+0000 7f5702b5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc09b2a0 0x7f56fc11d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.432+0000 7f5702b5d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56fc0a1290 0x7f56fc11d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.432+0000 7f57008f9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc09b2a0 0x7f56fc11d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.432+0000 7f5702b5d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f56fc12d7c0 0x7f56fc068220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.432+0000 7f5702b5d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc11b080 con 0x7f56fc0a1290 2024-09-13T18:38:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.432+0000 7f5702b5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc11adc0 con 0x7f56fc09b2a0 2024-09-13T18:38:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.432+0000 7f5702b5d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc119be0 con 0x7f56fc12d7c0 2024-09-13T18:38:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.432+0000 7f57008f9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc09b2a0 0x7f56fc11d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:48562/0 (socket says 172.21.15.97:48562) 2024-09-13T18:38:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.432+0000 7f57008f9640 1 -- 172.21.15.97:0/2587984874 learned_addr learned my addr 172.21.15.97:0/2587984874 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:38:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.432+0000 7f56fbfff640 1 --2- 172.21.15.97:0/2587984874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56fc0a1290 0x7f56fc11d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.433+0000 7f57010fa640 1 --2- 172.21.15.97:0/2587984874 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f56fc12d7c0 0x7f56fc068220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.433+0000 7f57008f9640 1 -- 172.21.15.97:0/2587984874 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f56fc12d7c0 msgr2=0x7f56fc068220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.433+0000 7f57008f9640 1 --2- 172.21.15.97:0/2587984874 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f56fc12d7c0 0x7f56fc068220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.433+0000 7f57008f9640 1 -- 172.21.15.97:0/2587984874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56fc0a1290 msgr2=0x7f56fc11d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.433+0000 7f57008f9640 1 --2- 172.21.15.97:0/2587984874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56fc0a1290 0x7f56fc11d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.433+0000 7f57008f9640 1 -- 172.21.15.97:0/2587984874 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f0009450 con 0x7f56fc09b2a0 2024-09-13T18:38:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.433+0000 7f57008f9640 1 --2- 172.21.15.97:0/2587984874 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc09b2a0 0x7f56fc11d180 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f56f002a690 tx=0x7f56f0032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.433+0000 7f56f8ff9640 1 -- 172.21.15.97:0/2587984874 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0032e20 con 0x7f56fc09b2a0 2024-09-13T18:38:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.433+0000 7f56f8ff9640 1 -- 172.21.15.97:0/2587984874 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f0031a60 con 0x7f56fc09b2a0 2024-09-13T18:38:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.433+0000 7f5702b5d640 1 -- 172.21.15.97:0/2587984874 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56fc069dc0 con 0x7f56fc09b2a0 2024-09-13T18:38:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.433+0000 7f56f8ff9640 1 -- 172.21.15.97:0/2587984874 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0031e60 con 0x7f56fc09b2a0 2024-09-13T18:38:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.433+0000 7f5702b5d640 1 -- 172.21.15.97:0/2587984874 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56fc11aa70 con 0x7f56fc09b2a0 2024-09-13T18:38:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.434+0000 7f56f8ff9640 1 -- 172.21.15.97:0/2587984874 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f56f0039040 con 0x7f56fc09b2a0 2024-09-13T18:38:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.434+0000 7f56f8ff9640 1 -- 172.21.15.97:0/2587984874 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f56f0041030 con 0x7f56fc09b2a0 2024-09-13T18:38:51.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.435+0000 7f5702b5d640 1 -- 172.21.15.97:0/2587984874 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56fc064600 con 0x7f56fc09b2a0 2024-09-13T18:38:51.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.437+0000 7f56f8ff9640 1 -- 172.21.15.97:0/2587984874 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f56f004b060 con 0x7f56fc09b2a0 2024-09-13T18:38:51.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.493+0000 7f5702b5d640 1 -- 172.21.15.97:0/2587984874 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56fc09ae70 con 0x7f56fc09b2a0 2024-09-13T18:38:51.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.494+0000 7f56f8ff9640 1 -- 172.21.15.97:0/2587984874 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7f56f0037070 con 0x7f56fc09b2a0 2024-09-13T18:38:51.497 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:38:51.497 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":6,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:38:51.275686+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:51.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.495+0000 7f5702b5d640 1 -- 172.21.15.97:0/2587984874 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc09b2a0 msgr2=0x7f56fc11d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:51.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.495+0000 7f5702b5d640 1 --2- 172.21.15.97:0/2587984874 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc09b2a0 0x7f56fc11d180 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f56f002a690 tx=0x7f56f0032000 comp rx=0 tx=0).stop 2024-09-13T18:38:51.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.495+0000 7f5702b5d640 1 -- 172.21.15.97:0/2587984874 shutdown_connections 2024-09-13T18:38:51.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.495+0000 7f5702b5d640 1 --2- 172.21.15.97:0/2587984874 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f56fc12d7c0 0x7f56fc068220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.495+0000 7f5702b5d640 1 --2- 172.21.15.97:0/2587984874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56fc0a1290 0x7f56fc11d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.495+0000 7f5702b5d640 1 --2- 172.21.15.97:0/2587984874 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f56fc09b2a0 0x7f56fc11d180 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:51.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.495+0000 7f5702b5d640 1 -- 172.21.15.97:0/2587984874 >> 172.21.15.97:0/2587984874 conn(0x7f56fc067820 msgr2=0x7f56fc09f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:51.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.495+0000 7f5702b5d640 1 -- 172.21.15.97:0/2587984874 shutdown_connections 2024-09-13T18:38:51.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:38:51.495+0000 7f5702b5d640 1 -- 172.21.15.97:0/2587984874 wait complete. 2024-09-13T18:38:51.508 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T18:38:51.508 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T18:38:51.639 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:51.636+0000 7f777c3c3ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:38:51.690 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:51.688+0000 7f777c3c3ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:38:51.910 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-09-13T18:38:51.907+0000 7f2706d21440 -1 Falling back to public interface 2024-09-13T18:38:51.911 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-09-13T18:38:51.909+0000 7f4763610440 -1 Falling back to public interface 2024-09-13T18:38:51.912 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:51.913 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-09-13T18:38:51.910+0000 7f732ad21440 -1 Falling back to public interface 2024-09-13T18:38:51.919 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-09-13T18:38:51.916+0000 7f7971d51440 -1 Falling back to public interface 2024-09-13T18:38:52.002 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.996+0000 7fc5feb9d640 1 Processor -- start 2024-09-13T18:38:52.002 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.996+0000 7fc5feb9d640 1 -- start start 2024-09-13T18:38:52.002 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5feb9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5f809ba70 0x7fc5f809be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:52.002 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5feb9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc5f806e4b0 0x7fc5f806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5feb9d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f806cc20 con 0x7fc5f809c380 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5feb9d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f809ac60 con 0x7fc5f806e4b0 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5feb9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f809b850 con 0x7fc5f809ba70 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5f7fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc5f809c380 0x7fc5f806dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:59434/0 (socket says 172.21.15.97:59434) 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5f7fff640 1 -- 172.21.15.97:0/3861973182 learned_addr learned my addr 172.21.15.97:0/3861973182 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5fc939640 1 --2- 172.21.15.97:0/3861973182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5f809ba70 0x7fc5f809be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5fd13a640 1 --2- 172.21.15.97:0/3861973182 >> v2:172.21.15.97:3300/0 conn(0x7fc5f806e4b0 0x7fc5f806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5f77fe640 1 -- 172.21.15.97:0/3861973182 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944017057 0 0) 0x7fc5f806cc20 con 0x7fc5f809c380 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5f77fe640 1 -- 172.21.15.97:0/3861973182 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e80034e0 con 0x7fc5f809c380 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5fc939640 1 -- 172.21.15.97:0/3861973182 >> v2:172.21.15.97:3300/0 conn(0x7fc5f806e4b0 msgr2=0x7fc5f806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5fc939640 1 --2- 172.21.15.97:0/3861973182 >> v2:172.21.15.97:3300/0 conn(0x7fc5f806e4b0 0x7fc5f806e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5fc939640 1 -- 172.21.15.97:0/3861973182 >> v1:172.21.15.97:6789/0 conn(0x7fc5f809c380 legacy=0x7fc5f806dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.997+0000 7fc5fc939640 1 -- 172.21.15.97:0/3861973182 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f809d320 con 0x7fc5f809ba70 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.998+0000 7fc5fc939640 1 --2- 172.21.15.97:0/3861973182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5f809ba70 0x7fc5f809be40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009850 tx=0x7fc5ec0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f68f2dd689dbd28c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:52.003 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.998+0000 7fc5f77fe640 1 -- 172.21.15.97:0/3861973182 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec02ac80 con 0x7fc5f809ba70 2024-09-13T18:38:52.004 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.998+0000 7fc5f77fe640 1 -- 172.21.15.97:0/3861973182 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec02ade0 con 0x7fc5f809ba70 2024-09-13T18:38:52.004 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.998+0000 7fc5f77fe640 1 -- 172.21.15.97:0/3861973182 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec032670 con 0x7fc5f809ba70 2024-09-13T18:38:52.004 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.999+0000 7fc5feb9d640 1 -- 172.21.15.97:0/3861973182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5f809ba70 msgr2=0x7fc5f809be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:52.004 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.999+0000 7fc5feb9d640 1 --2- 172.21.15.97:0/3861973182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5f809ba70 0x7fc5f809be40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009850 tx=0x7fc5ec0090f0 comp rx=0 tx=0).stop 2024-09-13T18:38:52.004 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.999+0000 7fc5feb9d640 1 -- 172.21.15.97:0/3861973182 shutdown_connections 2024-09-13T18:38:52.004 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.999+0000 7fc5feb9d640 1 --2- 172.21.15.97:0/3861973182 >> v2:172.21.15.97:3300/0 conn(0x7fc5f806e4b0 0x7fc5f806e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:52.004 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.999+0000 7fc5feb9d640 1 --2- 172.21.15.97:0/3861973182 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5f809ba70 0x7fc5f809be40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:52.004 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.999+0000 7fc5feb9d640 1 -- 172.21.15.97:0/3861973182 >> 172.21.15.97:0/3861973182 conn(0x7fc5f80638e0 msgr2=0x7fc5f80a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:52.004 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.999+0000 7fc5feb9d640 1 -- 172.21.15.97:0/3861973182 shutdown_connections 2024-09-13T18:38:52.004 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:51.999+0000 7fc5feb9d640 1 -- 172.21.15.97:0/3861973182 wait complete. 2024-09-13T18:38:52.004 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.000+0000 7fc5feb9d640 1 Processor -- start 2024-09-13T18:38:52.005 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.000+0000 7fc5feb9d640 1 -- start start 2024-09-13T18:38:52.006 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.000+0000 7fc5feb9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5f806e4b0 0x7fc5f812d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:52.006 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.000+0000 7fc5feb9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc5f809ba70 0x7fc5f8068090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.000+0000 7fc5feb9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5f809c380 0x7fc5f80685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.000+0000 7fc5feb9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f809dff0 con 0x7fc5f806e4b0 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.000+0000 7fc5feb9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f806c040 con 0x7fc5f809c380 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.000+0000 7fc5feb9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f811ee70 con 0x7fc5f809ba70 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.000+0000 7fc5fc939640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5f806e4b0 0x7fc5f812d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.000+0000 7fc5fd13a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5f809c380 0x7fc5f80685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.000+0000 7fc5f7fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc5f809ba70 0x7fc5f8068090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.000+0000 7fc5fd13a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5f809c380 0x7fc5f80685d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:48578/0 (socket says 172.21.15.97:48578) 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5fd13a640 1 -- 172.21.15.97:0/2538388279 learned_addr learned my addr 172.21.15.97:0/2538388279 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5fc939640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5f806e4b0 0x7fc5f812d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49292/0 (socket says 172.21.15.97:49292) 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5fc939640 1 -- 172.21.15.97:0/2538388279 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc5f809ba70 msgr2=0x7fc5f8068090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5fc939640 1 --2- 172.21.15.97:0/2538388279 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc5f809ba70 0x7fc5f8068090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5fc939640 1 -- 172.21.15.97:0/2538388279 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5f809c380 msgr2=0x7fc5f80685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:52.007 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5fc939640 1 --2- 172.21.15.97:0/2538388279 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5f809c380 0x7fc5f80685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:52.008 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5fc939640 1 -- 172.21.15.97:0/2538388279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec009390 con 0x7fc5f806e4b0 2024-09-13T18:38:52.008 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5fd13a640 1 --2- 172.21.15.97:0/2538388279 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5f809c380 0x7fc5f80685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:52.008 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5f7fff640 1 --2- 172.21.15.97:0/2538388279 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc5f809ba70 0x7fc5f8068090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:52.008 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5fc939640 1 --2- 172.21.15.97:0/2538388279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5f806e4b0 0x7fc5f812d960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec031000 tx=0x7fc5ec032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:52.008 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5f4ff9640 1 -- 172.21.15.97:0/2538388279 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec03d630 con 0x7fc5f806e4b0 2024-09-13T18:38:52.008 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5f4ff9640 1 -- 172.21.15.97:0/2538388279 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec03d7d0 con 0x7fc5f806e4b0 2024-09-13T18:38:52.008 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5f4ff9640 1 -- 172.21.15.97:0/2538388279 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec03db90 con 0x7fc5f806e4b0 2024-09-13T18:38:52.008 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5feb9d640 1 -- 172.21.15.97:0/2538388279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f8069470 con 0x7fc5f806e4b0 2024-09-13T18:38:52.008 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5feb9d640 1 -- 172.21.15.97:0/2538388279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f8069c00 con 0x7fc5f806e4b0 2024-09-13T18:38:52.008 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5f4ff9640 1 -- 172.21.15.97:0/2538388279 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fc5ec039040 con 0x7fc5f806e4b0 2024-09-13T18:38:52.008 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.001+0000 7fc5f4ff9640 1 -- 172.21.15.97:0/2538388279 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fc5ec03b900 con 0x7fc5f806e4b0 2024-09-13T18:38:52.008 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.002+0000 7fc5feb9d640 1 -- 172.21.15.97:0/2538388279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f8063ff0 con 0x7fc5f806e4b0 2024-09-13T18:38:52.008 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.004+0000 7fc5f4ff9640 1 -- 172.21.15.97:0/2538388279 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fc5ec037070 con 0x7fc5f806e4b0 2024-09-13T18:38:52.049 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:52.046+0000 7f777c3c3ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:38:52.064 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.061+0000 7fc5feb9d640 1 -- 172.21.15.97:0/2538388279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5f806c960 con 0x7fc5f806e4b0 2024-09-13T18:38:52.064 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.062+0000 7fc5f4ff9640 1 -- 172.21.15.97:0/2538388279 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7fc5ec046820 con 0x7fc5f806e4b0 2024-09-13T18:38:52.064 INFO:teuthology.misc.health.smithi097.stdout: 2024-09-13T18:38:52.064 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":6,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:38:51.275686+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:52.065 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.063+0000 7fc5feb9d640 1 -- 172.21.15.97:0/2538388279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5f806e4b0 msgr2=0x7fc5f812d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:52.066 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.063+0000 7fc5feb9d640 1 --2- 172.21.15.97:0/2538388279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5f806e4b0 0x7fc5f812d960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec031000 tx=0x7fc5ec032000 comp rx=0 tx=0).stop 2024-09-13T18:38:52.066 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.063+0000 7fc5feb9d640 1 -- 172.21.15.97:0/2538388279 shutdown_connections 2024-09-13T18:38:52.066 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.063+0000 7fc5feb9d640 1 --2- 172.21.15.97:0/2538388279 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc5f809c380 0x7fc5f80685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:52.066 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.063+0000 7fc5feb9d640 1 --2- 172.21.15.97:0/2538388279 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc5f809ba70 0x7fc5f8068090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:52.066 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.063+0000 7fc5feb9d640 1 --2- 172.21.15.97:0/2538388279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5f806e4b0 0x7fc5f812d960 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:52.066 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.063+0000 7fc5feb9d640 1 -- 172.21.15.97:0/2538388279 >> 172.21.15.97:0/2538388279 conn(0x7fc5f80638e0 msgr2=0x7fc5f809f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:52.066 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.063+0000 7fc5feb9d640 1 -- 172.21.15.97:0/2538388279 shutdown_connections 2024-09-13T18:38:52.066 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:52.063+0000 7fc5feb9d640 1 -- 172.21.15.97:0/2538388279 wait complete. 2024-09-13T18:38:52.074 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T18:38:52.132 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:52.129+0000 7f777c3c3ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:38:52.208 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:52.206+0000 7f777c3c3ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:38:52.253 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:52.251+0000 7f777c3c3ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:38:52.332 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:52.330+0000 7f777c3c3ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:38:52.385 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:52.383+0000 7f777c3c3ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:38:52.428 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:52.425+0000 7f777c3c3ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:38:52.509 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:52.506+0000 7f777c3c3ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:38:52.556 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:52.553+0000 7f777c3c3ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:38:52.606 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:52.603+0000 7f777c3c3ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:38:52.670 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:52.668+0000 7f777c3c3ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:38:52.712 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:52.710+0000 7f777c3c3ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:38:52.756 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:52.753+0000 7f777c3c3ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:38:53.340 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:53.337+0000 7f777c3c3ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:38:54.353 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:54.351+0000 7f7762664640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T18:38:54.353 INFO:tasks.ceph.mgr.x.smithi097.stderr:2024-09-13T18:38:54.351+0000 7f7762664640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T18:38:55.377 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-09-13T18:38:55.375+0000 7f2706d21440 -1 osd.3 0 log_to_monitors true 2024-09-13T18:38:55.425 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-09-13T18:38:55.422+0000 7f732ad21440 -1 osd.1 0 log_to_monitors true 2024-09-13T18:38:55.448 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-09-13T18:38:55.446+0000 7f4763610440 -1 osd.2 0 log_to_monitors true 2024-09-13T18:38:55.453 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-09-13T18:38:55.450+0000 7f7971d51440 -1 osd.0 0 log_to_monitors true 2024-09-13T18:38:58.478 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:58.575 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.573+0000 7f1f404c9640 1 Processor -- start 2024-09-13T18:38:58.575 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.573+0000 7f1f404c9640 1 -- start start 2024-09-13T18:38:58.578 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.573+0000 7f1f404c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1f3809ba90 0x7f1f3809be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:58.578 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.573+0000 7f1f404c9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1f3806e500 0x7f1f3806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:58.579 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.573+0000 7f1f404c9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3809cba0 con 0x7f1f3809c3a0 2024-09-13T18:38:58.579 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.573+0000 7f1f404c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3806d310 con 0x7f1f3809ba90 2024-09-13T18:38:58.579 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.573+0000 7f1f404c9640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3809d370 con 0x7f1f3806e500 2024-09-13T18:38:58.579 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.573+0000 7f1f3e265640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1f3809ba90 0x7f1f3809be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:58.579 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.573+0000 7f1f3ea66640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1f3806e500 0x7f1f3806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:58.579 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.574+0000 7f1f3da64640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1f3809c3a0 0x7f1f3806ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57632/0 (socket says 172.21.15.97:57632) 2024-09-13T18:38:58.579 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.574+0000 7f1f3e265640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1f3809ba90 0x7f1f3809be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60698/0 (socket says 172.21.15.97:60698) 2024-09-13T18:38:58.579 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.574+0000 7f1f3da64640 1 -- 172.21.15.97:0/4279176854 learned_addr learned my addr 172.21.15.97:0/4279176854 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:38:58.579 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.574+0000 7f1f3e265640 1 -- 172.21.15.97:0/4279176854 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1f3806e500 msgr2=0x7f1f3806e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:58.579 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.574+0000 7f1f3e265640 1 --2- 172.21.15.97:0/4279176854 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1f3806e500 0x7f1f3806e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.579 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.574+0000 7f1f3e265640 1 -- 172.21.15.97:0/4279176854 >> v1:172.21.15.97:6789/0 conn(0x7f1f3809c3a0 legacy=0x7f1f3806ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:58.579 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.574+0000 7f1f3e265640 1 -- 172.21.15.97:0/4279176854 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3809b870 con 0x7f1f3809ba90 2024-09-13T18:38:58.579 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.574+0000 7f1f3ea66640 1 --2- 172.21.15.97:0/4279176854 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1f3806e500 0x7f1f3806e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:58.580 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.574+0000 7f1f3e265640 1 --2- 172.21.15.97:0/4279176854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3809ba90 0x7f1f3809be60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009850 tx=0x7f1f340090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192fbc79353f031c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:58.580 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.575+0000 7f1f3d263640 1 -- 172.21.15.97:0/4279176854 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3402ac80 con 0x7f1f3809ba90 2024-09-13T18:38:58.580 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.575+0000 7f1f3d263640 1 -- 172.21.15.97:0/4279176854 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3402ade0 con 0x7f1f3809ba90 2024-09-13T18:38:58.580 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.575+0000 7f1f3d263640 1 -- 172.21.15.97:0/4279176854 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34032670 con 0x7f1f3809ba90 2024-09-13T18:38:58.580 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.575+0000 7f1f404c9640 1 -- 172.21.15.97:0/4279176854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3809ba90 msgr2=0x7f1f3809be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:58.580 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.575+0000 7f1f404c9640 1 --2- 172.21.15.97:0/4279176854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3809ba90 0x7f1f3809be60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009850 tx=0x7f1f340090f0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.580 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.575+0000 7f1f404c9640 1 -- 172.21.15.97:0/4279176854 shutdown_connections 2024-09-13T18:38:58.580 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.575+0000 7f1f404c9640 1 --2- 172.21.15.97:0/4279176854 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1f3806e500 0x7f1f3806e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.580 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.575+0000 7f1f404c9640 1 --2- 172.21.15.97:0/4279176854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3809ba90 0x7f1f3809be60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.581 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.575+0000 7f1f404c9640 1 -- 172.21.15.97:0/4279176854 >> 172.21.15.97:0/4279176854 conn(0x7f1f380638e0 msgr2=0x7f1f380a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:58.581 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.575+0000 7f1f404c9640 1 -- 172.21.15.97:0/4279176854 shutdown_connections 2024-09-13T18:38:58.581 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.575+0000 7f1f404c9640 1 -- 172.21.15.97:0/4279176854 wait complete. 2024-09-13T18:38:58.581 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.576+0000 7f1f404c9640 1 Processor -- start 2024-09-13T18:38:58.581 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.576+0000 7f1f404c9640 1 -- start start 2024-09-13T18:38:58.583 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.576+0000 7f1f404c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3806e500 0x7f1f3813ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:58.583 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.576+0000 7f1f404c9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1f3809ba90 0x7f1f3813cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:58.583 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f404c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3809c3a0 0x7f1f3813d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:58.583 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f404c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3811cf80 con 0x7f1f3806e500 2024-09-13T18:38:58.583 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f404c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3811ca20 con 0x7f1f3809c3a0 2024-09-13T18:38:58.583 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f404c9640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3809dfa0 con 0x7f1f3809ba90 2024-09-13T18:38:58.583 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f3e265640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3806e500 0x7f1f3813ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:58.583 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f3da64640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1f3809ba90 0x7f1f3813cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:58.584 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f3e265640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3806e500 0x7f1f3813ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60702/0 (socket says 172.21.15.97:60702) 2024-09-13T18:38:58.584 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f3e265640 1 -- 172.21.15.97:0/3068614105 learned_addr learned my addr 172.21.15.97:0/3068614105 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:38:58.584 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f3ea66640 1 --2- 172.21.15.97:0/3068614105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3809c3a0 0x7f1f3813d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:58.584 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f3e265640 1 -- 172.21.15.97:0/3068614105 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1f3809ba90 msgr2=0x7f1f3813cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:58.584 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f3e265640 1 --2- 172.21.15.97:0/3068614105 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1f3809ba90 0x7f1f3813cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.584 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f3e265640 1 -- 172.21.15.97:0/3068614105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3809c3a0 msgr2=0x7f1f3813d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:58.584 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f3e265640 1 --2- 172.21.15.97:0/3068614105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3809c3a0 0x7f1f3813d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.584 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f3e265640 1 -- 172.21.15.97:0/3068614105 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f30009a20 con 0x7f1f3806e500 2024-09-13T18:38:58.584 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f3e265640 1 --2- 172.21.15.97:0/3068614105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3806e500 0x7f1f3813ca50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1f3402a5b0 tx=0x7f1f34032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:58.584 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f2e7fc640 1 -- 172.21.15.97:0/3068614105 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3403d720 con 0x7f1f3806e500 2024-09-13T18:38:58.584 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f2e7fc640 1 -- 172.21.15.97:0/3068614105 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3403d880 con 0x7f1f3806e500 2024-09-13T18:38:58.584 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f404c9640 1 -- 172.21.15.97:0/3068614105 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f34009390 con 0x7f1f3806e500 2024-09-13T18:38:58.585 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f2e7fc640 1 -- 172.21.15.97:0/3068614105 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3403dc20 con 0x7f1f3806e500 2024-09-13T18:38:58.585 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.577+0000 7f1f404c9640 1 -- 172.21.15.97:0/3068614105 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3811d9b0 con 0x7f1f3806e500 2024-09-13T18:38:58.585 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.578+0000 7f1f2e7fc640 1 -- 172.21.15.97:0/3068614105 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 4) v1 ==== 36590+0+0 (secure 0 0 0) 0x7f1f34039040 con 0x7f1f3806e500 2024-09-13T18:38:58.585 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.578+0000 7f1f2e7fc640 1 -- 172.21.15.97:0/3068614105 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1509+0+0 (secure 0 0 0) 0x7f1f34061210 con 0x7f1f3806e500 2024-09-13T18:38:58.585 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.578+0000 7f1f404c9640 1 -- 172.21.15.97:0/3068614105 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3811d0c0 con 0x7f1f3806e500 2024-09-13T18:38:58.585 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.583+0000 7f1f2e7fc640 1 -- 172.21.15.97:0/3068614105 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f1f3811d0c0 con 0x7f1f3806e500 2024-09-13T18:38:58.773 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.770+0000 7f1f404c9640 1 -- 172.21.15.97:0/3068614105 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f3811d0c0 con 0x7f1f3806e500 2024-09-13T18:38:58.774 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.771+0000 7f1f2e7fc640 1 -- 172.21.15.97:0/3068614105 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+4108 (secure 0 0 0) 0x7f1f3811d0c0 con 0x7f1f3806e500 2024-09-13T18:38:58.774 INFO:teuthology.misc.health.smithi097.stdout: 2024-09-13T18:38:58.774 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":8,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:38:57.351660+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:58.776 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.773+0000 7f1f404c9640 1 -- 172.21.15.97:0/3068614105 >> v1:172.21.15.97:6816/34603 conn(0x7f1f1c0310d0 legacy=0x7f1f1c033580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:58.776 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.773+0000 7f1f404c9640 1 -- 172.21.15.97:0/3068614105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3806e500 msgr2=0x7f1f3813ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:58.776 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.773+0000 7f1f404c9640 1 --2- 172.21.15.97:0/3068614105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3806e500 0x7f1f3813ca50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1f3402a5b0 tx=0x7f1f34032000 comp rx=0 tx=0).stop 2024-09-13T18:38:58.776 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.773+0000 7f1f404c9640 1 -- 172.21.15.97:0/3068614105 shutdown_connections 2024-09-13T18:38:58.776 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.773+0000 7f1f404c9640 1 --2- 172.21.15.97:0/3068614105 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1f3809c3a0 0x7f1f3813d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.776 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.773+0000 7f1f404c9640 1 --2- 172.21.15.97:0/3068614105 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1f3809ba90 0x7f1f3813cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.776 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.773+0000 7f1f404c9640 1 --2- 172.21.15.97:0/3068614105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f3806e500 0x7f1f3813ca50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.776 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.773+0000 7f1f404c9640 1 -- 172.21.15.97:0/3068614105 >> 172.21.15.97:0/3068614105 conn(0x7f1f380638e0 msgr2=0x7f1f3809f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:58.776 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.773+0000 7f1f404c9640 1 -- 172.21.15.97:0/3068614105 shutdown_connections 2024-09-13T18:38:58.777 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:38:58.773+0000 7f1f404c9640 1 -- 172.21.15.97:0/3068614105 wait complete. 2024-09-13T18:38:58.785 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T18:38:59.421 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-09-13T18:38:59.418+0000 7f73257f6640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T18:38:59.425 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-09-13T18:38:59.423+0000 7f731e7e8640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:38:59.485 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-09-13T18:38:59.482+0000 7f796c7f6640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T18:38:59.492 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-09-13T18:38:59.490+0000 7f79657e8640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:38:59.495 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-09-13T18:38:59.492+0000 7f475ddf6640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T18:38:59.497 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-09-13T18:38:59.495+0000 7f4756de8640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:38:59.512 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-09-13T18:38:59.509+0000 7f27017f6640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T18:38:59.516 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-09-13T18:38:59.513+0000 7f26fa7e8640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:39:05.189 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:05.286 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.282+0000 7fedc70f8640 1 Processor -- start 2024-09-13T18:39:05.286 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.282+0000 7fedc70f8640 1 -- start start 2024-09-13T18:39:05.286 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedc70f8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fedc0132860 0x7fedc0134c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.286 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedc70f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedc0135180 0x7fedc0137560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.287 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedc70f8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc006f270 con 0x7fedc009bb80 2024-09-13T18:39:05.287 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedc70f8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc009d000 con 0x7fedc0132860 2024-09-13T18:39:05.287 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedc70f8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc009b980 con 0x7fedc0135180 2024-09-13T18:39:05.287 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedbffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fedc0132860 0x7fedc0134c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.287 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedc5695640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedc0135180 0x7fedc0137560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.287 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedbffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fedc0132860 0x7fedc0134c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60748/0 (socket says 172.21.15.97:60748) 2024-09-13T18:39:05.287 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedc5695640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedc0135180 0x7fedc0137560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:46970/0 (socket says 172.21.15.97:46970) 2024-09-13T18:39:05.287 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedbffff640 1 -- 172.21.15.97:0/737635907 learned_addr learned my addr 172.21.15.97:0/737635907 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:05.287 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedbffff640 1 -- 172.21.15.97:0/737635907 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedc0135180 msgr2=0x7fedc0137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:05.287 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedbffff640 1 --2- 172.21.15.97:0/737635907 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedc0135180 0x7fedc0137560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.287 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedbffff640 1 -- 172.21.15.97:0/737635907 >> v1:172.21.15.97:6789/0 conn(0x7fedc009bb80 legacy=0x7fedc009bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.287 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedbffff640 1 -- 172.21.15.97:0/737635907 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc0068190 con 0x7fedc0132860 2024-09-13T18:39:05.288 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedbf7fe640 1 -- 172.21.15.97:0/737635907 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814497688 0 0) 0x7fedc006f270 con 0x7fedc009bb80 2024-09-13T18:39:05.288 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.283+0000 7fedc5695640 1 --2- 172.21.15.97:0/737635907 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedc0135180 0x7fedc0137560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:05.291 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.284+0000 7fedbffff640 1 --2- 172.21.15.97:0/737635907 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedc0132860 0x7fedc0134c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fedac009910 tx=0x7fedac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d6553fe995c118 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:05.291 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.284+0000 7fedbf7fe640 1 -- 172.21.15.97:0/737635907 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac02ad20 con 0x7fedc0132860 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.284+0000 7fedbf7fe640 1 -- 172.21.15.97:0/737635907 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac02ae80 con 0x7fedc0132860 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.284+0000 7fedbf7fe640 1 -- 172.21.15.97:0/737635907 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac032670 con 0x7fedc0132860 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.285+0000 7fedc70f8640 1 -- 172.21.15.97:0/737635907 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedc0132860 msgr2=0x7fedc0134c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.285+0000 7fedc70f8640 1 --2- 172.21.15.97:0/737635907 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedc0132860 0x7fedc0134c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fedac009910 tx=0x7fedac0091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.285+0000 7fedc70f8640 1 -- 172.21.15.97:0/737635907 shutdown_connections 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.285+0000 7fedc70f8640 1 --2- 172.21.15.97:0/737635907 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedc0135180 0x7fedc0137560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.285+0000 7fedc70f8640 1 --2- 172.21.15.97:0/737635907 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedc0132860 0x7fedc0134c40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.285+0000 7fedc70f8640 1 -- 172.21.15.97:0/737635907 >> 172.21.15.97:0/737635907 conn(0x7fedc00638e0 msgr2=0x7fedc00a0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.285+0000 7fedc70f8640 1 -- 172.21.15.97:0/737635907 shutdown_connections 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.285+0000 7fedc70f8640 1 -- 172.21.15.97:0/737635907 wait complete. 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.286+0000 7fedc70f8640 1 Processor -- start 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.286+0000 7fedc70f8640 1 -- start start 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.286+0000 7fedc70f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedc009bb80 0x7fedc012fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.292 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.286+0000 7fedc70f8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fedc0132860 0x7fedc0119df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.286+0000 7fedc70f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedc0135180 0x7fedc011a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.286+0000 7fedc70f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc011b2b0 con 0x7fedc0135180 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.286+0000 7fedc70f8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc011c330 con 0x7fedc009bb80 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.286+0000 7fedc70f8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedc011d240 con 0x7fedc0132860 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.286+0000 7fedc5695640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedc0135180 0x7fedc011a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.286+0000 7fedc4e94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedc009bb80 0x7fedc012fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.286+0000 7fedbffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fedc0132860 0x7fedc0119df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedc4e94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedc009bb80 0x7fedc012fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:46980/0 (socket says 172.21.15.97:46980) 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedbffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fedc0132860 0x7fedc0119df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:32868/0 (socket says 172.21.15.97:32868) 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedc4e94640 1 -- 172.21.15.97:0/796528899 learned_addr learned my addr 172.21.15.97:0/796528899 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedbffff640 1 -- 172.21.15.97:0/796528899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedc009bb80 msgr2=0x7fedc012fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedbffff640 1 --2- 172.21.15.97:0/796528899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedc009bb80 0x7fedc012fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedbffff640 1 -- 172.21.15.97:0/796528899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedc0135180 msgr2=0x7fedc011a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.293 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedbffff640 1 --2- 172.21.15.97:0/796528899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedc0135180 0x7fedc011a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.294 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedbffff640 1 -- 172.21.15.97:0/796528899 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb8009a20 con 0x7fedc0132860 2024-09-13T18:39:05.294 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedc5695640 1 --2- 172.21.15.97:0/796528899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedc0135180 0x7fedc011a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:05.294 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedbffff640 1 --2- 172.21.15.97:0/796528899 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fedc0132860 0x7fedc0119df0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fedac031000 tx=0x7fedac032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:05.294 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedbcff9640 1 -- 172.21.15.97:0/796528899 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac031630 con 0x7fedc0132860 2024-09-13T18:39:05.294 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedbcff9640 1 -- 172.21.15.97:0/796528899 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac0317d0 con 0x7fedc0132860 2024-09-13T18:39:05.294 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedc70f8640 1 -- 172.21.15.97:0/796528899 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac009450 con 0x7fedc0132860 2024-09-13T18:39:05.294 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedbcff9640 1 -- 172.21.15.97:0/796528899 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac031b90 con 0x7fedc0132860 2024-09-13T18:39:05.294 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.287+0000 7fedc70f8640 1 -- 172.21.15.97:0/796528899 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc011df30 con 0x7fedc0132860 2024-09-13T18:39:05.294 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.288+0000 7fedbcff9640 1 -- 172.21.15.97:0/796528899 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 4) v1 ==== 36590+0+0 (secure 0 0 0) 0x7fedac039050 con 0x7fedc0132860 2024-09-13T18:39:05.294 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.288+0000 7fedbcff9640 1 -- 172.21.15.97:0/796528899 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2455+0+0 (secure 0 0 0) 0x7fedac061e30 con 0x7fedc0132860 2024-09-13T18:39:05.294 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.288+0000 7fedc70f8640 1 -- 172.21.15.97:0/796528899 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc0066270 con 0x7fedc0132860 2024-09-13T18:39:05.295 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.293+0000 7fedbcff9640 1 -- 172.21.15.97:0/796528899 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fedac040080 con 0x7fedc0132860 2024-09-13T18:39:05.449 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.446+0000 7fedc70f8640 1 -- 172.21.15.97:0/796528899 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedc0067740 con 0x7fedc0132860 2024-09-13T18:39:05.449 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.447+0000 7fedbcff9640 1 -- 172.21.15.97:0/796528899 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+6543 (secure 0 0 0) 0x7fedac053090 con 0x7fedc0132860 2024-09-13T18:39:05.450 INFO:teuthology.misc.health.smithi097.stdout: 2024-09-13T18:39:05.450 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":12,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:03.490355+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:05.452 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.449+0000 7fedc70f8640 1 -- 172.21.15.97:0/796528899 >> v1:172.21.15.97:6816/34603 conn(0x7feda40310d0 legacy=0x7feda4033580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.452 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.449+0000 7fedc70f8640 1 -- 172.21.15.97:0/796528899 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fedc0132860 msgr2=0x7fedc0119df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.452 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.449+0000 7fedc70f8640 1 --2- 172.21.15.97:0/796528899 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fedc0132860 0x7fedc0119df0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fedac031000 tx=0x7fedac032000 comp rx=0 tx=0).stop 2024-09-13T18:39:05.452 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.449+0000 7fedc70f8640 1 -- 172.21.15.97:0/796528899 shutdown_connections 2024-09-13T18:39:05.452 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.449+0000 7fedc70f8640 1 --2- 172.21.15.97:0/796528899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedc0135180 0x7fedc011a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.452 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.449+0000 7fedc70f8640 1 --2- 172.21.15.97:0/796528899 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fedc0132860 0x7fedc0119df0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.452 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.449+0000 7fedc70f8640 1 --2- 172.21.15.97:0/796528899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedc009bb80 0x7fedc012fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.453 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.449+0000 7fedc70f8640 1 -- 172.21.15.97:0/796528899 >> 172.21.15.97:0/796528899 conn(0x7fedc00638e0 msgr2=0x7fedc009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:05.453 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.449+0000 7fedc70f8640 1 -- 172.21.15.97:0/796528899 shutdown_connections 2024-09-13T18:39:05.453 INFO:teuthology.misc.health.smithi097.stderr:2024-09-13T18:39:05.449+0000 7fedc70f8640 1 -- 172.21.15.97:0/796528899 wait complete. 2024-09-13T18:39:05.461 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-13T18:39:05.461 INFO:tasks.ceph:Creating RBD pool 2024-09-13T18:39:05.461 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-13T18:39:05.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.553+0000 7fb894cc0640 1 Processor -- start 2024-09-13T18:39:05.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.553+0000 7fb894cc0640 1 -- start start 2024-09-13T18:39:05.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb894cc0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb89009f500 0x7fb8901347e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb894cc0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb890134d20 0x7fb890137100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb894cc0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb890068ee0 con 0x7fb8900699a0 2024-09-13T18:39:05.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb894cc0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb890069d70 con 0x7fb89009f500 2024-09-13T18:39:05.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb894cc0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900684a0 con 0x7fb890134d20 2024-09-13T18:39:05.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb88dd9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb89009f500 0x7fb8901347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb88ed9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb890134d20 0x7fb890137100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb88dd9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb89009f500 0x7fb8901347e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60760/0 (socket says 172.21.15.97:60760) 2024-09-13T18:39:05.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb88dd9b640 1 -- 172.21.15.97:0/217510586 learned_addr learned my addr 172.21.15.97:0/217510586 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:05.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb88dd9b640 1 -- 172.21.15.97:0/217510586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb890134d20 msgr2=0x7fb890137100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:05.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb88dd9b640 1 --2- 172.21.15.97:0/217510586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb890134d20 0x7fb890137100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb88dd9b640 1 -- 172.21.15.97:0/217510586 >> v1:172.21.15.97:6789/0 conn(0x7fb8900699a0 legacy=0x7fb89009edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb88dd9b640 1 -- 172.21.15.97:0/217510586 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89006a060 con 0x7fb89009f500 2024-09-13T18:39:05.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb88d59a640 1 -- 172.21.15.97:0/217510586 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475982638 0 0) 0x7fb890068ee0 con 0x7fb8900699a0 2024-09-13T18:39:05.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.554+0000 7fb88ed9d640 1 --2- 172.21.15.97:0/217510586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb890134d20 0x7fb890137100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:05.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.555+0000 7fb88dd9b640 1 --2- 172.21.15.97:0/217510586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89009f500 0x7fb8901347e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb884009910 tx=0x7fb8840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4898b59b2146e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:05.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.555+0000 7fb88d59a640 1 -- 172.21.15.97:0/217510586 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88402add0 con 0x7fb89009f500 2024-09-13T18:39:05.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.555+0000 7fb88d59a640 1 -- 172.21.15.97:0/217510586 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb884032440 con 0x7fb89009f500 2024-09-13T18:39:05.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.555+0000 7fb88d59a640 1 -- 172.21.15.97:0/217510586 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8840327e0 con 0x7fb89009f500 2024-09-13T18:39:05.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.555+0000 7fb894cc0640 1 -- 172.21.15.97:0/217510586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89009f500 msgr2=0x7fb8901347e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.555+0000 7fb894cc0640 1 --2- 172.21.15.97:0/217510586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89009f500 0x7fb8901347e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb884009910 tx=0x7fb8840091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.555+0000 7fb894cc0640 1 -- 172.21.15.97:0/217510586 shutdown_connections 2024-09-13T18:39:05.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.555+0000 7fb894cc0640 1 --2- 172.21.15.97:0/217510586 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb890134d20 0x7fb890137100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.555+0000 7fb894cc0640 1 --2- 172.21.15.97:0/217510586 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89009f500 0x7fb8901347e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.555+0000 7fb894cc0640 1 -- 172.21.15.97:0/217510586 >> 172.21.15.97:0/217510586 conn(0x7fb890067b70 msgr2=0x7fb8900a0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:05.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.556+0000 7fb894cc0640 1 -- 172.21.15.97:0/217510586 shutdown_connections 2024-09-13T18:39:05.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.556+0000 7fb894cc0640 1 -- 172.21.15.97:0/217510586 wait complete. 2024-09-13T18:39:05.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.556+0000 7fb894cc0640 1 Processor -- start 2024-09-13T18:39:05.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.556+0000 7fb894cc0640 1 -- start start 2024-09-13T18:39:05.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb894cc0640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb8900699a0 0x7fb89011af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb894cc0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89009f500 0x7fb890117260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb894cc0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb890134d20 0x7fb8901177a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb894cc0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb890134aa0 con 0x7fb89009f500 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb894cc0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89011a100 con 0x7fb890134d20 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb894cc0640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb890119300 con 0x7fb8900699a0 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb88dd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89009f500 0x7fb890117260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb88ed9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb890134d20 0x7fb8901177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb88e59c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb8900699a0 0x7fb89011af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb88dd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89009f500 0x7fb890117260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60762/0 (socket says 172.21.15.97:60762) 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb88dd9b640 1 -- 172.21.15.97:0/4040981301 learned_addr learned my addr 172.21.15.97:0/4040981301 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb88dd9b640 1 -- 172.21.15.97:0/4040981301 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb8900699a0 msgr2=0x7fb89011af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb88dd9b640 1 --2- 172.21.15.97:0/4040981301 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb8900699a0 0x7fb89011af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb88dd9b640 1 -- 172.21.15.97:0/4040981301 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb890134d20 msgr2=0x7fb8901177a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb88dd9b640 1 --2- 172.21.15.97:0/4040981301 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb890134d20 0x7fb8901177a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:05.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb88dd9b640 1 -- 172.21.15.97:0/4040981301 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb888009390 con 0x7fb89009f500 2024-09-13T18:39:05.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb88ed9d640 1 --2- 172.21.15.97:0/4040981301 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb890134d20 0x7fb8901177a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:05.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb88dd9b640 1 --2- 172.21.15.97:0/4040981301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89009f500 0x7fb890117260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb88402a700 tx=0x7fb884032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:05.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb87e7fc640 1 -- 172.21.15.97:0/4040981301 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884006b30 con 0x7fb89009f500 2024-09-13T18:39:05.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb87e7fc640 1 -- 172.21.15.97:0/4040981301 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb884031de0 con 0x7fb89009f500 2024-09-13T18:39:05.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb87e7fc640 1 -- 172.21.15.97:0/4040981301 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88403d690 con 0x7fb89009f500 2024-09-13T18:39:05.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.557+0000 7fb894cc0640 1 -- 172.21.15.97:0/4040981301 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb884009450 con 0x7fb89009f500 2024-09-13T18:39:05.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.558+0000 7fb894cc0640 1 -- 172.21.15.97:0/4040981301 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb890117ce0 con 0x7fb89009f500 2024-09-13T18:39:05.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.558+0000 7fb87e7fc640 1 -- 172.21.15.97:0/4040981301 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fb884039040 con 0x7fb89009f500 2024-09-13T18:39:05.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.558+0000 7fb87e7fc640 1 -- 172.21.15.97:0/4040981301 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2455+0+0 (secure 0 0 0) 0x7fb884061ca0 con 0x7fb89009f500 2024-09-13T18:39:05.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.558+0000 7fb894cc0640 1 -- 172.21.15.97:0/4040981301 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89011a8f0 con 0x7fb89009f500 2024-09-13T18:39:05.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.563+0000 7fb87e7fc640 1 -- 172.21.15.97:0/4040981301 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fb89011a8f0 con 0x7fb89009f500 2024-09-13T18:39:05.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:05.714+0000 7fb894cc0640 1 -- 172.21.15.97:0/4040981301 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb89011a8f0 con 0x7fb89009f500 2024-09-13T18:39:06.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.514+0000 7fb87e7fc640 1 -- 172.21.15.97:0/4040981301 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb89011a8f0 con 0x7fb89009f500 2024-09-13T18:39:06.517 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'rbd' created 2024-09-13T18:39:06.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.516+0000 7fb894cc0640 1 -- 172.21.15.97:0/4040981301 >> v1:172.21.15.97:6816/34603 conn(0x7fb870031160 legacy=0x7fb870033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:06.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.516+0000 7fb894cc0640 1 -- 172.21.15.97:0/4040981301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89009f500 msgr2=0x7fb890117260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:06.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.516+0000 7fb894cc0640 1 --2- 172.21.15.97:0/4040981301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89009f500 0x7fb890117260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb88402a700 tx=0x7fb884032000 comp rx=0 tx=0).stop 2024-09-13T18:39:06.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.516+0000 7fb894cc0640 1 -- 172.21.15.97:0/4040981301 shutdown_connections 2024-09-13T18:39:06.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.516+0000 7fb894cc0640 1 --2- 172.21.15.97:0/4040981301 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb890134d20 0x7fb8901177a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:06.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.516+0000 7fb894cc0640 1 --2- 172.21.15.97:0/4040981301 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89009f500 0x7fb890117260 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:06.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.516+0000 7fb894cc0640 1 --2- 172.21.15.97:0/4040981301 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb8900699a0 0x7fb89011af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:06.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.516+0000 7fb894cc0640 1 -- 172.21.15.97:0/4040981301 >> 172.21.15.97:0/4040981301 conn(0x7fb890067b70 msgr2=0x7fb89012f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:06.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.516+0000 7fb894cc0640 1 -- 172.21.15.97:0/4040981301 shutdown_connections 2024-09-13T18:39:06.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.517+0000 7fb894cc0640 1 -- 172.21.15.97:0/4040981301 wait complete. 2024-09-13T18:39:06.534 DEBUG:teuthology.orchestra.run.smithi097:> rbd --cluster ceph pool init rbd 2024-09-13T18:39:06.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.690+0000 7f79f6e2eb80 1 Processor -- start 2024-09-13T18:39:06.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.690+0000 7f79f6e2eb80 1 -- start start 2024-09-13T18:39:06.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f6e2eb80 1 --2- >> v2:172.21.15.97:3300/0 conn(0x5591d9127b70 0x5591d912cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:06.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f6e2eb80 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x5591d912d2f0 0x5591d912f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:06.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f6e2eb80 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x5591d8fb90e0 con 0x5591d9094c60 2024-09-13T18:39:06.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f6e2eb80 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x5591d8ff2260 con 0x5591d9127b70 2024-09-13T18:39:06.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f6e2eb80 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x5591d8fedf40 con 0x5591d912d2f0 2024-09-13T18:39:06.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f4da3640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x5591d912d2f0 0x5591d912f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:06.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f3da1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x5591d9127b70 0x5591d912cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:06.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f4da3640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x5591d912d2f0 0x5591d912f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:32872/0 (socket says 172.21.15.97:32872) 2024-09-13T18:39:06.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f45a2640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x5591d9094c60 0x5591d9128190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:57676/0 (socket says 172.21.15.97:57676) 2024-09-13T18:39:06.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f4da3640 1 -- 172.21.15.97:0/2973631418 learned_addr learned my addr 172.21.15.97:0/2973631418 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:06.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f3da1640 1 -- 172.21.15.97:0/2973631418 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x5591d912d2f0 msgr2=0x5591d912f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:06.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f3da1640 1 --2- 172.21.15.97:0/2973631418 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x5591d912d2f0 0x5591d912f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:06.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f3da1640 1 -- 172.21.15.97:0/2973631418 >> v1:172.21.15.97:6789/0 conn(0x5591d9094c60 legacy=0x5591d9128190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:06.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f35a0640 1 -- 172.21.15.97:0/2973631418 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511771748 0 0) 0x5591d8fb90e0 con 0x5591d9094c60 2024-09-13T18:39:06.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.691+0000 7f79f3da1640 1 -- 172.21.15.97:0/2973631418 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591d8f92270 con 0x5591d9127b70 2024-09-13T18:39:06.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.692+0000 7f79f4da3640 1 --2- 172.21.15.97:0/2973631418 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x5591d912d2f0 0x5591d912f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:06.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.693+0000 7f79f3da1640 1 --2- 172.21.15.97:0/2973631418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5591d9127b70 0x5591d912cdb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f79e800a650 tx=0x7f79e8045cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574a21602a836788 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:06.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.693+0000 7f79f35a0640 1 -- 172.21.15.97:0/2973631418 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e804d4e0 con 0x5591d9127b70 2024-09-13T18:39:06.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.694+0000 7f79f35a0640 1 -- 172.21.15.97:0/2973631418 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e804d640 con 0x5591d9127b70 2024-09-13T18:39:06.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.694+0000 7f79f35a0640 1 -- 172.21.15.97:0/2973631418 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e804d7d0 con 0x5591d9127b70 2024-09-13T18:39:06.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.694+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/2973631418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5591d9127b70 msgr2=0x5591d912cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:06.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.694+0000 7f79f6e2eb80 1 --2- 172.21.15.97:0/2973631418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5591d9127b70 0x5591d912cdb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f79e800a650 tx=0x7f79e8045cd0 comp rx=0 tx=0).stop 2024-09-13T18:39:06.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.694+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/2973631418 shutdown_connections 2024-09-13T18:39:06.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.694+0000 7f79f6e2eb80 1 --2- 172.21.15.97:0/2973631418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5591d9127b70 0x5591d912cdb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:06.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.694+0000 7f79f6e2eb80 1 --2- 172.21.15.97:0/2973631418 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x5591d912d2f0 0x5591d912f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:06.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.694+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/2973631418 >> 172.21.15.97:0/2973631418 conn(0x5591d9096af0 msgr2=0x5591d9096ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:06.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.694+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/2973631418 shutdown_connections 2024-09-13T18:39:06.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.694+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/2973631418 wait complete. 2024-09-13T18:39:06.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.695+0000 7f79f6e2eb80 1 Processor -- start 2024-09-13T18:39:06.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.695+0000 7f79f6e2eb80 1 -- start start 2024-09-13T18:39:06.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.695+0000 7f79f6e2eb80 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5591d9094c60 0x5591d912ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:06.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.695+0000 7f79f6e2eb80 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5591d9127b70 0x5591d912b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:06.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.695+0000 7f79f6e2eb80 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x5591d912d2f0 0x5591d912b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:06.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f6e2eb80 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591d8fb0ba0 con 0x5591d9094c60 2024-09-13T18:39:06.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f6e2eb80 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591d8fb0840 con 0x5591d9127b70 2024-09-13T18:39:06.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f6e2eb80 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x5591d8f737a0 con 0x5591d912d2f0 2024-09-13T18:39:06.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f45a2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5591d9094c60 0x5591d912ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:06.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f4da3640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x5591d912d2f0 0x5591d912b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:06.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f4da3640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x5591d912d2f0 0x5591d912b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:32876/0 (socket says 172.21.15.97:32876) 2024-09-13T18:39:06.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f45a2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5591d9094c60 0x5591d912ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60770/0 (socket says 172.21.15.97:60770) 2024-09-13T18:39:06.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f4da3640 1 -- 172.21.15.97:0/1254896969 learned_addr learned my addr 172.21.15.97:0/1254896969 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:06.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f3da1640 1 --2- 172.21.15.97:0/1254896969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5591d9127b70 0x5591d912b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:06.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f45a2640 1 -- 172.21.15.97:0/1254896969 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x5591d912d2f0 msgr2=0x5591d912b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:06.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f45a2640 1 --2- 172.21.15.97:0/1254896969 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x5591d912d2f0 0x5591d912b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:06.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f45a2640 1 -- 172.21.15.97:0/1254896969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5591d9127b70 msgr2=0x5591d912b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:06.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f45a2640 1 --2- 172.21.15.97:0/1254896969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x5591d9127b70 0x5591d912b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:06.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f45a2640 1 -- 172.21.15.97:0/1254896969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec005db0 con 0x5591d9094c60 2024-09-13T18:39:06.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f45a2640 1 --2- 172.21.15.97:0/1254896969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5591d9094c60 0x5591d912ae70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f79e400dfd0 tx=0x7f79e40069e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:06.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4012070 con 0x5591d9094c60 2024-09-13T18:39:06.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e40060d0 con 0x5591d9094c60 2024-09-13T18:39:06.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400b450 con 0x5591d9094c60 2024-09-13T18:39:06.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.696+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e8005cf0 con 0x5591d9094c60 2024-09-13T18:39:06.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.697+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591d8f9f0e0 con 0x5591d9094c60 2024-09-13T18:39:06.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.697+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f79e400b8a0 con 0x5591d9094c60 2024-09-13T18:39:06.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.697+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2797+0+0 (secure 0 0 0) 0x7f79e4043fe0 con 0x5591d9094c60 2024-09-13T18:39:06.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:06.698+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) v1 -- 0x5591d8f92600 con 0x5591d9094c60 2024-09-13T18:39:07.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:07.518+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 141+0+0 (secure 0 0 0) 0x7f79e401d030 con 0x5591d9094c60 2024-09-13T18:39:07.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:07.519+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x5591d8fb0630 con 0x5591d9094c60 2024-09-13T18:39:07.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:07.519+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79e4006b40 con 0x5591d9094c60 2024-09-13T18:39:07.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:07.519+0000 7f79f2d9f640 1 -- 172.21.15.97:0/1254896969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=14}) v3 -- 0x7f79d0002990 con 0x5591d9094c60 2024-09-13T18:39:07.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:07.519+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 <== mon.0 v2:172.21.15.97:3300/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 642+0+0 (secure 0 0 0) 0x7f79e4020cf0 con 0x5591d9094c60 2024-09-13T18:39:07.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:07.520+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 --> v1:172.21.15.97:6800/35060 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) v8 -- 0x5591d90927e0 con 0x5591d9091d00 2024-09-13T18:39:07.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:07.524+0000 7f79f4da3640 1 -- 172.21.15.97:0/1254896969 <== osd.3 v1:172.21.15.97:6800/35060 1 ==== osd_op_reply(1 rbd_trash [create] v14'1 uv1 ondisk = 0) v8 ==== 153+0+0 (unknown 1742540995 0 0) 0x7f79ec009880 con 0x5591d9091d00 2024-09-13T18:39:07.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:07.526+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 --> v1:172.21.15.97:6800/35060 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) v8 -- 0x5591d918bce0 con 0x5591d9091d00 2024-09-13T18:39:07.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:07.527+0000 7f79f4da3640 1 -- 172.21.15.97:0/1254896969 <== osd.3 v1:172.21.15.97:6800/35060 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (unknown 173568156 0 0) 0x7f79ec009880 con 0x5591d9091d00 2024-09-13T18:39:07.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:07.527+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 --> v1:172.21.15.97:6800/35060 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) v8 -- 0x5591d918add0 con 0x5591d9091d00 2024-09-13T18:39:07.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:07.527+0000 7f79f4da3640 1 -- 172.21.15.97:0/1254896969 <== osd.3 v1:172.21.15.97:6800/35060 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (unknown 185109136 0 0) 0x7f79ec009880 con 0x5591d9091d00 2024-09-13T18:39:07.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:07.527+0000 7f79f2d9f640 1 -- 172.21.15.97:0/1254896969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) v4 -- 0x7f79d0003d30 con 0x5591d9094c60 2024-09-13T18:39:08.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:08.522+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 <== mon.0 v2:172.21.15.97:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v15) v1 ==== 55+0+0 (secure 0 0 0) 0x7f79e402f060 con 0x5591d9094c60 2024-09-13T18:39:08.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:08.522+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=15}) v3 -- 0x7f79d8036580 con 0x5591d9094c60 2024-09-13T18:39:08.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:08.522+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 <== mon.0 v2:172.21.15.97:3300/0 10 ==== osd_map(15..15 src has 1..15) v4 ==== 618+0+0 (secure 0 0 0) 0x7f79e400bde0 con 0x5591d9094c60 2024-09-13T18:39:08.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:08.523+0000 7f79f2d9f640 1 -- 172.21.15.97:0/1254896969 --> v1:172.21.15.97:6800/35060 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x7f79d00056f0 con 0x5591d9091d00 2024-09-13T18:39:08.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:08.526+0000 7f79f4da3640 1 -- 172.21.15.97:0/1254896969 <== osd.3 v1:172.21.15.97:6800/35060 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v15'1 uv1 ondisk = 0) v8 ==== 194+0+0 (unknown 913822303 0 0) 0x7f79ec009880 con 0x5591d9091d00 2024-09-13T18:39:08.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:08.526+0000 7f79f2d9f640 1 -- 172.21.15.97:0/1254896969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v15) v4 -- 0x7f79d0005140 con 0x5591d9094c60 2024-09-13T18:39:09.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.532+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 <== mon.0 v2:172.21.15.97:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v16) v1 ==== 43+0+0 (secure 0 0 0) 0x7f79e4038060 con 0x5591d9094c60 2024-09-13T18:39:09.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.532+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=16}) v3 -- 0x7f79d8036710 con 0x5591d9094c60 2024-09-13T18:39:09.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.532+0000 7f79f0d9b640 1 -- 172.21.15.97:0/1254896969 <== mon.0 v2:172.21.15.97:3300/0 12 ==== osd_map(16..16 src has 1..16) v4 ==== 646+0+0 (secure 0 0 0) 0x7f79e400bb50 con 0x5591d9094c60 2024-09-13T18:39:09.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.532+0000 7f79f2d9f640 1 -- 172.21.15.97:0/1254896969 --> v1:172.21.15.97:6800/35060 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) v8 -- 0x7f79d0005f90 con 0x5591d9091d00 2024-09-13T18:39:09.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.537+0000 7f79f4da3640 1 -- 172.21.15.97:0/1254896969 <== osd.3 v1:172.21.15.97:6800/35060 5 ==== osd_op_reply(7 rbd_info [write 0~19] v16'2 uv2 ondisk = 0) v8 ==== 152+0+0 (unknown 2130366450 0 0) 0x7f79ec009880 con 0x5591d9091d00 2024-09-13T18:39:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.538+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 >> v1:172.21.15.97:6800/35060 conn(0x5591d9091d00 legacy=0x5591d90920d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.538+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 >> v1:172.21.15.97:6816/34603 conn(0x7f79d802fa90 legacy=0x7f79d8031f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.538+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5591d9094c60 msgr2=0x5591d912ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.538+0000 7f79f6e2eb80 1 --2- 172.21.15.97:0/1254896969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5591d9094c60 0x5591d912ae70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f79e400dfd0 tx=0x7f79e40069e0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.538+0000 7f79f4da3640 1 -- 172.21.15.97:0/1254896969 reap_dead start 2024-09-13T18:39:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.538+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 shutdown_connections 2024-09-13T18:39:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.538+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 >> 172.21.15.97:0/1254896969 conn(0x5591d9096af0 msgr2=0x5591d9127160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.538+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 shutdown_connections 2024-09-13T18:39:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.538+0000 7f79f6e2eb80 1 -- 172.21.15.97:0/1254896969 wait complete. 2024-09-13T18:39:09.544 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T18:39:09.545 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:39:09.545 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:39:09.547 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:39:09.547 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T18:39:09.548 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:09.623 INFO:tasks.ceph.mds.a.smithi097.stdout:starting mds.a at 2024-09-13T18:39:09.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.647+0000 7fa7640d4640 1 Processor -- start 2024-09-13T18:39:09.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.647+0000 7fa7640d4640 1 -- start start 2024-09-13T18:39:09.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.647+0000 7fa7640d4640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa75c0a02f0 0x7fa75c098f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:09.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.647+0000 7fa7640d4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75c097850 0x7fa75c099450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:09.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.647+0000 7fa7640d4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75c0969d0 con 0x7fa75c09ad90 2024-09-13T18:39:09.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.647+0000 7fa7640d4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0a06c0 con 0x7fa75c097850 2024-09-13T18:39:09.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.647+0000 7fa7640d4640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c09bf10 con 0x7fa75c0a02f0 2024-09-13T18:39:09.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.647+0000 7fa761e70640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa75c0a02f0 0x7fa75c098f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:09.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.647+0000 7fa76166f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa75c09ad90 0x7fa75c067110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35926/0 (socket says 172.21.15.97:35926) 2024-09-13T18:39:09.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.647+0000 7fa762671640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75c097850 0x7fa75c099450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:09.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.647+0000 7fa76166f640 1 -- 172.21.15.97:0/826802288 learned_addr learned my addr 172.21.15.97:0/826802288 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:09.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.648+0000 7fa761e70640 1 -- 172.21.15.97:0/826802288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75c097850 msgr2=0x7fa75c099450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:09.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.648+0000 7fa761e70640 1 --2- 172.21.15.97:0/826802288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75c097850 0x7fa75c099450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.648+0000 7fa761e70640 1 -- 172.21.15.97:0/826802288 >> v1:172.21.15.97:6789/0 conn(0x7fa75c09ad90 legacy=0x7fa75c067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:09.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.648+0000 7fa760e6e640 1 -- 172.21.15.97:0/826802288 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324926400 0 0) 0x7fa75c0969d0 con 0x7fa75c09ad90 2024-09-13T18:39:09.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.648+0000 7fa761e70640 1 -- 172.21.15.97:0/826802288 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c097ce0 con 0x7fa75c0a02f0 2024-09-13T18:39:09.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.648+0000 7fa762671640 1 --2- 172.21.15.97:0/826802288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75c097850 0x7fa75c099450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:09.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.648+0000 7fa761e70640 1 --2- 172.21.15.97:0/826802288 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa75c0a02f0 0x7fa75c098f10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009880 tx=0x7fa74c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6fe8c23c74e095e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:09.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.649+0000 7fa760e6e640 1 -- 172.21.15.97:0/826802288 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c02ace0 con 0x7fa75c0a02f0 2024-09-13T18:39:09.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.649+0000 7fa760e6e640 1 -- 172.21.15.97:0/826802288 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c02ae40 con 0x7fa75c0a02f0 2024-09-13T18:39:09.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.649+0000 7fa760e6e640 1 -- 172.21.15.97:0/826802288 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c032670 con 0x7fa75c0a02f0 2024-09-13T18:39:09.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.649+0000 7fa7640d4640 1 -- 172.21.15.97:0/826802288 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa75c0a02f0 msgr2=0x7fa75c098f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.649+0000 7fa7640d4640 1 --2- 172.21.15.97:0/826802288 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa75c0a02f0 0x7fa75c098f10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009880 tx=0x7fa74c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.649+0000 7fa7640d4640 1 -- 172.21.15.97:0/826802288 shutdown_connections 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.649+0000 7fa7640d4640 1 --2- 172.21.15.97:0/826802288 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75c097850 0x7fa75c099450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.649+0000 7fa7640d4640 1 --2- 172.21.15.97:0/826802288 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa75c0a02f0 0x7fa75c098f10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.649+0000 7fa7640d4640 1 -- 172.21.15.97:0/826802288 >> 172.21.15.97:0/826802288 conn(0x7fa75c05e5d0 msgr2=0x7fa75c09f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.649+0000 7fa7640d4640 1 -- 172.21.15.97:0/826802288 shutdown_connections 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.649+0000 7fa7640d4640 1 -- 172.21.15.97:0/826802288 wait complete. 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.650+0000 7fa7640d4640 1 Processor -- start 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.650+0000 7fa7640d4640 1 -- start start 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.650+0000 7fa7640d4640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa75c097850 0x7fa75c11d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.650+0000 7fa7640d4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75c09ad90 0x7fa75c11d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.650+0000 7fa7640d4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa75c0a02f0 0x7fa75c13e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.650+0000 7fa7640d4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c11fc20 con 0x7fa75c0a02f0 2024-09-13T18:39:09.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.650+0000 7fa7640d4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c1202c0 con 0x7fa75c09ad90 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.650+0000 7fa7640d4640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c099390 con 0x7fa75c097850 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.650+0000 7fa761e70640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa75c097850 0x7fa75c11d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa761e70640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa75c097850 0x7fa75c11d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59278/0 (socket says 172.21.15.97:59278) 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa761e70640 1 -- 172.21.15.97:0/3135810025 learned_addr learned my addr 172.21.15.97:0/3135810025 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa762671640 1 --2- 172.21.15.97:0/3135810025 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa75c0a02f0 0x7fa75c13e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa76166f640 1 --2- 172.21.15.97:0/3135810025 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75c09ad90 0x7fa75c11d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa761e70640 1 -- 172.21.15.97:0/3135810025 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75c09ad90 msgr2=0x7fa75c11d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa761e70640 1 --2- 172.21.15.97:0/3135810025 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75c09ad90 0x7fa75c11d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa761e70640 1 -- 172.21.15.97:0/3135810025 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa75c0a02f0 msgr2=0x7fa75c13e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa761e70640 1 --2- 172.21.15.97:0/3135810025 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa75c0a02f0 0x7fa75c13e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa761e70640 1 -- 172.21.15.97:0/3135810025 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa754009a20 con 0x7fa75c097850 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa76166f640 1 --2- 172.21.15.97:0/3135810025 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75c09ad90 0x7fa75c11d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa761e70640 1 --2- 172.21.15.97:0/3135810025 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa75c097850 0x7fa75c11d010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa74c035040 tx=0x7fa74c032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:09.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa751ffb640 1 -- 172.21.15.97:0/3135810025 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c031700 con 0x7fa75c097850 2024-09-13T18:39:09.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa751ffb640 1 -- 172.21.15.97:0/3135810025 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c031860 con 0x7fa75c097850 2024-09-13T18:39:09.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa7640d4640 1 -- 172.21.15.97:0/3135810025 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74c009390 con 0x7fa75c097850 2024-09-13T18:39:09.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa751ffb640 1 -- 172.21.15.97:0/3135810025 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c031c20 con 0x7fa75c097850 2024-09-13T18:39:09.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.651+0000 7fa7640d4640 1 -- 172.21.15.97:0/3135810025 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75c11e320 con 0x7fa75c097850 2024-09-13T18:39:09.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.652+0000 7fa751ffb640 1 -- 172.21.15.97:0/3135810025 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fa74c039040 con 0x7fa75c097850 2024-09-13T18:39:09.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.652+0000 7fa751ffb640 1 -- 172.21.15.97:0/3135810025 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2864+0+0 (secure 0 0 0) 0x7fa74c041070 con 0x7fa75c097850 2024-09-13T18:39:09.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.652+0000 7fa7640d4640 1 -- 172.21.15.97:0/3135810025 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75c0681c0 con 0x7fa75c097850 2024-09-13T18:39:09.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.657+0000 7fa751ffb640 1 -- 172.21.15.97:0/3135810025 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fa74c04a080 con 0x7fa75c097850 2024-09-13T18:39:09.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.811+0000 7fa7640d4640 1 -- 172.21.15.97:0/3135810025 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa75c068780 con 0x7fa75c097850 2024-09-13T18:39:09.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.811+0000 7fa751ffb640 1 -- 172.21.15.97:0/3135810025 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8169 (secure 0 0 0) 0x7fa74c03bc80 con 0x7fa75c097850 2024-09-13T18:39:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:09.815 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":16,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:09.520715+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:09.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.814+0000 7fa7640d4640 1 -- 172.21.15.97:0/3135810025 >> v1:172.21.15.97:6816/34603 conn(0x7fa740031160 legacy=0x7fa740033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:09.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.814+0000 7fa7640d4640 1 -- 172.21.15.97:0/3135810025 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa75c097850 msgr2=0x7fa75c11d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:09.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.814+0000 7fa7640d4640 1 --2- 172.21.15.97:0/3135810025 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa75c097850 0x7fa75c11d010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa74c035040 tx=0x7fa74c032000 comp rx=0 tx=0).stop 2024-09-13T18:39:09.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.814+0000 7fa7640d4640 1 -- 172.21.15.97:0/3135810025 shutdown_connections 2024-09-13T18:39:09.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.814+0000 7fa7640d4640 1 --2- 172.21.15.97:0/3135810025 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa75c0a02f0 0x7fa75c13e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.814+0000 7fa7640d4640 1 --2- 172.21.15.97:0/3135810025 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa75c09ad90 0x7fa75c11d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.814+0000 7fa7640d4640 1 --2- 172.21.15.97:0/3135810025 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa75c097850 0x7fa75c11d010 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.814+0000 7fa7640d4640 1 -- 172.21.15.97:0/3135810025 >> 172.21.15.97:0/3135810025 conn(0x7fa75c05e5d0 msgr2=0x7fa75c09de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:09.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.814+0000 7fa7640d4640 1 -- 172.21.15.97:0/3135810025 shutdown_connections 2024-09-13T18:39:09.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.814+0000 7fa7640d4640 1 -- 172.21.15.97:0/3135810025 wait complete. 2024-09-13T18:39:09.827 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:39:01.375967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T18:39:05.732412+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-09-13T18:39:09.827 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:39:09.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.919+0000 7fc8158b8640 1 Processor -- start 2024-09-13T18:39:09.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.919+0000 7fc8158b8640 1 -- start start 2024-09-13T18:39:09.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc8158b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc81009dca0 0x7fc8101347b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:09.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc8158b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc810134cf0 0x7fc8101370d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:09.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc8158b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8100690a0 con 0x7fc810068970 2024-09-13T18:39:09.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc8158b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc810068d40 con 0x7fc810134cf0 2024-09-13T18:39:09.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc8158b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81009e5e0 con 0x7fc81009dca0 2024-09-13T18:39:09.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc80f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc810134cf0 0x7fc8101370d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:09.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc80e7fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc81009dca0 0x7fc8101347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:09.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc80e7fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc81009dca0 0x7fc8101347b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:33676/0 (socket says 172.21.15.97:33676) 2024-09-13T18:39:09.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc80f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc810134cf0 0x7fc8101370d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40680/0 (socket says 172.21.15.97:40680) 2024-09-13T18:39:09.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc80e7fc640 1 -- 172.21.15.97:0/2951070442 learned_addr learned my addr 172.21.15.97:0/2951070442 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:09.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc80e7fc640 1 -- 172.21.15.97:0/2951070442 >> v2:172.21.15.97:3300/0 conn(0x7fc810134cf0 msgr2=0x7fc8101370d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:09.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc80e7fc640 1 --2- 172.21.15.97:0/2951070442 >> v2:172.21.15.97:3300/0 conn(0x7fc810134cf0 0x7fc8101370d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc80e7fc640 1 -- 172.21.15.97:0/2951070442 >> v1:172.21.15.97:6789/0 conn(0x7fc810068970 legacy=0x7fc81009d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:09.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc80e7fc640 1 -- 172.21.15.97:0/2951070442 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81009ce00 con 0x7fc81009dca0 2024-09-13T18:39:09.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.920+0000 7fc80f7fe640 1 --2- 172.21.15.97:0/2951070442 >> v2:172.21.15.97:3300/0 conn(0x7fc810134cf0 0x7fc8101370d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:09.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.921+0000 7fc80e7fc640 1 --2- 172.21.15.97:0/2951070442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc81009dca0 0x7fc8101347b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc804009910 tx=0x7fc8040091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=152cdc2b13a1fccd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:09.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.921+0000 7fc80dffb640 1 -- 172.21.15.97:0/2951070442 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80402ad20 con 0x7fc81009dca0 2024-09-13T18:39:09.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.921+0000 7fc80dffb640 1 -- 172.21.15.97:0/2951070442 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80402ae80 con 0x7fc81009dca0 2024-09-13T18:39:09.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.921+0000 7fc80dffb640 1 -- 172.21.15.97:0/2951070442 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804032670 con 0x7fc81009dca0 2024-09-13T18:39:09.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.922+0000 7fc8158b8640 1 -- 172.21.15.97:0/2951070442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc81009dca0 msgr2=0x7fc8101347b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:09.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.922+0000 7fc8158b8640 1 --2- 172.21.15.97:0/2951070442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc81009dca0 0x7fc8101347b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc804009910 tx=0x7fc8040091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.922+0000 7fc8158b8640 1 -- 172.21.15.97:0/2951070442 shutdown_connections 2024-09-13T18:39:09.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.922+0000 7fc8158b8640 1 --2- 172.21.15.97:0/2951070442 >> v2:172.21.15.97:3300/0 conn(0x7fc810134cf0 0x7fc8101370d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.922+0000 7fc8158b8640 1 --2- 172.21.15.97:0/2951070442 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc81009dca0 0x7fc8101347b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.922+0000 7fc8158b8640 1 -- 172.21.15.97:0/2951070442 >> 172.21.15.97:0/2951070442 conn(0x7fc81006f300 msgr2=0x7fc8100a29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:09.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.922+0000 7fc8158b8640 1 -- 172.21.15.97:0/2951070442 shutdown_connections 2024-09-13T18:39:09.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.922+0000 7fc8158b8640 1 -- 172.21.15.97:0/2951070442 wait complete. 2024-09-13T18:39:09.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.922+0000 7fc8158b8640 1 Processor -- start 2024-09-13T18:39:09.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc8158b8640 1 -- start start 2024-09-13T18:39:09.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc8158b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810068970 0x7fc81011a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:09.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc8158b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc81009dca0 0x7fc81011a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:09.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc8158b8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc810134cf0 0x7fc81011ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:09.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc8158b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc810134a10 con 0x7fc81009dca0 2024-09-13T18:39:09.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc8158b8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81009e7b0 con 0x7fc810068970 2024-09-13T18:39:09.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc8158b8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc81011b870 con 0x7fc810134cf0 2024-09-13T18:39:09.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc80effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810068970 0x7fc81011a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:09.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc80e7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc81009dca0 0x7fc81011a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:09.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc80effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810068970 0x7fc81011a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:33684/0 (socket says 172.21.15.97:33684) 2024-09-13T18:39:09.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc80effd640 1 -- 172.21.15.97:0/3417926158 learned_addr learned my addr 172.21.15.97:0/3417926158 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:09.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc80f7fe640 1 --2- 172.21.15.97:0/3417926158 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc810134cf0 0x7fc81011ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:09.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc80effd640 1 -- 172.21.15.97:0/3417926158 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc810134cf0 msgr2=0x7fc81011ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:09.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc80effd640 1 --2- 172.21.15.97:0/3417926158 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc810134cf0 0x7fc81011ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc80effd640 1 -- 172.21.15.97:0/3417926158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc81009dca0 msgr2=0x7fc81011a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:09.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc80effd640 1 --2- 172.21.15.97:0/3417926158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc81009dca0 0x7fc81011a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:09.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc80effd640 1 -- 172.21.15.97:0/3417926158 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc808009390 con 0x7fc810068970 2024-09-13T18:39:09.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.923+0000 7fc80e7fc640 1 --2- 172.21.15.97:0/3417926158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc81009dca0 0x7fc81011a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:09.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.924+0000 7fc80effd640 1 --2- 172.21.15.97:0/3417926158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810068970 0x7fc81011a400 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc80000c8e0 tx=0x7fc800001710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:09.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.924+0000 7fc7f6ffd640 1 -- 172.21.15.97:0/3417926158 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80000a850 con 0x7fc810068970 2024-09-13T18:39:09.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.924+0000 7fc7f6ffd640 1 -- 172.21.15.97:0/3417926158 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80000a9d0 con 0x7fc810068970 2024-09-13T18:39:09.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.924+0000 7fc8158b8640 1 -- 172.21.15.97:0/3417926158 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc804009450 con 0x7fc810068970 2024-09-13T18:39:09.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.924+0000 7fc7f6ffd640 1 -- 172.21.15.97:0/3417926158 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80000ad90 con 0x7fc810068970 2024-09-13T18:39:09.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.924+0000 7fc8158b8640 1 -- 172.21.15.97:0/3417926158 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81011de70 con 0x7fc810068970 2024-09-13T18:39:09.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.924+0000 7fc7f6ffd640 1 -- 172.21.15.97:0/3417926158 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fc800003030 con 0x7fc810068970 2024-09-13T18:39:09.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.925+0000 7fc7f6ffd640 1 -- 172.21.15.97:0/3417926158 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2864+0+0 (secure 0 0 0) 0x7fc800041d10 con 0x7fc810068970 2024-09-13T18:39:09.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.925+0000 7fc8158b8640 1 -- 172.21.15.97:0/3417926158 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8100714b0 con 0x7fc810068970 2024-09-13T18:39:09.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:09.929+0000 7fc7f6ffd640 1 -- 172.21.15.97:0/3417926158 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fc800012630 con 0x7fc810068970 2024-09-13T18:39:10.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.080+0000 7fc8158b8640 1 -- 172.21.15.97:0/3417926158 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc81009ff60 con 0x7fc810068970 2024-09-13T18:39:10.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.080+0000 7fc7f6ffd640 1 -- 172.21.15.97:0/3417926158 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8000212a0 con 0x7fc810068970 2024-09-13T18:39:10.083 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2024-09-13T18:39:10.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.082+0000 7fc8158b8640 1 -- 172.21.15.97:0/3417926158 >> v1:172.21.15.97:6816/34603 conn(0x7fc7fc031160 legacy=0x7fc7fc033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.082+0000 7fc8158b8640 1 -- 172.21.15.97:0/3417926158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810068970 msgr2=0x7fc81011a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.082+0000 7fc8158b8640 1 --2- 172.21.15.97:0/3417926158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810068970 0x7fc81011a400 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc80000c8e0 tx=0x7fc800001710 comp rx=0 tx=0).stop 2024-09-13T18:39:10.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.082+0000 7fc8158b8640 1 -- 172.21.15.97:0/3417926158 shutdown_connections 2024-09-13T18:39:10.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.082+0000 7fc8158b8640 1 --2- 172.21.15.97:0/3417926158 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc810134cf0 0x7fc81011ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.082+0000 7fc8158b8640 1 --2- 172.21.15.97:0/3417926158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc81009dca0 0x7fc81011a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.082+0000 7fc8158b8640 1 --2- 172.21.15.97:0/3417926158 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc810068970 0x7fc81011a400 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.082+0000 7fc8158b8640 1 -- 172.21.15.97:0/3417926158 >> 172.21.15.97:0/3417926158 conn(0x7fc81006f300 msgr2=0x7fc8100a1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:10.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.082+0000 7fc8158b8640 1 -- 172.21.15.97:0/3417926158 shutdown_connections 2024-09-13T18:39:10.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.082+0000 7fc8158b8640 1 -- 172.21.15.97:0/3417926158 wait complete. 2024-09-13T18:39:10.095 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-13T18:39:10.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.188+0000 7f65e4914640 1 Processor -- start 2024-09-13T18:39:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65e4914640 1 -- start start 2024-09-13T18:39:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65e4914640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e0097580 0x7f65e009a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65e4914640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65e009adb0 0x7f65e009b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65e4914640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e0096b70 con 0x7f65e0134020 2024-09-13T18:39:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65e4914640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e0069cd0 con 0x7f65e009adb0 2024-09-13T18:39:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65e4914640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e0069fe0 con 0x7f65e0097580 2024-09-13T18:39:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65d7fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65e009adb0 0x7f65e009b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65de59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e0097580 0x7f65e009a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65de59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e0097580 0x7f65e009a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:33688/0 (socket says 172.21.15.97:33688) 2024-09-13T18:39:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65de59c640 1 -- 172.21.15.97:0/3343435396 learned_addr learned my addr 172.21.15.97:0/3343435396 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65d7fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65e009adb0 0x7f65e009b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40698/0 (socket says 172.21.15.97:40698) 2024-09-13T18:39:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65ded9d640 1 --1- 172.21.15.97:0/3343435396 >> v1:172.21.15.97:6789/0 conn(0x7f65e0134020 0x7f65e0136400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35946/0 (socket says 172.21.15.97:35946) 2024-09-13T18:39:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65de59c640 1 -- 172.21.15.97:0/3343435396 >> v2:172.21.15.97:3300/0 conn(0x7f65e009adb0 msgr2=0x7f65e009b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:10.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65de59c640 1 --2- 172.21.15.97:0/3343435396 >> v2:172.21.15.97:3300/0 conn(0x7f65e009adb0 0x7f65e009b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65de59c640 1 -- 172.21.15.97:0/3343435396 >> v1:172.21.15.97:6789/0 conn(0x7f65e0134020 legacy=0x7f65e0136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65ddd9b640 1 -- 172.21.15.97:0/3343435396 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802240957 0 0) 0x7f65e0096b70 con 0x7f65e0134020 2024-09-13T18:39:10.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65de59c640 1 -- 172.21.15.97:0/3343435396 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e00970d0 con 0x7f65e0097580 2024-09-13T18:39:10.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.189+0000 7f65d7fff640 1 --2- 172.21.15.97:0/3343435396 >> v2:172.21.15.97:3300/0 conn(0x7f65e009adb0 0x7f65e009b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:10.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.190+0000 7f65de59c640 1 --2- 172.21.15.97:0/3343435396 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e0097580 0x7f65e009a870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009940 tx=0x7f65d00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28166dc590a87802 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.190+0000 7f65ddd9b640 1 -- 172.21.15.97:0/3343435396 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d002ad20 con 0x7f65e0097580 2024-09-13T18:39:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.190+0000 7f65ddd9b640 1 -- 172.21.15.97:0/3343435396 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d002ae80 con 0x7f65e0097580 2024-09-13T18:39:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.190+0000 7f65ddd9b640 1 -- 172.21.15.97:0/3343435396 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d0032670 con 0x7f65e0097580 2024-09-13T18:39:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.191+0000 7f65e4914640 1 -- 172.21.15.97:0/3343435396 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e0097580 msgr2=0x7f65e009a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.191+0000 7f65e4914640 1 --2- 172.21.15.97:0/3343435396 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e0097580 0x7f65e009a870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009940 tx=0x7f65d00091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.191+0000 7f65e4914640 1 -- 172.21.15.97:0/3343435396 shutdown_connections 2024-09-13T18:39:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.191+0000 7f65e4914640 1 --2- 172.21.15.97:0/3343435396 >> v2:172.21.15.97:3300/0 conn(0x7f65e009adb0 0x7f65e009b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.191+0000 7f65e4914640 1 --2- 172.21.15.97:0/3343435396 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e0097580 0x7f65e009a870 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.191+0000 7f65e4914640 1 -- 172.21.15.97:0/3343435396 >> 172.21.15.97:0/3343435396 conn(0x7f65e009f910 msgr2=0x7f65e009b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.191+0000 7f65e4914640 1 -- 172.21.15.97:0/3343435396 shutdown_connections 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.191+0000 7f65e4914640 1 -- 172.21.15.97:0/3343435396 wait complete. 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.192+0000 7f65e4914640 1 Processor -- start 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.192+0000 7f65e4914640 1 -- start start 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.192+0000 7f65e4914640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65e0097580 0x7f65e0133260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.192+0000 7f65e4914640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e009adb0 0x7f65e01337a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.192+0000 7f65e4914640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e0134020 0x7f65e0090730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.192+0000 7f65e4914640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e006ee90 con 0x7f65e0134020 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.192+0000 7f65e4914640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e00990a0 con 0x7f65e009adb0 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.192+0000 7f65e4914640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65e0094120 con 0x7f65e0097580 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.192+0000 7f65de59c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65e0097580 0x7f65e0133260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.192+0000 7f65d7fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e009adb0 0x7f65e01337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.192+0000 7f65ded9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e0134020 0x7f65e0090730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.192+0000 7f65de59c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65e0097580 0x7f65e0133260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59292/0 (socket says 172.21.15.97:59292) 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.192+0000 7f65de59c640 1 -- 172.21.15.97:0/3362088892 learned_addr learned my addr 172.21.15.97:0/3362088892 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.193+0000 7f65d7fff640 1 -- 172.21.15.97:0/3362088892 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65e0097580 msgr2=0x7f65e0133260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.193+0000 7f65d7fff640 1 --2- 172.21.15.97:0/3362088892 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65e0097580 0x7f65e0133260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.193+0000 7f65d7fff640 1 -- 172.21.15.97:0/3362088892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e0134020 msgr2=0x7f65e0090730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.193+0000 7f65d7fff640 1 --2- 172.21.15.97:0/3362088892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e0134020 0x7f65e0090730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.193+0000 7f65d7fff640 1 -- 172.21.15.97:0/3362088892 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c8009390 con 0x7f65e009adb0 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.193+0000 7f65d7fff640 1 --2- 172.21.15.97:0/3362088892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e009adb0 0x7f65e01337a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f65c800ea20 tx=0x7f65c80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.193+0000 7f65d67fc640 1 -- 172.21.15.97:0/3362088892 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c800ca10 con 0x7f65e009adb0 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.193+0000 7f65d67fc640 1 -- 172.21.15.97:0/3362088892 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c800cb70 con 0x7f65e009adb0 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.193+0000 7f65e4914640 1 -- 172.21.15.97:0/3362088892 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d0009450 con 0x7f65e009adb0 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.193+0000 7f65d67fc640 1 -- 172.21.15.97:0/3362088892 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c8013470 con 0x7f65e009adb0 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.193+0000 7f65e4914640 1 -- 172.21.15.97:0/3362088892 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e00922b0 con 0x7f65e009adb0 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.194+0000 7f65d67fc640 1 -- 172.21.15.97:0/3362088892 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f65c80137e0 con 0x7f65e009adb0 2024-09-13T18:39:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.194+0000 7f65d67fc640 1 -- 172.21.15.97:0/3362088892 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2864+0+0 (secure 0 0 0) 0x7f65c8042030 con 0x7f65e009adb0 2024-09-13T18:39:10.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.194+0000 7f65e4914640 1 -- 172.21.15.97:0/3362088892 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e0096d00 con 0x7f65e009adb0 2024-09-13T18:39:10.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.198+0000 7f65d67fc640 1 -- 172.21.15.97:0/3362088892 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f65c8021020 con 0x7f65e009adb0 2024-09-13T18:39:10.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.350+0000 7f65e4914640 1 -- 172.21.15.97:0/3362088892 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f65e0093bd0 con 0x7f65e009adb0 2024-09-13T18:39:10.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.350+0000 7f65d67fc640 1 -- 172.21.15.97:0/3362088892 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65c80236b0 con 0x7f65e009adb0 2024-09-13T18:39:10.353 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 8 2024-09-13T18:39:10.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.352+0000 7f65e4914640 1 -- 172.21.15.97:0/3362088892 >> v1:172.21.15.97:6816/34603 conn(0x7f65c0031160 legacy=0x7f65c0033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.352+0000 7f65e4914640 1 -- 172.21.15.97:0/3362088892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e009adb0 msgr2=0x7f65e01337a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.352+0000 7f65e4914640 1 --2- 172.21.15.97:0/3362088892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e009adb0 0x7f65e01337a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f65c800ea20 tx=0x7f65c80090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.352+0000 7f65e4914640 1 -- 172.21.15.97:0/3362088892 shutdown_connections 2024-09-13T18:39:10.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.352+0000 7f65e4914640 1 --2- 172.21.15.97:0/3362088892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65e0134020 0x7f65e0090730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.352+0000 7f65e4914640 1 --2- 172.21.15.97:0/3362088892 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65e009adb0 0x7f65e01337a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.352+0000 7f65e4914640 1 --2- 172.21.15.97:0/3362088892 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65e0097580 0x7f65e0133260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.352+0000 7f65e4914640 1 -- 172.21.15.97:0/3362088892 >> 172.21.15.97:0/3362088892 conn(0x7f65e009f910 msgr2=0x7f65e006e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:10.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.352+0000 7f65e4914640 1 -- 172.21.15.97:0/3362088892 shutdown_connections 2024-09-13T18:39:10.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.352+0000 7f65e4914640 1 -- 172.21.15.97:0/3362088892 wait complete. 2024-09-13T18:39:10.365 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:39:10.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.455+0000 7f1788894640 1 Processor -- start 2024-09-13T18:39:10.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.455+0000 7f1788894640 1 -- start start 2024-09-13T18:39:10.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1788894640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f178412ff40 0x7f1784134950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1788894640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1784134e90 0x7f1784137270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1788894640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178412f600 con 0x7f1784067110 2024-09-13T18:39:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1788894640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17840674e0 con 0x7f178412ff40 2024-09-13T18:39:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1788894640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f178409d040 con 0x7f1784134e90 2024-09-13T18:39:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1781d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f178412ff40 0x7f1784134950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1782d9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1784134e90 0x7f1784137270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1781d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f178412ff40 0x7f1784134950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40710/0 (socket says 172.21.15.97:40710) 2024-09-13T18:39:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1781d9b640 1 -- 172.21.15.97:0/1733069117 learned_addr learned my addr 172.21.15.97:0/1733069117 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f178259c640 1 --1- 172.21.15.97:0/1733069117 >> v1:172.21.15.97:6789/0 conn(0x7f1784067110 0x7f178412f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35958/0 (socket says 172.21.15.97:35958) 2024-09-13T18:39:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1781d9b640 1 -- 172.21.15.97:0/1733069117 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1784134e90 msgr2=0x7f1784137270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1781d9b640 1 --2- 172.21.15.97:0/1733069117 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1784134e90 0x7f1784137270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1781d9b640 1 -- 172.21.15.97:0/1733069117 >> v1:172.21.15.97:6789/0 conn(0x7f1784067110 legacy=0x7f178412f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1781d9b640 1 -- 172.21.15.97:0/1733069117 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784067a50 con 0x7f178412ff40 2024-09-13T18:39:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.456+0000 7f1782d9d640 1 --2- 172.21.15.97:0/1733069117 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1784134e90 0x7f1784137270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.457+0000 7f1781d9b640 1 --2- 172.21.15.97:0/1733069117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f178412ff40 0x7f1784134950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1778009f20 tx=0x7f1778009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5429cad136df31fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.457+0000 7f178159a640 1 -- 172.21.15.97:0/1733069117 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778031400 con 0x7f178412ff40 2024-09-13T18:39:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.457+0000 7f178159a640 1 -- 172.21.15.97:0/1733069117 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177802d050 con 0x7f178412ff40 2024-09-13T18:39:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.457+0000 7f178159a640 1 -- 172.21.15.97:0/1733069117 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17780317d0 con 0x7f178412ff40 2024-09-13T18:39:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.457+0000 7f1788894640 1 -- 172.21.15.97:0/1733069117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f178412ff40 msgr2=0x7f1784134950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.457+0000 7f1788894640 1 --2- 172.21.15.97:0/1733069117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f178412ff40 0x7f1784134950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1778009f20 tx=0x7f1778009840 comp rx=0 tx=0).stop 2024-09-13T18:39:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.458+0000 7f1788894640 1 -- 172.21.15.97:0/1733069117 shutdown_connections 2024-09-13T18:39:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.458+0000 7f1788894640 1 --2- 172.21.15.97:0/1733069117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f178412ff40 0x7f1784134950 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.458+0000 7f1788894640 1 --2- 172.21.15.97:0/1733069117 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1784134e90 0x7f1784137270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.458+0000 7f1788894640 1 -- 172.21.15.97:0/1733069117 >> 172.21.15.97:0/1733069117 conn(0x7f178405e5d0 msgr2=0x7f178409f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.458+0000 7f1788894640 1 -- 172.21.15.97:0/1733069117 shutdown_connections 2024-09-13T18:39:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.458+0000 7f1788894640 1 -- 172.21.15.97:0/1733069117 wait complete. 2024-09-13T18:39:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.458+0000 7f1788894640 1 Processor -- start 2024-09-13T18:39:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.458+0000 7f1788894640 1 -- start start 2024-09-13T18:39:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f1788894640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1784067110 0x7f178411a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f1788894640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f178412ff40 0x7f178411a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f1788894640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784134e90 0x7f178411acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f1788894640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178411b420 con 0x7f1784134e90 2024-09-13T18:39:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f1788894640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178409c120 con 0x7f178412ff40 2024-09-13T18:39:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f1788894640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f178406ea00 con 0x7f1784067110 2024-09-13T18:39:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f178259c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1784067110 0x7f178411a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f178259c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1784067110 0x7f178411a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59308/0 (socket says 172.21.15.97:59308) 2024-09-13T18:39:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f178259c640 1 -- 172.21.15.97:0/2106667533 learned_addr learned my addr 172.21.15.97:0/2106667533 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f1782d9d640 1 --2- 172.21.15.97:0/2106667533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784134e90 0x7f178411acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f1781d9b640 1 --2- 172.21.15.97:0/2106667533 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f178412ff40 0x7f178411a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f178259c640 1 -- 172.21.15.97:0/2106667533 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f178412ff40 msgr2=0x7f178411a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f178259c640 1 --2- 172.21.15.97:0/2106667533 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f178412ff40 0x7f178411a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f178259c640 1 -- 172.21.15.97:0/2106667533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784134e90 msgr2=0x7f178411acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f178259c640 1 --2- 172.21.15.97:0/2106667533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784134e90 0x7f178411acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f178259c640 1 -- 172.21.15.97:0/2106667533 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1774009390 con 0x7f1784067110 2024-09-13T18:39:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f1782d9d640 1 --2- 172.21.15.97:0/2106667533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784134e90 0x7f178411acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f178259c640 1 --2- 172.21.15.97:0/2106667533 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1784067110 0x7f178411a230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f177c00c590 tx=0x7f177c007ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f17727fc640 1 -- 172.21.15.97:0/2106667533 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c0072e0 con 0x7f1784067110 2024-09-13T18:39:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.459+0000 7f17727fc640 1 -- 172.21.15.97:0/2106667533 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c007480 con 0x7f1784067110 2024-09-13T18:39:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.460+0000 7f1788894640 1 -- 172.21.15.97:0/2106667533 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1778009ae0 con 0x7f1784067110 2024-09-13T18:39:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.460+0000 7f17727fc640 1 -- 172.21.15.97:0/2106667533 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c0047a0 con 0x7f1784067110 2024-09-13T18:39:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.460+0000 7f1788894640 1 -- 172.21.15.97:0/2106667533 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178411c7c0 con 0x7f1784067110 2024-09-13T18:39:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.460+0000 7f17727fc640 1 -- 172.21.15.97:0/2106667533 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f177c004bd0 con 0x7f1784067110 2024-09-13T18:39:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.460+0000 7f17727fc640 1 -- 172.21.15.97:0/2106667533 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2864+0+0 (secure 0 0 0) 0x7f177c0415b0 con 0x7f1784067110 2024-09-13T18:39:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.460+0000 7f1788894640 1 -- 172.21.15.97:0/2106667533 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1784064000 con 0x7f1784067110 2024-09-13T18:39:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.465+0000 7f17727fc640 1 -- 172.21.15.97:0/2106667533 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f177c0125b0 con 0x7f1784067110 2024-09-13T18:39:10.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.648+0000 7f1788894640 1 -- 172.21.15.97:0/2106667533 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1784069770 con 0x7f1784067110 2024-09-13T18:39:10.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.649+0000 7f17727fc640 1 -- 172.21.15.97:0/2106667533 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1196 (secure 0 0 0) 0x7f177c010300 con 0x7f1784067110 2024-09-13T18:39:10.651 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:10.652 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6817/3890865357","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6817","nonce":3890865357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:39:10.652 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 2 2024-09-13T18:39:10.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.650+0000 7f1788894640 1 -- 172.21.15.97:0/2106667533 >> v1:172.21.15.97:6816/34603 conn(0x7f1764031160 legacy=0x7f1764033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.651+0000 7f1788894640 1 -- 172.21.15.97:0/2106667533 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1784067110 msgr2=0x7f178411a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.651+0000 7f1788894640 1 --2- 172.21.15.97:0/2106667533 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1784067110 0x7f178411a230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f177c00c590 tx=0x7f177c007ee0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.651+0000 7f1788894640 1 -- 172.21.15.97:0/2106667533 shutdown_connections 2024-09-13T18:39:10.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.651+0000 7f1788894640 1 --2- 172.21.15.97:0/2106667533 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1784134e90 0x7f178411acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.651+0000 7f1788894640 1 --2- 172.21.15.97:0/2106667533 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f178412ff40 0x7f178411a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.651+0000 7f1788894640 1 --2- 172.21.15.97:0/2106667533 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1784067110 0x7f178411a230 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.651+0000 7f1788894640 1 -- 172.21.15.97:0/2106667533 >> 172.21.15.97:0/2106667533 conn(0x7f178405e5d0 msgr2=0x7f178409ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:10.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.651+0000 7f1788894640 1 -- 172.21.15.97:0/2106667533 shutdown_connections 2024-09-13T18:39:10.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.651+0000 7f1788894640 1 -- 172.21.15.97:0/2106667533 wait complete. 2024-09-13T18:39:10.664 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:10.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.754+0000 7f671cad4640 1 Processor -- start 2024-09-13T18:39:10.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.754+0000 7f671cad4640 1 -- start start 2024-09-13T18:39:10.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f671cad4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6718097690 0x7f6718131350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f671cad4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180969d0 0x7f67181338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f671cad4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671806a190 con 0x7f671809dfb0 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f671cad4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671809e380 con 0x7f6718097690 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f671cad4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6718098870 con 0x7f67180969d0 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f6715d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6718097690 0x7f6718131350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f6715d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6718097690 0x7f6718131350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40726/0 (socket says 172.21.15.97:40726) 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f6716d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180969d0 0x7f67181338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f6715d9b640 1 -- 172.21.15.97:0/48442867 learned_addr learned my addr 172.21.15.97:0/48442867 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f6715d9b640 1 -- 172.21.15.97:0/48442867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180969d0 msgr2=0x7f67181338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f6715d9b640 1 --2- 172.21.15.97:0/48442867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180969d0 0x7f67181338a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f6715d9b640 1 -- 172.21.15.97:0/48442867 >> v1:172.21.15.97:6789/0 conn(0x7f671809dfb0 legacy=0x7f6718096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f6715d9b640 1 -- 172.21.15.97:0/48442867 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6718098e10 con 0x7f6718097690 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f671559a640 1 -- 172.21.15.97:0/48442867 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057460133 0 0) 0x7f671806a190 con 0x7f671809dfb0 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.755+0000 7f6716d9d640 1 --2- 172.21.15.97:0/48442867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180969d0 0x7f67181338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.756+0000 7f6715d9b640 1 --2- 172.21.15.97:0/48442867 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6718097690 0x7f6718131350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f670c00bbc0 tx=0x7f670c00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928950c6a0094ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:10.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.756+0000 7f671559a640 1 -- 172.21.15.97:0/48442867 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c032620 con 0x7f6718097690 2024-09-13T18:39:10.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.756+0000 7f671559a640 1 -- 172.21.15.97:0/48442867 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c02e040 con 0x7f6718097690 2024-09-13T18:39:10.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.756+0000 7f671559a640 1 -- 172.21.15.97:0/48442867 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c0329b0 con 0x7f6718097690 2024-09-13T18:39:10.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.756+0000 7f671cad4640 1 -- 172.21.15.97:0/48442867 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6718097690 msgr2=0x7f6718131350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.756+0000 7f671cad4640 1 --2- 172.21.15.97:0/48442867 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6718097690 0x7f6718131350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f670c00bbc0 tx=0x7f670c00b460 comp rx=0 tx=0).stop 2024-09-13T18:39:10.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.757+0000 7f671cad4640 1 -- 172.21.15.97:0/48442867 shutdown_connections 2024-09-13T18:39:10.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.757+0000 7f671cad4640 1 --2- 172.21.15.97:0/48442867 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f67180969d0 0x7f67181338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.757+0000 7f671cad4640 1 --2- 172.21.15.97:0/48442867 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6718097690 0x7f6718131350 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.757+0000 7f671cad4640 1 -- 172.21.15.97:0/48442867 >> 172.21.15.97:0/48442867 conn(0x7f671809b200 msgr2=0x7f671809b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:10.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.757+0000 7f671cad4640 1 -- 172.21.15.97:0/48442867 shutdown_connections 2024-09-13T18:39:10.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.757+0000 7f671cad4640 1 -- 172.21.15.97:0/48442867 wait complete. 2024-09-13T18:39:10.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.757+0000 7f671cad4640 1 Processor -- start 2024-09-13T18:39:10.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.757+0000 7f671cad4640 1 -- start start 2024-09-13T18:39:10.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f671cad4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67180969d0 0x7f6718118af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f671cad4640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6718097690 0x7f6718119030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f671cad4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f671809dfb0 0x7f671813a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:10.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f671cad4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671809a5d0 con 0x7f67180969d0 2024-09-13T18:39:10.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f671cad4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6718097e10 con 0x7f671809dfb0 2024-09-13T18:39:10.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f671cad4640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f671811baf0 con 0x7f6718097690 2024-09-13T18:39:10.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f6716d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f671809dfb0 0x7f671813a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f671659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67180969d0 0x7f6718118af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f6716d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f671809dfb0 0x7f671813a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:33730/0 (socket says 172.21.15.97:33730) 2024-09-13T18:39:10.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f6716d9d640 1 -- 172.21.15.97:0/3326691904 learned_addr learned my addr 172.21.15.97:0/3326691904 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:10.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f6715d9b640 1 --2- 172.21.15.97:0/3326691904 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6718097690 0x7f6718119030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:10.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f6716d9d640 1 -- 172.21.15.97:0/3326691904 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6718097690 msgr2=0x7f6718119030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f6716d9d640 1 --2- 172.21.15.97:0/3326691904 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6718097690 0x7f6718119030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f6716d9d640 1 -- 172.21.15.97:0/3326691904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67180969d0 msgr2=0x7f6718118af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f6716d9d640 1 --2- 172.21.15.97:0/3326691904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67180969d0 0x7f6718118af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f6716d9d640 1 -- 172.21.15.97:0/3326691904 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6710009a20 con 0x7f671809dfb0 2024-09-13T18:39:10.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f671659c640 1 --2- 172.21.15.97:0/3326691904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67180969d0 0x7f6718118af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:10.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f6716d9d640 1 --2- 172.21.15.97:0/3326691904 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f671809dfb0 0x7f671813a470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6710009fc0 tx=0x7f671000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:10.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.758+0000 7f67067fc640 1 -- 172.21.15.97:0/3326691904 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671000ce70 con 0x7f671809dfb0 2024-09-13T18:39:10.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.759+0000 7f67067fc640 1 -- 172.21.15.97:0/3326691904 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671000f040 con 0x7f671809dfb0 2024-09-13T18:39:10.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.759+0000 7f671cad4640 1 -- 172.21.15.97:0/3326691904 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670c00b700 con 0x7f671809dfb0 2024-09-13T18:39:10.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.759+0000 7f67067fc640 1 -- 172.21.15.97:0/3326691904 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67100146d0 con 0x7f671809dfb0 2024-09-13T18:39:10.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.759+0000 7f671cad4640 1 -- 172.21.15.97:0/3326691904 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671811c4b0 con 0x7f671809dfb0 2024-09-13T18:39:10.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.759+0000 7f67067fc640 1 -- 172.21.15.97:0/3326691904 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f6710003020 con 0x7f671809dfb0 2024-09-13T18:39:10.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.760+0000 7f671cad4640 1 -- 172.21.15.97:0/3326691904 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671811b720 con 0x7f671809dfb0 2024-09-13T18:39:10.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.760+0000 7f67067fc640 1 -- 172.21.15.97:0/3326691904 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2864+0+0 (secure 0 0 0) 0x7f67100427c0 con 0x7f671809dfb0 2024-09-13T18:39:10.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.764+0000 7f67067fc640 1 -- 172.21.15.97:0/3326691904 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f6710018070 con 0x7f671809dfb0 2024-09-13T18:39:10.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.917+0000 7f671cad4640 1 -- 172.21.15.97:0/3326691904 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6718064000 con 0x7f671809dfb0 2024-09-13T18:39:10.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.918+0000 7f67067fc640 1 -- 172.21.15.97:0/3326691904 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8169 (secure 0 0 0) 0x7f67100133e0 con 0x7f671809dfb0 2024-09-13T18:39:10.921 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:10.921 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":16,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:09.520715+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:10.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.920+0000 7f671cad4640 1 -- 172.21.15.97:0/3326691904 >> v1:172.21.15.97:6816/34603 conn(0x7f66f8031160 legacy=0x7f66f8033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.920+0000 7f671cad4640 1 -- 172.21.15.97:0/3326691904 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f671809dfb0 msgr2=0x7f671813a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:10.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.920+0000 7f671cad4640 1 --2- 172.21.15.97:0/3326691904 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f671809dfb0 0x7f671813a470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6710009fc0 tx=0x7f671000b040 comp rx=0 tx=0).stop 2024-09-13T18:39:10.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.920+0000 7f671cad4640 1 -- 172.21.15.97:0/3326691904 shutdown_connections 2024-09-13T18:39:10.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.920+0000 7f671cad4640 1 --2- 172.21.15.97:0/3326691904 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f671809dfb0 0x7f671813a470 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.920+0000 7f671cad4640 1 --2- 172.21.15.97:0/3326691904 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6718097690 0x7f6718119030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.920+0000 7f671cad4640 1 --2- 172.21.15.97:0/3326691904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67180969d0 0x7f6718118af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:10.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.920+0000 7f671cad4640 1 -- 172.21.15.97:0/3326691904 >> 172.21.15.97:0/3326691904 conn(0x7f671809b200 msgr2=0x7f671806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:10.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.920+0000 7f671cad4640 1 -- 172.21.15.97:0/3326691904 shutdown_connections 2024-09-13T18:39:10.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:10.920+0000 7f671cad4640 1 -- 172.21.15.97:0/3326691904 wait complete. 2024-09-13T18:39:10.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:39:01.375967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T18:39:05.732412+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-09-13T18:39:10.933 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:39:11.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.025+0000 7f8398ee8640 1 Processor -- start 2024-09-13T18:39:11.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.025+0000 7f8398ee8640 1 -- start start 2024-09-13T18:39:11.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f8398ee8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 0x7f839409f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f8398ee8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f839409f800 0x7f839412f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f8398ee8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839409eb30 con 0x7f839412f900 2024-09-13T18:39:11.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f8398ee8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8394068eb0 con 0x7f839409f800 2024-09-13T18:39:11.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f8398ee8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8394069100 con 0x7f839409eef0 2024-09-13T18:39:11.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f839259c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 0x7f839409f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f8391d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f839409f800 0x7f839412f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f839259c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 0x7f839409f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:33742/0 (socket says 172.21.15.97:33742) 2024-09-13T18:39:11.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f839259c640 1 -- 172.21.15.97:0/4283427942 learned_addr learned my addr 172.21.15.97:0/4283427942 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:11.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f839259c640 1 -- 172.21.15.97:0/4283427942 >> v2:172.21.15.97:3300/0 conn(0x7f839409f800 msgr2=0x7f839412f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:11.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f839259c640 1 --2- 172.21.15.97:0/4283427942 >> v2:172.21.15.97:3300/0 conn(0x7f839409f800 0x7f839412f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f839259c640 1 -- 172.21.15.97:0/4283427942 >> v1:172.21.15.97:6789/0 conn(0x7f839412f900 legacy=0x7f8394136750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f839259c640 1 -- 172.21.15.97:0/4283427942 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839409fe80 con 0x7f839409eef0 2024-09-13T18:39:11.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.026+0000 7f8391d9b640 1 --2- 172.21.15.97:0/4283427942 >> v2:172.21.15.97:3300/0 conn(0x7f839409f800 0x7f839412f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:11.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.027+0000 7f839259c640 1 --2- 172.21.15.97:0/4283427942 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 0x7f839409f2c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8384009940 tx=0x7f83840091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6407b378db3bc44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:11.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.027+0000 7f839159a640 1 -- 172.21.15.97:0/4283427942 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838402ad20 con 0x7f839409eef0 2024-09-13T18:39:11.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.027+0000 7f839159a640 1 -- 172.21.15.97:0/4283427942 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838402ae80 con 0x7f839409eef0 2024-09-13T18:39:11.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.027+0000 7f839159a640 1 -- 172.21.15.97:0/4283427942 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384032670 con 0x7f839409eef0 2024-09-13T18:39:11.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.028+0000 7f8398ee8640 1 -- 172.21.15.97:0/4283427942 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 msgr2=0x7f839409f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.028+0000 7f8398ee8640 1 --2- 172.21.15.97:0/4283427942 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 0x7f839409f2c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8384009940 tx=0x7f83840091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.028+0000 7f8398ee8640 1 -- 172.21.15.97:0/4283427942 shutdown_connections 2024-09-13T18:39:11.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.028+0000 7f8398ee8640 1 --2- 172.21.15.97:0/4283427942 >> v2:172.21.15.97:3300/0 conn(0x7f839409f800 0x7f839412f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.028+0000 7f8398ee8640 1 --2- 172.21.15.97:0/4283427942 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 0x7f839409f2c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.028+0000 7f8398ee8640 1 -- 172.21.15.97:0/4283427942 >> 172.21.15.97:0/4283427942 conn(0x7f8394067b90 msgr2=0x7f83940a0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.028+0000 7f8398ee8640 1 -- 172.21.15.97:0/4283427942 shutdown_connections 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.028+0000 7f8398ee8640 1 -- 172.21.15.97:0/4283427942 wait complete. 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.029+0000 7f8398ee8640 1 Processor -- start 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.029+0000 7f8398ee8640 1 -- start start 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.029+0000 7f8398ee8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 0x7f839412c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.029+0000 7f8398ee8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f839409f800 0x7f8394118910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.029+0000 7f8398ee8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839412f900 0x7f8394118e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.029+0000 7f8398ee8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839411a930 con 0x7f839412f900 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.029+0000 7f8398ee8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839411a570 con 0x7f839409eef0 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.029+0000 7f8398ee8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f839411b300 con 0x7f839409f800 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.029+0000 7f839259c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 0x7f839412c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.029+0000 7f8391d9b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f839409f800 0x7f8394118910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.029+0000 7f839259c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 0x7f839412c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:33750/0 (socket says 172.21.15.97:33750) 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.029+0000 7f839259c640 1 -- 172.21.15.97:0/3401748864 learned_addr learned my addr 172.21.15.97:0/3401748864 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.029+0000 7f8392d9d640 1 --2- 172.21.15.97:0/3401748864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839412f900 0x7f8394118e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.030+0000 7f8391d9b640 1 -- 172.21.15.97:0/3401748864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 msgr2=0x7f839412c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.030+0000 7f8391d9b640 1 --2- 172.21.15.97:0/3401748864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 0x7f839412c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.030+0000 7f8391d9b640 1 -- 172.21.15.97:0/3401748864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839412f900 msgr2=0x7f8394118e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.030+0000 7f8391d9b640 1 --2- 172.21.15.97:0/3401748864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839412f900 0x7f8394118e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.030+0000 7f8391d9b640 1 -- 172.21.15.97:0/3401748864 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c009390 con 0x7f839409f800 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.030+0000 7f8392d9d640 1 --2- 172.21.15.97:0/3401748864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839412f900 0x7f8394118e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.030+0000 7f839259c640 1 --2- 172.21.15.97:0/3401748864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 0x7f839412c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.030+0000 7f8391d9b640 1 --2- 172.21.15.97:0/3401748864 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f839409f800 0x7f8394118910 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f837c00ea20 tx=0x7f837c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.030+0000 7f838a7fc640 1 -- 172.21.15.97:0/3401748864 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c009670 con 0x7f839409f800 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.030+0000 7f838a7fc640 1 -- 172.21.15.97:0/3401748864 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c00ca10 con 0x7f839409f800 2024-09-13T18:39:11.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.030+0000 7f8398ee8640 1 -- 172.21.15.97:0/3401748864 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8384009450 con 0x7f839409f800 2024-09-13T18:39:11.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.030+0000 7f838a7fc640 1 -- 172.21.15.97:0/3401748864 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00cdd0 con 0x7f839409f800 2024-09-13T18:39:11.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.030+0000 7f8398ee8640 1 -- 172.21.15.97:0/3401748864 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839406a260 con 0x7f839409f800 2024-09-13T18:39:11.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.031+0000 7f838a7fc640 1 -- 172.21.15.97:0/3401748864 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f837c013680 con 0x7f839409f800 2024-09-13T18:39:11.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.031+0000 7f838a7fc640 1 -- 172.21.15.97:0/3401748864 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2864+0+0 (secure 0 0 0) 0x7f837c041fc0 con 0x7f839409f800 2024-09-13T18:39:11.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.031+0000 7f8398ee8640 1 -- 172.21.15.97:0/3401748864 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8394068760 con 0x7f839409f800 2024-09-13T18:39:11.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.035+0000 7f838a7fc640 1 -- 172.21.15.97:0/3401748864 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f837c021020 con 0x7f839409f800 2024-09-13T18:39:11.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.186+0000 7f8398ee8640 1 -- 172.21.15.97:0/3401748864 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83940714b0 con 0x7f839409f800 2024-09-13T18:39:11.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.187+0000 7f838a7fc640 1 -- 172.21.15.97:0/3401748864 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f837c023ad0 con 0x7f839409f800 2024-09-13T18:39:11.189 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2024-09-13T18:39:11.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.189+0000 7f8398ee8640 1 -- 172.21.15.97:0/3401748864 >> v1:172.21.15.97:6816/34603 conn(0x7f8374031160 legacy=0x7f8374033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.189+0000 7f8398ee8640 1 -- 172.21.15.97:0/3401748864 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f839409f800 msgr2=0x7f8394118910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.189+0000 7f8398ee8640 1 --2- 172.21.15.97:0/3401748864 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f839409f800 0x7f8394118910 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f837c00ea20 tx=0x7f837c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.189+0000 7f8398ee8640 1 -- 172.21.15.97:0/3401748864 shutdown_connections 2024-09-13T18:39:11.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.189+0000 7f8398ee8640 1 --2- 172.21.15.97:0/3401748864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f839412f900 0x7f8394118e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.189+0000 7f8398ee8640 1 --2- 172.21.15.97:0/3401748864 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f839409f800 0x7f8394118910 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.189+0000 7f8398ee8640 1 --2- 172.21.15.97:0/3401748864 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f839409eef0 0x7f839412c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.189+0000 7f8398ee8640 1 -- 172.21.15.97:0/3401748864 >> 172.21.15.97:0/3401748864 conn(0x7f8394067b90 msgr2=0x7f839412e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:11.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.189+0000 7f8398ee8640 1 -- 172.21.15.97:0/3401748864 shutdown_connections 2024-09-13T18:39:11.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.189+0000 7f8398ee8640 1 -- 172.21.15.97:0/3401748864 wait complete. 2024-09-13T18:39:11.201 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-13T18:39:11.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.294+0000 7fcea9eb8640 1 Processor -- start 2024-09-13T18:39:11.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.294+0000 7fcea9eb8640 1 -- start start 2024-09-13T18:39:11.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea9eb8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcea4097260 0x7fcea4097630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea9eb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097b70 0x7fcea4097f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea9eb8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea406ead0 con 0x7fcea412fe70 2024-09-13T18:39:11.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea9eb8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4099900 con 0x7fcea4097b70 2024-09-13T18:39:11.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea9eb8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcea409a820 con 0x7fcea4097260 2024-09-13T18:39:11.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea37fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcea4097260 0x7fcea4097630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea2ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097b70 0x7fcea4097f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea2ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097b70 0x7fcea4097f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:33764/0 (socket says 172.21.15.97:33764) 2024-09-13T18:39:11.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea37fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcea4097260 0x7fcea4097630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59332/0 (socket says 172.21.15.97:59332) 2024-09-13T18:39:11.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea2ffd640 1 -- 172.21.15.97:0/3632078960 learned_addr learned my addr 172.21.15.97:0/3632078960 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:11.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea27fc640 1 -- 172.21.15.97:0/3632078960 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548681987 0 0) 0x7fcea406ead0 con 0x7fcea412fe70 2024-09-13T18:39:11.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea37fe640 1 -- 172.21.15.97:0/3632078960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097b70 msgr2=0x7fcea4097f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:11.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea37fe640 1 --2- 172.21.15.97:0/3632078960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097b70 0x7fcea4097f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea37fe640 1 -- 172.21.15.97:0/3632078960 >> v1:172.21.15.97:6789/0 conn(0x7fcea412fe70 legacy=0x7fcea4132250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea37fe640 1 -- 172.21.15.97:0/3632078960 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4098dd0 con 0x7fcea4097260 2024-09-13T18:39:11.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.295+0000 7fcea2ffd640 1 --2- 172.21.15.97:0/3632078960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097b70 0x7fcea4097f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:11.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.296+0000 7fcea37fe640 1 --2- 172.21.15.97:0/3632078960 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcea4097260 0x7fcea4097630 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fce94009880 tx=0x7fce940090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0c780ab308574f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:11.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.296+0000 7fcea27fc640 1 -- 172.21.15.97:0/3632078960 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9402ac50 con 0x7fcea4097260 2024-09-13T18:39:11.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.296+0000 7fcea27fc640 1 -- 172.21.15.97:0/3632078960 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9402adb0 con 0x7fcea4097260 2024-09-13T18:39:11.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.296+0000 7fcea27fc640 1 -- 172.21.15.97:0/3632078960 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94032670 con 0x7fcea4097260 2024-09-13T18:39:11.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.297+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3632078960 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcea4097260 msgr2=0x7fcea4097630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.297+0000 7fcea9eb8640 1 --2- 172.21.15.97:0/3632078960 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcea4097260 0x7fcea4097630 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fce94009880 tx=0x7fce940090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.297+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3632078960 shutdown_connections 2024-09-13T18:39:11.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.297+0000 7fcea9eb8640 1 --2- 172.21.15.97:0/3632078960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097b70 0x7fcea4097f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.297+0000 7fcea9eb8640 1 --2- 172.21.15.97:0/3632078960 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcea4097260 0x7fcea4097630 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.297+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3632078960 >> 172.21.15.97:0/3632078960 conn(0x7fcea409b170 msgr2=0x7fcea409b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.297+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3632078960 shutdown_connections 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.297+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3632078960 wait complete. 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea9eb8640 1 Processor -- start 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea9eb8640 1 -- start start 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea9eb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097260 0x7fcea4118cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea9eb8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcea4097b70 0x7fcea4114f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea9eb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcea412fe70 0x7fcea4115440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea9eb8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea41177f0 con 0x7fcea412fe70 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea9eb8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4116df0 con 0x7fcea4097260 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea9eb8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4117060 con 0x7fcea4097b70 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea37fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097260 0x7fcea4118cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea2ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcea4097b70 0x7fcea4114f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcea412fe70 0x7fcea4115440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea37fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097260 0x7fcea4118cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:33778/0 (socket says 172.21.15.97:33778) 2024-09-13T18:39:11.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea37fe640 1 -- 172.21.15.97:0/3214659884 learned_addr learned my addr 172.21.15.97:0/3214659884 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:11.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea37fe640 1 -- 172.21.15.97:0/3214659884 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcea4097b70 msgr2=0x7fcea4114f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea37fe640 1 --2- 172.21.15.97:0/3214659884 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcea4097b70 0x7fcea4114f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea37fe640 1 -- 172.21.15.97:0/3214659884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcea412fe70 msgr2=0x7fcea4115440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea37fe640 1 --2- 172.21.15.97:0/3214659884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcea412fe70 0x7fcea4115440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea37fe640 1 -- 172.21.15.97:0/3214659884 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98009450 con 0x7fcea4097260 2024-09-13T18:39:11.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea3fff640 1 --2- 172.21.15.97:0/3214659884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcea412fe70 0x7fcea4115440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:11.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.298+0000 7fcea2ffd640 1 --2- 172.21.15.97:0/3214659884 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcea4097b70 0x7fcea4114f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:11.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.299+0000 7fcea37fe640 1 --2- 172.21.15.97:0/3214659884 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097260 0x7fcea4118cf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fce94009880 tx=0x7fce94032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:11.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.299+0000 7fce8b7fe640 1 -- 172.21.15.97:0/3214659884 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9403d720 con 0x7fcea4097260 2024-09-13T18:39:11.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.299+0000 7fce8b7fe640 1 -- 172.21.15.97:0/3214659884 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9403d880 con 0x7fcea4097260 2024-09-13T18:39:11.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.299+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3214659884 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce94009390 con 0x7fcea4097260 2024-09-13T18:39:11.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.299+0000 7fce8b7fe640 1 -- 172.21.15.97:0/3214659884 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9403dc20 con 0x7fcea4097260 2024-09-13T18:39:11.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.299+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3214659884 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea4115980 con 0x7fcea4097260 2024-09-13T18:39:11.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.300+0000 7fce8b7fe640 1 -- 172.21.15.97:0/3214659884 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fce94039040 con 0x7fcea4097260 2024-09-13T18:39:11.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.300+0000 7fce8b7fe640 1 -- 172.21.15.97:0/3214659884 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2864+0+0 (secure 0 0 0) 0x7fce94061940 con 0x7fcea4097260 2024-09-13T18:39:11.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.300+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3214659884 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea40714b0 con 0x7fcea4097260 2024-09-13T18:39:11.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.304+0000 7fce8b7fe640 1 -- 172.21.15.97:0/3214659884 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fce94037070 con 0x7fcea4097260 2024-09-13T18:39:11.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.455+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3214659884 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcea409f4e0 con 0x7fcea4097260 2024-09-13T18:39:11.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.456+0000 7fce8b7fe640 1 -- 172.21.15.97:0/3214659884 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fce94042030 con 0x7fcea4097260 2024-09-13T18:39:11.459 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 8 2024-09-13T18:39:11.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.457+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3214659884 >> v1:172.21.15.97:6816/34603 conn(0x7fce90031160 legacy=0x7fce90033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.457+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3214659884 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097260 msgr2=0x7fcea4118cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.457+0000 7fcea9eb8640 1 --2- 172.21.15.97:0/3214659884 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097260 0x7fcea4118cf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fce94009880 tx=0x7fce94032000 comp rx=0 tx=0).stop 2024-09-13T18:39:11.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.457+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3214659884 shutdown_connections 2024-09-13T18:39:11.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.457+0000 7fcea9eb8640 1 --2- 172.21.15.97:0/3214659884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcea412fe70 0x7fcea4115440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.457+0000 7fcea9eb8640 1 --2- 172.21.15.97:0/3214659884 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcea4097b70 0x7fcea4114f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.457+0000 7fcea9eb8640 1 --2- 172.21.15.97:0/3214659884 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcea4097260 0x7fcea4118cf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.457+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3214659884 >> 172.21.15.97:0/3214659884 conn(0x7fcea409b170 msgr2=0x7fcea406cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:11.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.458+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3214659884 shutdown_connections 2024-09-13T18:39:11.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.458+0000 7fcea9eb8640 1 -- 172.21.15.97:0/3214659884 wait complete. 2024-09-13T18:39:11.471 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:39:11.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.563+0000 7fa5914d4640 1 Processor -- start 2024-09-13T18:39:11.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.563+0000 7fa5914d4640 1 -- start start 2024-09-13T18:39:11.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa5914d4640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 0x7fa58c09ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa5914d4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa58c09d820 0x7fa58c12d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa5914d4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58c06eed0 con 0x7fa58c09d410 2024-09-13T18:39:11.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa5914d4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c06b550 con 0x7fa58c09d820 2024-09-13T18:39:11.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa5914d4640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c06a6c0 con 0x7fa58c06b180 2024-09-13T18:39:11.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa58affd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 0x7fa58c09ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa58b7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa58c09d820 0x7fa58c12d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa58affd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 0x7fa58c09ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59356/0 (socket says 172.21.15.97:59356) 2024-09-13T18:39:11.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa58affd640 1 -- 172.21.15.97:0/1924493069 learned_addr learned my addr 172.21.15.97:0/1924493069 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:11.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa58affd640 1 -- 172.21.15.97:0/1924493069 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa58c09d820 msgr2=0x7fa58c12d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:11.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa58affd640 1 --2- 172.21.15.97:0/1924493069 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa58c09d820 0x7fa58c12d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa58affd640 1 -- 172.21.15.97:0/1924493069 >> v1:172.21.15.97:6789/0 conn(0x7fa58c09d410 legacy=0x7fa58c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa589ffb640 1 -- 172.21.15.97:0/1924493069 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462181059 0 0) 0x7fa58c06eed0 con 0x7fa58c09d410 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa58affd640 1 -- 172.21.15.97:0/1924493069 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c09ded0 con 0x7fa58c06b180 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.564+0000 7fa58b7fe640 1 --2- 172.21.15.97:0/1924493069 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa58c09d820 0x7fa58c12d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.565+0000 7fa58affd640 1 --2- 172.21.15.97:0/1924493069 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 0x7fa58c09ced0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009940 tx=0x7fa57c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7317c853f064a295 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.565+0000 7fa589ffb640 1 -- 172.21.15.97:0/1924493069 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c02ad00 con 0x7fa58c06b180 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.565+0000 7fa589ffb640 1 -- 172.21.15.97:0/1924493069 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c02ae60 con 0x7fa58c06b180 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.565+0000 7fa589ffb640 1 -- 172.21.15.97:0/1924493069 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c032670 con 0x7fa58c06b180 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.565+0000 7fa5914d4640 1 -- 172.21.15.97:0/1924493069 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 msgr2=0x7fa58c09ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.565+0000 7fa5914d4640 1 --2- 172.21.15.97:0/1924493069 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 0x7fa58c09ced0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009940 tx=0x7fa57c0091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.565+0000 7fa5914d4640 1 -- 172.21.15.97:0/1924493069 shutdown_connections 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.565+0000 7fa5914d4640 1 --2- 172.21.15.97:0/1924493069 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa58c09d820 0x7fa58c12d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.565+0000 7fa5914d4640 1 --2- 172.21.15.97:0/1924493069 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 0x7fa58c09ced0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.565+0000 7fa5914d4640 1 -- 172.21.15.97:0/1924493069 >> 172.21.15.97:0/1924493069 conn(0x7fa58c09b310 msgr2=0x7fa58c09b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:11.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.565+0000 7fa5914d4640 1 -- 172.21.15.97:0/1924493069 shutdown_connections 2024-09-13T18:39:11.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.565+0000 7fa5914d4640 1 -- 172.21.15.97:0/1924493069 wait complete. 2024-09-13T18:39:11.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.566+0000 7fa5914d4640 1 Processor -- start 2024-09-13T18:39:11.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.566+0000 7fa5914d4640 1 -- start start 2024-09-13T18:39:11.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa5914d4640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 0x7fa58c13c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa5914d4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa58c09d410 0x7fa58c13cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa5914d4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa58c09d820 0x7fa58c1164f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa5914d4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c069d40 con 0x7fa58c09d410 2024-09-13T18:39:11.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa5914d4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c1179b0 con 0x7fa58c09d820 2024-09-13T18:39:11.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa5914d4640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c12c650 con 0x7fa58c06b180 2024-09-13T18:39:11.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa58affd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 0x7fa58c13c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa58b7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa58c09d820 0x7fa58c1164f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa58a7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa58c09d410 0x7fa58c13cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa58affd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 0x7fa58c13c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59364/0 (socket says 172.21.15.97:59364) 2024-09-13T18:39:11.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa58affd640 1 -- 172.21.15.97:0/4145118861 learned_addr learned my addr 172.21.15.97:0/4145118861 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:11.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa58affd640 1 -- 172.21.15.97:0/4145118861 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa58c09d820 msgr2=0x7fa58c1164f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa58affd640 1 --2- 172.21.15.97:0/4145118861 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa58c09d820 0x7fa58c1164f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa58affd640 1 -- 172.21.15.97:0/4145118861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa58c09d410 msgr2=0x7fa58c13cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa58affd640 1 --2- 172.21.15.97:0/4145118861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa58c09d410 0x7fa58c13cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa58affd640 1 -- 172.21.15.97:0/4145118861 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa584009a20 con 0x7fa58c06b180 2024-09-13T18:39:11.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa58b7fe640 1 --2- 172.21.15.97:0/4145118861 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa58c09d820 0x7fa58c1164f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:11.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa58a7fc640 1 --2- 172.21.15.97:0/4145118861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa58c09d410 0x7fa58c13cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:11.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.567+0000 7fa58affd640 1 --2- 172.21.15.97:0/4145118861 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 0x7fa58c13c9b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa57c02a630 tx=0x7fa57c032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:11.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.568+0000 7fa572ffd640 1 -- 172.21.15.97:0/4145118861 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c03b900 con 0x7fa58c06b180 2024-09-13T18:39:11.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.568+0000 7fa572ffd640 1 -- 172.21.15.97:0/4145118861 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c03ba60 con 0x7fa58c06b180 2024-09-13T18:39:11.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.568+0000 7fa572ffd640 1 -- 172.21.15.97:0/4145118861 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c03be20 con 0x7fa58c06b180 2024-09-13T18:39:11.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.568+0000 7fa5914d4640 1 -- 172.21.15.97:0/4145118861 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57c009450 con 0x7fa58c06b180 2024-09-13T18:39:11.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.568+0000 7fa5914d4640 1 -- 172.21.15.97:0/4145118861 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58c117ef0 con 0x7fa58c06b180 2024-09-13T18:39:11.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.568+0000 7fa572ffd640 1 -- 172.21.15.97:0/4145118861 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fa57c04f450 con 0x7fa58c06b180 2024-09-13T18:39:11.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.569+0000 7fa572ffd640 1 -- 172.21.15.97:0/4145118861 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2864+0+0 (secure 0 0 0) 0x7fa57c065f30 con 0x7fa58c06b180 2024-09-13T18:39:11.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.569+0000 7fa5914d4640 1 -- 172.21.15.97:0/4145118861 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58c064000 con 0x7fa58c06b180 2024-09-13T18:39:11.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.573+0000 7fa572ffd640 1 -- 172.21.15.97:0/4145118861 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fa57c037070 con 0x7fa58c06b180 2024-09-13T18:39:11.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.725+0000 7fa5914d4640 1 -- 172.21.15.97:0/4145118861 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa58c0008d0 con 0x7fa58c06b180 2024-09-13T18:39:11.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.726+0000 7fa572ffd640 1 -- 172.21.15.97:0/4145118861 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa57c037030 con 0x7fa58c06b180 2024-09-13T18:39:11.729 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:11.729 INFO:teuthology.orchestra.run.smithi097.stdout:[ 2024-09-13T18:39:11.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-13T18:39:11.729 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 1, 2024-09-13T18:39:11.729 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": ".mgr" 2024-09-13T18:39:11.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-13T18:39:11.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-13T18:39:11.729 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 2, 2024-09-13T18:39:11.729 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": "rbd" 2024-09-13T18:39:11.729 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-13T18:39:11.730 INFO:teuthology.orchestra.run.smithi097.stdout:] 2024-09-13T18:39:11.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.728+0000 7fa5914d4640 1 -- 172.21.15.97:0/4145118861 >> v1:172.21.15.97:6816/34603 conn(0x7fa578031160 legacy=0x7fa578033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.728+0000 7fa5914d4640 1 -- 172.21.15.97:0/4145118861 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 msgr2=0x7fa58c13c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.728+0000 7fa5914d4640 1 --2- 172.21.15.97:0/4145118861 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 0x7fa58c13c9b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa57c02a630 tx=0x7fa57c032000 comp rx=0 tx=0).stop 2024-09-13T18:39:11.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.728+0000 7fa5914d4640 1 -- 172.21.15.97:0/4145118861 shutdown_connections 2024-09-13T18:39:11.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.728+0000 7fa5914d4640 1 --2- 172.21.15.97:0/4145118861 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa58c09d820 0x7fa58c1164f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.728+0000 7fa5914d4640 1 --2- 172.21.15.97:0/4145118861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa58c09d410 0x7fa58c13cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.728+0000 7fa5914d4640 1 --2- 172.21.15.97:0/4145118861 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa58c06b180 0x7fa58c13c9b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.728+0000 7fa5914d4640 1 -- 172.21.15.97:0/4145118861 >> 172.21.15.97:0/4145118861 conn(0x7fa58c09b310 msgr2=0x7fa58c130370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:11.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.728+0000 7fa5914d4640 1 -- 172.21.15.97:0/4145118861 shutdown_connections 2024-09-13T18:39:11.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.728+0000 7fa5914d4640 1 -- 172.21.15.97:0/4145118861 wait complete. 2024-09-13T18:39:11.741 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:39:11.741 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:39:11.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.834+0000 7f18bfee8640 1 Processor -- start 2024-09-13T18:39:11.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.834+0000 7f18bfee8640 1 -- start start 2024-09-13T18:39:11.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18bfee8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f18b809c420 0x7f18b8097770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18bfee8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f18b809b4f0 0x7f18b81371a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18bfee8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b80959f0 con 0x7f18b809a9d0 2024-09-13T18:39:11.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18bfee8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b809c7f0 con 0x7f18b809b4f0 2024-09-13T18:39:11.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18bfee8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18b805e6e0 con 0x7f18b809c420 2024-09-13T18:39:11.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18be485640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f18b809b4f0 0x7f18b81371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18bdc84640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f18b809c420 0x7f18b8097770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18be485640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f18b809b4f0 0x7f18b81371a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40784/0 (socket says 172.21.15.97:40784) 2024-09-13T18:39:11.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18bdc84640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f18b809c420 0x7f18b8097770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59380/0 (socket says 172.21.15.97:59380) 2024-09-13T18:39:11.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18be485640 1 -- 172.21.15.97:0/2549288448 learned_addr learned my addr 172.21.15.97:0/2549288448 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:11.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18bd483640 1 --1- 172.21.15.97:0/2549288448 >> v1:172.21.15.97:6789/0 conn(0x7f18b809a9d0 0x7f18b809ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:36020/0 (socket says 172.21.15.97:36020) 2024-09-13T18:39:11.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18be485640 1 -- 172.21.15.97:0/2549288448 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f18b809c420 msgr2=0x7f18b8097770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:11.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18be485640 1 --2- 172.21.15.97:0/2549288448 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f18b809c420 0x7f18b8097770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18be485640 1 -- 172.21.15.97:0/2549288448 >> v1:172.21.15.97:6789/0 conn(0x7f18b809a9d0 legacy=0x7f18b809ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18bcc82640 1 -- 172.21.15.97:0/2549288448 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412881290 0 0) 0x7f18b80959f0 con 0x7f18b809a9d0 2024-09-13T18:39:11.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.835+0000 7f18be485640 1 -- 172.21.15.97:0/2549288448 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b805df70 con 0x7f18b809b4f0 2024-09-13T18:39:11.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.836+0000 7f18be485640 1 --2- 172.21.15.97:0/2549288448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18b809b4f0 0x7f18b81371a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009f20 tx=0x7f18b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1787a9733952fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:11.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.836+0000 7f18bcc82640 1 -- 172.21.15.97:0/2549288448 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0031400 con 0x7f18b809b4f0 2024-09-13T18:39:11.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.836+0000 7f18bcc82640 1 -- 172.21.15.97:0/2549288448 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b002d050 con 0x7f18b809b4f0 2024-09-13T18:39:11.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.836+0000 7f18bcc82640 1 -- 172.21.15.97:0/2549288448 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0031790 con 0x7f18b809b4f0 2024-09-13T18:39:11.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.837+0000 7f18bfee8640 1 -- 172.21.15.97:0/2549288448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18b809b4f0 msgr2=0x7f18b81371a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.837+0000 7f18bfee8640 1 --2- 172.21.15.97:0/2549288448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18b809b4f0 0x7f18b81371a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009f20 tx=0x7f18b0009840 comp rx=0 tx=0).stop 2024-09-13T18:39:11.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.837+0000 7f18bfee8640 1 -- 172.21.15.97:0/2549288448 shutdown_connections 2024-09-13T18:39:11.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.837+0000 7f18bfee8640 1 --2- 172.21.15.97:0/2549288448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18b809b4f0 0x7f18b81371a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.837+0000 7f18bfee8640 1 --2- 172.21.15.97:0/2549288448 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f18b809c420 0x7f18b8097770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.837+0000 7f18bfee8640 1 -- 172.21.15.97:0/2549288448 >> 172.21.15.97:0/2549288448 conn(0x7f18b809fa90 msgr2=0x7f18b809bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:11.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.837+0000 7f18bfee8640 1 -- 172.21.15.97:0/2549288448 shutdown_connections 2024-09-13T18:39:11.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.837+0000 7f18bfee8640 1 -- 172.21.15.97:0/2549288448 wait complete. 2024-09-13T18:39:11.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bfee8640 1 Processor -- start 2024-09-13T18:39:11.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bfee8640 1 -- start start 2024-09-13T18:39:11.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bfee8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18b809a9d0 0x7f18b8093c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bfee8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f18b809b4f0 0x7f18b80949a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bfee8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18b809c420 0x7f18b8094ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:11.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bfee8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8091d60 con 0x7f18b809c420 2024-09-13T18:39:11.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bfee8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80985a0 con 0x7f18b809a9d0 2024-09-13T18:39:11.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bfee8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80966e0 con 0x7f18b809b4f0 2024-09-13T18:39:11.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bd483640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f18b809b4f0 0x7f18b80949a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bdc84640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18b809a9d0 0x7f18b8093c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18be485640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18b809c420 0x7f18b8094ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:11.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bd483640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f18b809b4f0 0x7f18b80949a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59388/0 (socket says 172.21.15.97:59388) 2024-09-13T18:39:11.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18be485640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18b809c420 0x7f18b8094ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40788/0 (socket says 172.21.15.97:40788) 2024-09-13T18:39:11.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bd483640 1 -- 172.21.15.97:0/3356652212 learned_addr learned my addr 172.21.15.97:0/3356652212 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:11.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bd483640 1 -- 172.21.15.97:0/3356652212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18b809a9d0 msgr2=0x7f18b8093c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bd483640 1 --2- 172.21.15.97:0/3356652212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18b809a9d0 0x7f18b8093c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bd483640 1 -- 172.21.15.97:0/3356652212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18b809c420 msgr2=0x7f18b8094ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:11.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bd483640 1 --2- 172.21.15.97:0/3356652212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18b809c420 0x7f18b8094ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:11.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.838+0000 7f18bd483640 1 -- 172.21.15.97:0/3356652212 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b0009ae0 con 0x7f18b809b4f0 2024-09-13T18:39:11.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.839+0000 7f18bd483640 1 --2- 172.21.15.97:0/3356652212 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f18b809b4f0 0x7f18b80949a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18a800c610 tx=0x7f18a8007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:11.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.839+0000 7f18adffb640 1 -- 172.21.15.97:0/3356652212 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8007300 con 0x7f18b809b4f0 2024-09-13T18:39:11.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.839+0000 7f18adffb640 1 -- 172.21.15.97:0/3356652212 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a8007480 con 0x7f18b809b4f0 2024-09-13T18:39:11.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.839+0000 7f18bfee8640 1 -- 172.21.15.97:0/3356652212 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b80934c0 con 0x7f18b809b4f0 2024-09-13T18:39:11.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.839+0000 7f18adffb640 1 -- 172.21.15.97:0/3356652212 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80049f0 con 0x7f18b809b4f0 2024-09-13T18:39:11.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.839+0000 7f18bfee8640 1 -- 172.21.15.97:0/3356652212 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b8091820 con 0x7f18b809b4f0 2024-09-13T18:39:11.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.840+0000 7f18adffb640 1 -- 172.21.15.97:0/3356652212 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f18a801c3b0 con 0x7f18b809b4f0 2024-09-13T18:39:11.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.840+0000 7f18adffb640 1 -- 172.21.15.97:0/3356652212 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2864+0+0 (secure 0 0 0) 0x7f18a80411e0 con 0x7f18b809b4f0 2024-09-13T18:39:11.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.840+0000 7f18bfee8640 1 -- 172.21.15.97:0/3356652212 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b8064000 con 0x7f18b809b4f0 2024-09-13T18:39:11.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.844+0000 7f18adffb640 1 -- 172.21.15.97:0/3356652212 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f18a8018070 con 0x7f18b809b4f0 2024-09-13T18:39:11.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:11.996+0000 7f18bfee8640 1 -- 172.21.15.97:0/3356652212 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f18b809e150 con 0x7f18b809b4f0 2024-09-13T18:39:12.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.547+0000 7f18adffb640 1 -- 172.21.15.97:0/3356652212 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f18a801c660 con 0x7f18b809b4f0 2024-09-13T18:39:12.550 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' created 2024-09-13T18:39:12.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.552+0000 7f18bfee8640 1 -- 172.21.15.97:0/3356652212 >> v1:172.21.15.97:6816/34603 conn(0x7f189c031160 legacy=0x7f189c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:12.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.552+0000 7f18bfee8640 1 -- 172.21.15.97:0/3356652212 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f18b809b4f0 msgr2=0x7f18b80949a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:12.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.552+0000 7f18bfee8640 1 --2- 172.21.15.97:0/3356652212 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f18b809b4f0 0x7f18b80949a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18a800c610 tx=0x7f18a8007d50 comp rx=0 tx=0).stop 2024-09-13T18:39:12.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.552+0000 7f18bfee8640 1 -- 172.21.15.97:0/3356652212 shutdown_connections 2024-09-13T18:39:12.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.552+0000 7f18bfee8640 1 --2- 172.21.15.97:0/3356652212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f18b809c420 0x7f18b8094ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:12.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.552+0000 7f18bfee8640 1 --2- 172.21.15.97:0/3356652212 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f18b809b4f0 0x7f18b80949a0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18a800c610 tx=0x7f18a8007d50 comp rx=0 tx=0).stop 2024-09-13T18:39:12.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.552+0000 7f18bfee8640 1 --2- 172.21.15.97:0/3356652212 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f18b809a9d0 0x7f18b8093c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:12.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.552+0000 7f18bfee8640 1 -- 172.21.15.97:0/3356652212 >> 172.21.15.97:0/3356652212 conn(0x7f18b809fa90 msgr2=0x7f18b806c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:12.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.553+0000 7f18bfee8640 1 -- 172.21.15.97:0/3356652212 shutdown_connections 2024-09-13T18:39:12.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.553+0000 7f18bfee8640 1 -- 172.21.15.97:0/3356652212 wait complete. 2024-09-13T18:39:12.567 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:39:12.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.667+0000 7f3d56b9d640 1 Processor -- start 2024-09-13T18:39:12.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.667+0000 7f3d56b9d640 1 -- start start 2024-09-13T18:39:12.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.667+0000 7f3d56b9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3d5012d480 0x7f3d5012d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:12.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d56b9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3d50067820 0x7f3d50135640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:12.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d56b9d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5009c0a0 con 0x7f3d5012dd90 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d56b9d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5012e1d0 con 0x7f3d5012d480 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d56b9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5009a7e0 con 0x7f3d50067820 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d54939640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3d5012d480 0x7f3d5012d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d5513a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3d50067820 0x7f3d50135640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d54939640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3d5012d480 0x7f3d5012d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40792/0 (socket says 172.21.15.97:40792) 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d54939640 1 -- 172.21.15.97:0/2020364128 learned_addr learned my addr 172.21.15.97:0/2020364128 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d5513a640 1 -- 172.21.15.97:0/2020364128 >> v2:172.21.15.97:3300/0 conn(0x7f3d5012d480 msgr2=0x7f3d5012d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d5513a640 1 --2- 172.21.15.97:0/2020364128 >> v2:172.21.15.97:3300/0 conn(0x7f3d5012d480 0x7f3d5012d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d5513a640 1 -- 172.21.15.97:0/2020364128 >> v1:172.21.15.97:6789/0 conn(0x7f3d5012dd90 legacy=0x7f3d50067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d5513a640 1 -- 172.21.15.97:0/2020364128 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5009ad20 con 0x7f3d50067820 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d477fe640 1 -- 172.21.15.97:0/2020364128 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109538257 0 0) 0x7f3d5009c0a0 con 0x7f3d5012dd90 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.668+0000 7f3d54939640 1 --2- 172.21.15.97:0/2020364128 >> v2:172.21.15.97:3300/0 conn(0x7f3d5012d480 0x7f3d5012d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.669+0000 7f3d5513a640 1 --2- 172.21.15.97:0/2020364128 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3d50067820 0x7f3d50135640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009e60 tx=0x7f3d48009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=401198a5863418a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:12.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.669+0000 7f3d477fe640 1 -- 172.21.15.97:0/2020364128 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48007550 con 0x7f3d50067820 2024-09-13T18:39:12.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.669+0000 7f3d477fe640 1 -- 172.21.15.97:0/2020364128 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4802d050 con 0x7f3d50067820 2024-09-13T18:39:12.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.669+0000 7f3d477fe640 1 -- 172.21.15.97:0/2020364128 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d480078e0 con 0x7f3d50067820 2024-09-13T18:39:12.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.669+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2020364128 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3d50067820 msgr2=0x7f3d50135640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:12.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.669+0000 7f3d56b9d640 1 --2- 172.21.15.97:0/2020364128 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3d50067820 0x7f3d50135640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009e60 tx=0x7f3d48009780 comp rx=0 tx=0).stop 2024-09-13T18:39:12.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.669+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2020364128 shutdown_connections 2024-09-13T18:39:12.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.669+0000 7f3d56b9d640 1 --2- 172.21.15.97:0/2020364128 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3d50067820 0x7f3d50135640 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:12.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.669+0000 7f3d56b9d640 1 --2- 172.21.15.97:0/2020364128 >> v2:172.21.15.97:3300/0 conn(0x7f3d5012d480 0x7f3d5012d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:12.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.669+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2020364128 >> 172.21.15.97:0/2020364128 conn(0x7f3d5009ff50 msgr2=0x7f3d5009c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:12.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.669+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2020364128 shutdown_connections 2024-09-13T18:39:12.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.669+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2020364128 wait complete. 2024-09-13T18:39:12.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.670+0000 7f3d56b9d640 1 Processor -- start 2024-09-13T18:39:12.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.670+0000 7f3d56b9d640 1 -- start start 2024-09-13T18:39:12.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d56b9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d50067820 0x7f3d5013c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:12.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d56b9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d5012d480 0x7f3d5013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d56b9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3d5012dd90 0x7f3d5013d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d56b9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5011a970 con 0x7f3d50067820 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d56b9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5011b850 con 0x7f3d5012d480 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d56b9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5011bdb0 con 0x7f3d5012dd90 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d54939640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d50067820 0x7f3d5013c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d54939640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d50067820 0x7f3d5013c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40804/0 (socket says 172.21.15.97:40804) 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d54939640 1 -- 172.21.15.97:0/2813746564 learned_addr learned my addr 172.21.15.97:0/2813746564 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d47fff640 1 --2- 172.21.15.97:0/2813746564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d5012d480 0x7f3d5013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d5513a640 1 --2- 172.21.15.97:0/2813746564 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3d5012dd90 0x7f3d5013d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d54939640 1 -- 172.21.15.97:0/2813746564 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3d5012dd90 msgr2=0x7f3d5013d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d54939640 1 --2- 172.21.15.97:0/2813746564 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3d5012dd90 0x7f3d5013d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d54939640 1 -- 172.21.15.97:0/2813746564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d5012d480 msgr2=0x7f3d5013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d54939640 1 --2- 172.21.15.97:0/2813746564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d5012d480 0x7f3d5013cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:12.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d54939640 1 -- 172.21.15.97:0/2813746564 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c009450 con 0x7f3d50067820 2024-09-13T18:39:12.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d5513a640 1 --2- 172.21.15.97:0/2813746564 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3d5012dd90 0x7f3d5013d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:12.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d54939640 1 --2- 172.21.15.97:0/2813746564 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d50067820 0x7f3d5013c960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00ec80 tx=0x7f3d4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:12.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.671+0000 7f3d44ff9640 1 -- 172.21.15.97:0/2813746564 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00eec0 con 0x7f3d50067820 2024-09-13T18:39:12.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.672+0000 7f3d44ff9640 1 -- 172.21.15.97:0/2813746564 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c00cbc0 con 0x7f3d50067820 2024-09-13T18:39:12.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.672+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2813746564 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d48009a20 con 0x7f3d50067820 2024-09-13T18:39:12.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.672+0000 7f3d44ff9640 1 -- 172.21.15.97:0/2813746564 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c013470 con 0x7f3d50067820 2024-09-13T18:39:12.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.672+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2813746564 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d500994d0 con 0x7f3d50067820 2024-09-13T18:39:12.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.672+0000 7f3d44ff9640 1 -- 172.21.15.97:0/2813746564 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f3d4c013820 con 0x7f3d50067820 2024-09-13T18:39:12.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.672+0000 7f3d44ff9640 1 -- 172.21.15.97:0/2813746564 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3206+0+0 (secure 0 0 0) 0x7f3d4c042640 con 0x7f3d50067820 2024-09-13T18:39:12.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.672+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2813746564 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5012d2f0 con 0x7f3d50067820 2024-09-13T18:39:12.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.677+0000 7f3d44ff9640 1 -- 172.21.15.97:0/2813746564 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f3d4c021070 con 0x7f3d50067820 2024-09-13T18:39:12.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:12.826+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2813746564 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3d50064000 con 0x7f3d50067820 2024-09-13T18:39:13.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.558+0000 7f3d44ff9640 1 -- 172.21.15.97:0/2813746564 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3d4c01b770 con 0x7f3d50067820 2024-09-13T18:39:13.561 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' created 2024-09-13T18:39:13.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.564+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2813746564 >> v1:172.21.15.97:6816/34603 conn(0x7f3d3c031160 legacy=0x7f3d3c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:13.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.564+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2813746564 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d50067820 msgr2=0x7f3d5013c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:13.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.564+0000 7f3d56b9d640 1 --2- 172.21.15.97:0/2813746564 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d50067820 0x7f3d5013c960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00ec80 tx=0x7f3d4c0091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:13.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.568+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2813746564 shutdown_connections 2024-09-13T18:39:13.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.568+0000 7f3d56b9d640 1 --2- 172.21.15.97:0/2813746564 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3d5012dd90 0x7f3d5013d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:13.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.568+0000 7f3d56b9d640 1 --2- 172.21.15.97:0/2813746564 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3d5012d480 0x7f3d5013cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:13.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.568+0000 7f3d56b9d640 1 --2- 172.21.15.97:0/2813746564 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d50067820 0x7f3d5013c960 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:13.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.568+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2813746564 >> 172.21.15.97:0/2813746564 conn(0x7f3d5009ff50 msgr2=0x7f3d50130400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:13.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.570+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2813746564 shutdown_connections 2024-09-13T18:39:13.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.570+0000 7f3d56b9d640 1 -- 172.21.15.97:0/2813746564 wait complete. 2024-09-13T18:39:13.593 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:39:13.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.690+0000 7f6a8f99d640 1 Processor -- start 2024-09-13T18:39:13.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.690+0000 7f6a8f99d640 1 -- start start 2024-09-13T18:39:13.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8f99d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6a8809bd80 0x7f6a88134950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:13.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8f99d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a88134e90 0x7f6a88137270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:13.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8f99d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a88068d90 con 0x7f6a8809b2a0 2024-09-13T18:39:13.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8f99d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8809d250 con 0x7f6a8809bd80 2024-09-13T18:39:13.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8f99d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a880681b0 con 0x7f6a88134e90 2024-09-13T18:39:13.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8d739640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6a8809b2a0 0x7f6a8809b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:36050/0 (socket says 172.21.15.97:36050) 2024-09-13T18:39:13.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8d739640 1 -- 172.21.15.97:0/3320083865 learned_addr learned my addr 172.21.15.97:0/3320083865 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:13.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8cf38640 1 --2- 172.21.15.97:0/3320083865 >> v2:172.21.15.97:3300/0 conn(0x7f6a8809bd80 0x7f6a88134950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:13.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8df3a640 1 --2- 172.21.15.97:0/3320083865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a88134e90 0x7f6a88137270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:13.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8df3a640 1 -- 172.21.15.97:0/3320083865 >> v2:172.21.15.97:3300/0 conn(0x7f6a8809bd80 msgr2=0x7f6a88134950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:13.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8df3a640 1 --2- 172.21.15.97:0/3320083865 >> v2:172.21.15.97:3300/0 conn(0x7f6a8809bd80 0x7f6a88134950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:13.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8df3a640 1 -- 172.21.15.97:0/3320083865 >> v1:172.21.15.97:6789/0 conn(0x7f6a8809b2a0 legacy=0x7f6a8809b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:13.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a7ffff640 1 -- 172.21.15.97:0/3320083865 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739971275 0 0) 0x7f6a88068d90 con 0x7f6a8809b2a0 2024-09-13T18:39:13.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8df3a640 1 -- 172.21.15.97:0/3320083865 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8809cae0 con 0x7f6a88134e90 2024-09-13T18:39:13.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.691+0000 7f6a8cf38640 1 --2- 172.21.15.97:0/3320083865 >> v2:172.21.15.97:3300/0 conn(0x7f6a8809bd80 0x7f6a88134950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:13.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.692+0000 7f6a8df3a640 1 --2- 172.21.15.97:0/3320083865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a88134e90 0x7f6a88137270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009e60 tx=0x7f6a80009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b64f0cdb2670907f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:13.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.692+0000 7f6a7ffff640 1 -- 172.21.15.97:0/3320083865 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80007550 con 0x7f6a88134e90 2024-09-13T18:39:13.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.692+0000 7f6a7ffff640 1 -- 172.21.15.97:0/3320083865 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8002d050 con 0x7f6a88134e90 2024-09-13T18:39:13.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.692+0000 7f6a7ffff640 1 -- 172.21.15.97:0/3320083865 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a800078e0 con 0x7f6a88134e90 2024-09-13T18:39:13.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.692+0000 7f6a8f99d640 1 -- 172.21.15.97:0/3320083865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a88134e90 msgr2=0x7f6a88137270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:13.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.692+0000 7f6a8f99d640 1 --2- 172.21.15.97:0/3320083865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a88134e90 0x7f6a88137270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009e60 tx=0x7f6a80009780 comp rx=0 tx=0).stop 2024-09-13T18:39:13.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.693+0000 7f6a8f99d640 1 -- 172.21.15.97:0/3320083865 shutdown_connections 2024-09-13T18:39:13.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.693+0000 7f6a8f99d640 1 --2- 172.21.15.97:0/3320083865 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a88134e90 0x7f6a88137270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:13.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.693+0000 7f6a8f99d640 1 --2- 172.21.15.97:0/3320083865 >> v2:172.21.15.97:3300/0 conn(0x7f6a8809bd80 0x7f6a88134950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:13.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.693+0000 7f6a8f99d640 1 -- 172.21.15.97:0/3320083865 >> 172.21.15.97:0/3320083865 conn(0x7f6a88067b90 msgr2=0x7f6a880a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:13.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.693+0000 7f6a8f99d640 1 -- 172.21.15.97:0/3320083865 shutdown_connections 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.693+0000 7f6a8f99d640 1 -- 172.21.15.97:0/3320083865 wait complete. 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.693+0000 7f6a8f99d640 1 Processor -- start 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.693+0000 7f6a8f99d640 1 -- start start 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8f99d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a8809b2a0 0x7f6a8813e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8f99d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a8809bd80 0x7f6a8813eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8f99d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a88134e90 0x7f6a8813f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8f99d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8811a000 con 0x7f6a88134e90 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8f99d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a881173e0 con 0x7f6a8809bd80 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8f99d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8811aa30 con 0x7f6a8809b2a0 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8d739640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a8809b2a0 0x7f6a8813e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8cf38640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a8809bd80 0x7f6a8813eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8cf38640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a8809bd80 0x7f6a8813eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:33822/0 (socket says 172.21.15.97:33822) 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8cf38640 1 -- 172.21.15.97:0/560579647 learned_addr learned my addr 172.21.15.97:0/560579647 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8df3a640 1 --2- 172.21.15.97:0/560579647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a88134e90 0x7f6a8813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:13.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8d739640 1 -- 172.21.15.97:0/560579647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a8809bd80 msgr2=0x7f6a8813eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:13.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8d739640 1 --2- 172.21.15.97:0/560579647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a8809bd80 0x7f6a8813eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:13.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8d739640 1 -- 172.21.15.97:0/560579647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a88134e90 msgr2=0x7f6a8813f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:13.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8d739640 1 --2- 172.21.15.97:0/560579647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a88134e90 0x7f6a8813f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:13.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.694+0000 7f6a8d739640 1 -- 172.21.15.97:0/560579647 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a78009390 con 0x7f6a8809b2a0 2024-09-13T18:39:13.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.695+0000 7f6a8d739640 1 --2- 172.21.15.97:0/560579647 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a8809b2a0 0x7f6a8813e5e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400c410 tx=0x7f6a84007ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:13.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.695+0000 7f6a7d7fa640 1 -- 172.21.15.97:0/560579647 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84005aa0 con 0x7f6a8809b2a0 2024-09-13T18:39:13.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.695+0000 7f6a7d7fa640 1 -- 172.21.15.97:0/560579647 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a84005c20 con 0x7f6a8809b2a0 2024-09-13T18:39:13.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.695+0000 7f6a8f99d640 1 -- 172.21.15.97:0/560579647 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a80009a20 con 0x7f6a8809b2a0 2024-09-13T18:39:13.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.695+0000 7f6a7d7fa640 1 -- 172.21.15.97:0/560579647 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84007320 con 0x7f6a8809b2a0 2024-09-13T18:39:13.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.695+0000 7f6a8f99d640 1 -- 172.21.15.97:0/560579647 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a88118cf0 con 0x7f6a8809b2a0 2024-09-13T18:39:13.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.695+0000 7f6a7d7fa640 1 -- 172.21.15.97:0/560579647 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f6a8401b3b0 con 0x7f6a8809b2a0 2024-09-13T18:39:13.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.696+0000 7f6a7d7fa640 1 -- 172.21.15.97:0/560579647 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3588+0+0 (secure 0 0 0) 0x7f6a84041340 con 0x7f6a8809b2a0 2024-09-13T18:39:13.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.696+0000 7f6a8f99d640 1 -- 172.21.15.97:0/560579647 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a88064000 con 0x7f6a8809b2a0 2024-09-13T18:39:13.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.700+0000 7f6a7d7fa640 1 -- 172.21.15.97:0/560579647 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f6a84017070 con 0x7f6a8809b2a0 2024-09-13T18:39:13.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:13.883+0000 7f6a8f99d640 1 -- 172.21.15.97:0/560579647 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6a880008d0 con 0x7f6a8809b2a0 2024-09-13T18:39:14.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.556+0000 7f6a7d7fa640 1 -- 172.21.15.97:0/560579647 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6a84005e10 con 0x7f6a8809b2a0 2024-09-13T18:39:14.561 INFO:teuthology.orchestra.run.smithi097.stderr:new fs with metadata pool 3 and data pool 4 2024-09-13T18:39:14.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.567+0000 7f6a8f99d640 1 -- 172.21.15.97:0/560579647 >> v1:172.21.15.97:6816/34603 conn(0x7f6a6c031160 legacy=0x7f6a6c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:14.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.567+0000 7f6a8f99d640 1 -- 172.21.15.97:0/560579647 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a8809b2a0 msgr2=0x7f6a8813e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:14.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.567+0000 7f6a8f99d640 1 --2- 172.21.15.97:0/560579647 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a8809b2a0 0x7f6a8813e5e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400c410 tx=0x7f6a84007ea0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.568+0000 7f6a8f99d640 1 -- 172.21.15.97:0/560579647 shutdown_connections 2024-09-13T18:39:14.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.568+0000 7f6a8f99d640 1 --2- 172.21.15.97:0/560579647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a88134e90 0x7f6a8813f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.568+0000 7f6a8f99d640 1 --2- 172.21.15.97:0/560579647 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a8809bd80 0x7f6a8813eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.568+0000 7f6a8f99d640 1 --2- 172.21.15.97:0/560579647 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a8809b2a0 0x7f6a8813e5e0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400c410 tx=0x7f6a84007ea0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.568+0000 7f6a8f99d640 1 -- 172.21.15.97:0/560579647 >> 172.21.15.97:0/560579647 conn(0x7f6a88067b90 msgr2=0x7f6a8812f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:14.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.572+0000 7f6a8f99d640 1 -- 172.21.15.97:0/560579647 shutdown_connections 2024-09-13T18:39:14.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.574+0000 7f6a8f99d640 1 -- 172.21.15.97:0/560579647 wait complete. 2024-09-13T18:39:14.599 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:14.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.692+0000 7f55b6f5d640 1 Processor -- start 2024-09-13T18:39:14.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.692+0000 7f55b6f5d640 1 -- start start 2024-09-13T18:39:14.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55b6f5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b00a1290 0x7f55b012d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:14.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55b6f5d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f55b012d7c0 0x7f55b012db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:14.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55b6f5d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f55b009b2a0 0x7f55b009b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:14.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55b6f5d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b006ee70 con 0x7f55b009b2a0 2024-09-13T18:39:14.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55b6f5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b006da40 con 0x7f55b00a1290 2024-09-13T18:39:14.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55b6f5d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55b012e0d0 con 0x7f55b012d7c0 2024-09-13T18:39:14.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55b4cf9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b00a1290 0x7f55b012d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:14.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55b54fa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f55b009b2a0 0x7f55b009b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:14.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55affff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f55b012d7c0 0x7f55b012db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:14.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55b4cf9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b00a1290 0x7f55b012d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:33832/0 (socket says 172.21.15.97:33832) 2024-09-13T18:39:14.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55b4cf9640 1 -- 172.21.15.97:0/1042985139 learned_addr learned my addr 172.21.15.97:0/1042985139 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:14.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55affff640 1 -- 172.21.15.97:0/1042985139 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b00a1290 msgr2=0x7f55b012d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:14.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55affff640 1 --2- 172.21.15.97:0/1042985139 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b00a1290 0x7f55b012d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55affff640 1 -- 172.21.15.97:0/1042985139 >> v2:172.21.15.97:3300/0 conn(0x7f55b009b2a0 msgr2=0x7f55b009b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:14.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55affff640 1 --2- 172.21.15.97:0/1042985139 >> v2:172.21.15.97:3300/0 conn(0x7f55b009b2a0 0x7f55b009b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55affff640 1 -- 172.21.15.97:0/1042985139 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b009cd30 con 0x7f55b012d7c0 2024-09-13T18:39:14.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55b54fa640 1 --2- 172.21.15.97:0/1042985139 >> v2:172.21.15.97:3300/0 conn(0x7f55b009b2a0 0x7f55b009b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:14.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.693+0000 7f55b4cf9640 1 --2- 172.21.15.97:0/1042985139 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b00a1290 0x7f55b012d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:14.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.694+0000 7f55affff640 1 --2- 172.21.15.97:0/1042985139 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f55b012d7c0 0x7f55b012db90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009880 tx=0x7f55a40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7142996dd1f65b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:14.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.694+0000 7f55af7fe640 1 -- 172.21.15.97:0/1042985139 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a402abc0 con 0x7f55b012d7c0 2024-09-13T18:39:14.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.694+0000 7f55af7fe640 1 -- 172.21.15.97:0/1042985139 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a402ad20 con 0x7f55b012d7c0 2024-09-13T18:39:14.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.694+0000 7f55af7fe640 1 -- 172.21.15.97:0/1042985139 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4032670 con 0x7f55b012d7c0 2024-09-13T18:39:14.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.695+0000 7f55b6f5d640 1 -- 172.21.15.97:0/1042985139 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f55b012d7c0 msgr2=0x7f55b012db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:14.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.695+0000 7f55b6f5d640 1 --2- 172.21.15.97:0/1042985139 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f55b012d7c0 0x7f55b012db90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009880 tx=0x7f55a40090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.695+0000 7f55b6f5d640 1 -- 172.21.15.97:0/1042985139 shutdown_connections 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.695+0000 7f55b6f5d640 1 --2- 172.21.15.97:0/1042985139 >> v2:172.21.15.97:3300/0 conn(0x7f55b009b2a0 0x7f55b009b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.695+0000 7f55b6f5d640 1 --2- 172.21.15.97:0/1042985139 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f55b012d7c0 0x7f55b012db90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.695+0000 7f55b6f5d640 1 --2- 172.21.15.97:0/1042985139 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b00a1290 0x7f55b012d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.695+0000 7f55b6f5d640 1 -- 172.21.15.97:0/1042985139 >> 172.21.15.97:0/1042985139 conn(0x7f55b0067820 msgr2=0x7f55b00a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.695+0000 7f55b6f5d640 1 -- 172.21.15.97:0/1042985139 shutdown_connections 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.695+0000 7f55b6f5d640 1 -- 172.21.15.97:0/1042985139 wait complete. 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.695+0000 7f55b6f5d640 1 Processor -- start 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b6f5d640 1 -- start start 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b6f5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b009b2a0 0x7f55b012a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b6f5d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55b00a1290 0x7f55b01198d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b6f5d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f55b012d7c0 0x7f55b0119e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b6f5d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b011d340 con 0x7f55b00a1290 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b6f5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b011b4a0 con 0x7f55b009b2a0 2024-09-13T18:39:14.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b6f5d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55b009f490 con 0x7f55b012d7c0 2024-09-13T18:39:14.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b4cf9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b009b2a0 0x7f55b012a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:14.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b54fa640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f55b012d7c0 0x7f55b0119e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:14.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55affff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55b00a1290 0x7f55b01198d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:14.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b4cf9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b009b2a0 0x7f55b012a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:33842/0 (socket says 172.21.15.97:33842) 2024-09-13T18:39:14.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b4cf9640 1 -- 172.21.15.97:0/950633669 learned_addr learned my addr 172.21.15.97:0/950633669 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:14.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b54fa640 1 -- 172.21.15.97:0/950633669 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b009b2a0 msgr2=0x7f55b012a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:14.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b54fa640 1 --2- 172.21.15.97:0/950633669 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b009b2a0 0x7f55b012a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b54fa640 1 -- 172.21.15.97:0/950633669 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55b00a1290 msgr2=0x7f55b01198d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:14.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.696+0000 7f55b54fa640 1 --2- 172.21.15.97:0/950633669 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55b00a1290 0x7f55b01198d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.697+0000 7f55b54fa640 1 -- 172.21.15.97:0/950633669 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a8009a20 con 0x7f55b012d7c0 2024-09-13T18:39:14.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.697+0000 7f55b4cf9640 1 --2- 172.21.15.97:0/950633669 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b009b2a0 0x7f55b012a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:14.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.697+0000 7f55affff640 1 --2- 172.21.15.97:0/950633669 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55b00a1290 0x7f55b01198d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:14.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.697+0000 7f55b54fa640 1 --2- 172.21.15.97:0/950633669 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f55b012d7c0 0x7f55b0119e10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009f10 tx=0x7f55a800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:14.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.697+0000 7f55acff9640 1 -- 172.21.15.97:0/950633669 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a800cdb0 con 0x7f55b012d7c0 2024-09-13T18:39:14.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.697+0000 7f55acff9640 1 -- 172.21.15.97:0/950633669 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a800f040 con 0x7f55b012d7c0 2024-09-13T18:39:14.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.697+0000 7f55b6f5d640 1 -- 172.21.15.97:0/950633669 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a0009450 con 0x7f55b012d7c0 2024-09-13T18:39:14.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.697+0000 7f55acff9640 1 -- 172.21.15.97:0/950633669 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80146d0 con 0x7f55b012d7c0 2024-09-13T18:39:14.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.697+0000 7f55b6f5d640 1 -- 172.21.15.97:0/950633669 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a4009390 con 0x7f55b012d7c0 2024-09-13T18:39:14.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.698+0000 7f55acff9640 1 -- 172.21.15.97:0/950633669 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f55a8003020 con 0x7f55b012d7c0 2024-09-13T18:39:14.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.698+0000 7f55acff9640 1 -- 172.21.15.97:0/950633669 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f55a8042960 con 0x7f55b012d7c0 2024-09-13T18:39:14.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.698+0000 7f55b6f5d640 1 -- 172.21.15.97:0/950633669 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b011bc80 con 0x7f55b012d7c0 2024-09-13T18:39:14.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.702+0000 7f55acff9640 1 -- 172.21.15.97:0/950633669 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f55a8018020 con 0x7f55b012d7c0 2024-09-13T18:39:14.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.855+0000 7f55b6f5d640 1 -- 172.21.15.97:0/950633669 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55b0064600 con 0x7f55b012d7c0 2024-09-13T18:39:14.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.856+0000 7f55acff9640 1 -- 172.21.15.97:0/950633669 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11356 (secure 0 0 0) 0x7f55a80133e0 con 0x7f55b012d7c0 2024-09-13T18:39:14.858 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:14.858 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":19,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:13.885361+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:14.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.858+0000 7f55b6f5d640 1 -- 172.21.15.97:0/950633669 >> v1:172.21.15.97:6816/34603 conn(0x7f559c031190 legacy=0x7f559c033640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:14.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.858+0000 7f55b6f5d640 1 -- 172.21.15.97:0/950633669 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f55b012d7c0 msgr2=0x7f55b0119e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:14.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.858+0000 7f55b6f5d640 1 --2- 172.21.15.97:0/950633669 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f55b012d7c0 0x7f55b0119e10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009f10 tx=0x7f55a800b040 comp rx=0 tx=0).stop 2024-09-13T18:39:14.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.858+0000 7f55b6f5d640 1 -- 172.21.15.97:0/950633669 shutdown_connections 2024-09-13T18:39:14.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.858+0000 7f55b6f5d640 1 --2- 172.21.15.97:0/950633669 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f55b012d7c0 0x7f55b0119e10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.858+0000 7f55b6f5d640 1 --2- 172.21.15.97:0/950633669 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55b00a1290 0x7f55b01198d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.858+0000 7f55b6f5d640 1 --2- 172.21.15.97:0/950633669 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f55b009b2a0 0x7f55b012a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.858+0000 7f55b6f5d640 1 -- 172.21.15.97:0/950633669 >> 172.21.15.97:0/950633669 conn(0x7f55b0067820 msgr2=0x7f55b012cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:14.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.858+0000 7f55b6f5d640 1 -- 172.21.15.97:0/950633669 shutdown_connections 2024-09-13T18:39:14.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.858+0000 7f55b6f5d640 1 -- 172.21.15.97:0/950633669 wait complete. 2024-09-13T18:39:14.871 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.965+0000 7f1b9139d640 1 Processor -- start 2024-09-13T18:39:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.965+0000 7f1b9139d640 1 -- start start 2024-09-13T18:39:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.965+0000 7f1b9139d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8c09dfb0 0x7f1b8c096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.965+0000 7f1b9139d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b8c0974c0 0x7f1b8c12c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.965+0000 7f1b9139d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8c06a190 con 0x7f1b8c0969d0 2024-09-13T18:39:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.965+0000 7f1b9139d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8c09e380 con 0x7f1b8c0974c0 2024-09-13T18:39:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.965+0000 7f1b9139d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c098870 con 0x7f1b8c09dfb0 2024-09-13T18:39:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.966+0000 7f1b8affd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8c09dfb0 0x7f1b8c096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.966+0000 7f1b8b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1b8c0974c0 0x7f1b8c12c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:14.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.966+0000 7f1b8a7fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1b8c0969d0 0x7f1b8c12bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:36062/0 (socket says 172.21.15.97:36062) 2024-09-13T18:39:14.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.966+0000 7f1b8a7fc640 1 -- 172.21.15.97:0/3702702547 learned_addr learned my addr 172.21.15.97:0/3702702547 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:14.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.966+0000 7f1b8affd640 1 --2- 172.21.15.97:0/3702702547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8c09dfb0 0x7f1b8c096f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:33850/0 (socket says 172.21.15.97:33850) 2024-09-13T18:39:14.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.966+0000 7f1b8b7fe640 1 -- 172.21.15.97:0/3702702547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8c09dfb0 msgr2=0x7f1b8c096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:14.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.966+0000 7f1b8b7fe640 1 --2- 172.21.15.97:0/3702702547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8c09dfb0 0x7f1b8c096f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.966+0000 7f1b8b7fe640 1 -- 172.21.15.97:0/3702702547 >> v1:172.21.15.97:6789/0 conn(0x7f1b8c0969d0 legacy=0x7f1b8c12bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:14.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.966+0000 7f1b8b7fe640 1 -- 172.21.15.97:0/3702702547 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c097960 con 0x7f1b8c0974c0 2024-09-13T18:39:14.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.966+0000 7f1b89ffb640 1 -- 172.21.15.97:0/3702702547 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374983938 0 0) 0x7f1b8c06a190 con 0x7f1b8c0969d0 2024-09-13T18:39:14.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.966+0000 7f1b8affd640 1 --2- 172.21.15.97:0/3702702547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8c09dfb0 0x7f1b8c096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:14.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.967+0000 7f1b8b7fe640 1 --2- 172.21.15.97:0/3702702547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8c0974c0 0x7f1b8c12c680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009e90 tx=0x7f1b84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c045b67040856216 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:14.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.967+0000 7f1b89ffb640 1 -- 172.21.15.97:0/3702702547 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8402aea0 con 0x7f1b8c0974c0 2024-09-13T18:39:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.967+0000 7f1b89ffb640 1 -- 172.21.15.97:0/3702702547 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8402d050 con 0x7f1b8c0974c0 2024-09-13T18:39:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.967+0000 7f1b89ffb640 1 -- 172.21.15.97:0/3702702547 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84007780 con 0x7f1b8c0974c0 2024-09-13T18:39:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.967+0000 7f1b9139d640 1 -- 172.21.15.97:0/3702702547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8c0974c0 msgr2=0x7f1b8c12c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.967+0000 7f1b9139d640 1 --2- 172.21.15.97:0/3702702547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8c0974c0 0x7f1b8c12c680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009e90 tx=0x7f1b84009780 comp rx=0 tx=0).stop 2024-09-13T18:39:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.967+0000 7f1b9139d640 1 -- 172.21.15.97:0/3702702547 shutdown_connections 2024-09-13T18:39:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.967+0000 7f1b9139d640 1 --2- 172.21.15.97:0/3702702547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8c0974c0 0x7f1b8c12c680 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.967+0000 7f1b9139d640 1 --2- 172.21.15.97:0/3702702547 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8c09dfb0 0x7f1b8c096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.967+0000 7f1b9139d640 1 -- 172.21.15.97:0/3702702547 >> 172.21.15.97:0/3702702547 conn(0x7f1b8c09b200 msgr2=0x7f1b8c09b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.967+0000 7f1b9139d640 1 -- 172.21.15.97:0/3702702547 shutdown_connections 2024-09-13T18:39:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.967+0000 7f1b9139d640 1 -- 172.21.15.97:0/3702702547 wait complete. 2024-09-13T18:39:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.968+0000 7f1b9139d640 1 Processor -- start 2024-09-13T18:39:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.968+0000 7f1b9139d640 1 -- start start 2024-09-13T18:39:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b9139d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8c0969d0 0x7f1b8c12bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b9139d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1b8c0974c0 0x7f1b8c12c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b9139d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8c09dfb0 0x7f1b8c11b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b9139d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c11e420 con 0x7f1b8c0969d0 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b9139d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c11f5a0 con 0x7f1b8c09dfb0 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b9139d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c06a580 con 0x7f1b8c0974c0 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b8affd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8c0969d0 0x7f1b8c12bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b8a7fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1b8c0974c0 0x7f1b8c12c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b8b7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8c09dfb0 0x7f1b8c11b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b8affd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8c0969d0 0x7f1b8c12bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40854/0 (socket says 172.21.15.97:40854) 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b8affd640 1 -- 172.21.15.97:0/1088977188 learned_addr learned my addr 172.21.15.97:0/1088977188 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b8affd640 1 -- 172.21.15.97:0/1088977188 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1b8c0974c0 msgr2=0x7f1b8c12c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b8affd640 1 --2- 172.21.15.97:0/1088977188 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1b8c0974c0 0x7f1b8c12c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b8affd640 1 -- 172.21.15.97:0/1088977188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8c09dfb0 msgr2=0x7f1b8c11b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b8affd640 1 --2- 172.21.15.97:0/1088977188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8c09dfb0 0x7f1b8c11b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b8affd640 1 -- 172.21.15.97:0/1088977188 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c009390 con 0x7f1b8c0969d0 2024-09-13T18:39:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b8a7fc640 1 --2- 172.21.15.97:0/1088977188 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1b8c0974c0 0x7f1b8c12c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b8affd640 1 --2- 172.21.15.97:0/1088977188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8c0969d0 0x7f1b8c12bac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c010e90 tx=0x7f1b7c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b72ffd640 1 -- 172.21.15.97:0/1088977188 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c011450 con 0x7f1b8c0969d0 2024-09-13T18:39:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b72ffd640 1 -- 172.21.15.97:0/1088977188 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c0115b0 con 0x7f1b8c0969d0 2024-09-13T18:39:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b9139d640 1 -- 172.21.15.97:0/1088977188 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b84009a20 con 0x7f1b8c0969d0 2024-09-13T18:39:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b72ffd640 1 -- 172.21.15.97:0/1088977188 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c011950 con 0x7f1b8c0969d0 2024-09-13T18:39:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.969+0000 7f1b9139d640 1 -- 172.21.15.97:0/1088977188 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8c11f110 con 0x7f1b8c0969d0 2024-09-13T18:39:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.970+0000 7f1b72ffd640 1 -- 172.21.15.97:0/1088977188 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f1b7c011cc0 con 0x7f1b8c0969d0 2024-09-13T18:39:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.970+0000 7f1b9139d640 1 -- 172.21.15.97:0/1088977188 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8c11e640 con 0x7f1b8c0969d0 2024-09-13T18:39:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.970+0000 7f1b72ffd640 1 -- 172.21.15.97:0/1088977188 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f1b7c0445b0 con 0x7f1b8c0969d0 2024-09-13T18:39:14.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:14.975+0000 7f1b72ffd640 1 -- 172.21.15.97:0/1088977188 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f1b7c017aa0 con 0x7f1b8c0969d0 2024-09-13T18:39:15.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.127+0000 7f1b9139d640 1 -- 172.21.15.97:0/1088977188 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b8c064000 con 0x7f1b8c0969d0 2024-09-13T18:39:15.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.128+0000 7f1b72ffd640 1 -- 172.21.15.97:0/1088977188 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+11343 (secure 0 0 0) 0x7f1b7c01e070 con 0x7f1b8c0969d0 2024-09-13T18:39:15.130 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:15.130 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:14.949504+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:15.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.129+0000 7f1b9139d640 1 -- 172.21.15.97:0/1088977188 >> v1:172.21.15.97:6816/34603 conn(0x7f1b78031160 legacy=0x7f1b78033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:15.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.129+0000 7f1b9139d640 1 -- 172.21.15.97:0/1088977188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8c0969d0 msgr2=0x7f1b8c12bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:15.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.129+0000 7f1b9139d640 1 --2- 172.21.15.97:0/1088977188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8c0969d0 0x7f1b8c12bac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c010e90 tx=0x7f1b7c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.129+0000 7f1b9139d640 1 -- 172.21.15.97:0/1088977188 shutdown_connections 2024-09-13T18:39:15.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.129+0000 7f1b9139d640 1 --2- 172.21.15.97:0/1088977188 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1b8c09dfb0 0x7f1b8c11b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.129+0000 7f1b9139d640 1 --2- 172.21.15.97:0/1088977188 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1b8c0974c0 0x7f1b8c12c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.129+0000 7f1b9139d640 1 --2- 172.21.15.97:0/1088977188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1b8c0969d0 0x7f1b8c12bac0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.129+0000 7f1b9139d640 1 -- 172.21.15.97:0/1088977188 >> 172.21.15.97:0/1088977188 conn(0x7f1b8c09b200 msgr2=0x7f1b8c114d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:15.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.130+0000 7f1b9139d640 1 -- 172.21.15.97:0/1088977188 shutdown_connections 2024-09-13T18:39:15.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.130+0000 7f1b9139d640 1 -- 172.21.15.97:0/1088977188 wait complete. 2024-09-13T18:39:15.145 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:39:15.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.238+0000 7fb14f080640 1 Processor -- start 2024-09-13T18:39:15.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.238+0000 7fb14f080640 1 -- start start 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb14f080640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb148067110 0x7fb14809a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb14f080640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14809ab50 0x7fb14812f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb14f080640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb14809af20 0x7fb14812fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb14f080640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1480674e0 con 0x7fb148067110 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb14f080640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14809b640 con 0x7fb14809ab50 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb14f080640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb148067b30 con 0x7fb14809af20 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb14ce1c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb148067110 0x7fb14809a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb13ffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14809ab50 0x7fb14812f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb14ce1c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb148067110 0x7fb14809a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40866/0 (socket says 172.21.15.97:40866) 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb14ce1c640 1 -- 172.21.15.97:0/4065827869 learned_addr learned my addr 172.21.15.97:0/4065827869 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb14d61d640 1 --2- 172.21.15.97:0/4065827869 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb14809af20 0x7fb14812fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb13ffff640 1 -- 172.21.15.97:0/4065827869 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb14809af20 msgr2=0x7fb14812fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb13ffff640 1 --2- 172.21.15.97:0/4065827869 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb14809af20 0x7fb14812fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb13ffff640 1 -- 172.21.15.97:0/4065827869 >> v2:172.21.15.97:3300/0 conn(0x7fb148067110 msgr2=0x7fb14809a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:15.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb13ffff640 1 --2- 172.21.15.97:0/4065827869 >> v2:172.21.15.97:3300/0 conn(0x7fb148067110 0x7fb14809a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb13ffff640 1 -- 172.21.15.97:0/4065827869 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb148067f20 con 0x7fb14809ab50 2024-09-13T18:39:15.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.239+0000 7fb14ce1c640 1 --2- 172.21.15.97:0/4065827869 >> v2:172.21.15.97:3300/0 conn(0x7fb148067110 0x7fb14809a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:15.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.240+0000 7fb13ffff640 1 --2- 172.21.15.97:0/4065827869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14809ab50 0x7fb14812f6d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb138009850 tx=0x7fb1380090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de291bcf4122787 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:15.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.240+0000 7fb13f7fe640 1 -- 172.21.15.97:0/4065827869 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13802ac50 con 0x7fb14809ab50 2024-09-13T18:39:15.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.240+0000 7fb13f7fe640 1 -- 172.21.15.97:0/4065827869 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13802adb0 con 0x7fb14809ab50 2024-09-13T18:39:15.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.240+0000 7fb13f7fe640 1 -- 172.21.15.97:0/4065827869 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138032670 con 0x7fb14809ab50 2024-09-13T18:39:15.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.240+0000 7fb14f080640 1 -- 172.21.15.97:0/4065827869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14809ab50 msgr2=0x7fb14812f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:15.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.240+0000 7fb14f080640 1 --2- 172.21.15.97:0/4065827869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14809ab50 0x7fb14812f6d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb138009850 tx=0x7fb1380090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.241+0000 7fb14f080640 1 -- 172.21.15.97:0/4065827869 shutdown_connections 2024-09-13T18:39:15.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.241+0000 7fb14f080640 1 --2- 172.21.15.97:0/4065827869 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb14809af20 0x7fb14812fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.241+0000 7fb14f080640 1 --2- 172.21.15.97:0/4065827869 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14809ab50 0x7fb14812f6d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.241+0000 7fb14f080640 1 --2- 172.21.15.97:0/4065827869 >> v2:172.21.15.97:3300/0 conn(0x7fb148067110 0x7fb14809a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.241+0000 7fb14f080640 1 -- 172.21.15.97:0/4065827869 >> 172.21.15.97:0/4065827869 conn(0x7fb14809f790 msgr2=0x7fb14809fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:15.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.241+0000 7fb14f080640 1 -- 172.21.15.97:0/4065827869 shutdown_connections 2024-09-13T18:39:15.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.241+0000 7fb14f080640 1 -- 172.21.15.97:0/4065827869 wait complete. 2024-09-13T18:39:15.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.241+0000 7fb14f080640 1 Processor -- start 2024-09-13T18:39:15.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.241+0000 7fb14f080640 1 -- start start 2024-09-13T18:39:15.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14f080640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb148067110 0x7fb148132720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:15.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14f080640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb14809ab50 0x7fb148132c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:15.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14f080640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14809af20 0x7fb14813ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:15.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14f080640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14809bb10 con 0x7fb148067110 2024-09-13T18:39:15.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14f080640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14809de10 con 0x7fb14809af20 2024-09-13T18:39:15.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14f080640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb14811ad90 con 0x7fb14809ab50 2024-09-13T18:39:15.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14ce1c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb148067110 0x7fb148132720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:15.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14ce1c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb148067110 0x7fb148132720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40880/0 (socket says 172.21.15.97:40880) 2024-09-13T18:39:15.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb13ffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb14809ab50 0x7fb148132c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:15.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14ce1c640 1 -- 172.21.15.97:0/1837398164 learned_addr learned my addr 172.21.15.97:0/1837398164 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:15.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14d61d640 1 --2- 172.21.15.97:0/1837398164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14809af20 0x7fb14813ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:15.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14d61d640 1 -- 172.21.15.97:0/1837398164 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb14809ab50 msgr2=0x7fb148132c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:15.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14d61d640 1 --2- 172.21.15.97:0/1837398164 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb14809ab50 0x7fb148132c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14d61d640 1 -- 172.21.15.97:0/1837398164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb148067110 msgr2=0x7fb148132720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:15.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14d61d640 1 --2- 172.21.15.97:0/1837398164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb148067110 0x7fb148132720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14d61d640 1 -- 172.21.15.97:0/1837398164 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb144009450 con 0x7fb14809af20 2024-09-13T18:39:15.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14ce1c640 1 --2- 172.21.15.97:0/1837398164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb148067110 0x7fb148132720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:15.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.242+0000 7fb14d61d640 1 --2- 172.21.15.97:0/1837398164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14809af20 0x7fb14813ec50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb140009e20 tx=0x7fb14000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:15.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.243+0000 7fb13cff9640 1 -- 172.21.15.97:0/1837398164 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14000cd40 con 0x7fb14809af20 2024-09-13T18:39:15.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.243+0000 7fb13cff9640 1 -- 172.21.15.97:0/1837398164 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14000f040 con 0x7fb14809af20 2024-09-13T18:39:15.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.243+0000 7fb14f080640 1 -- 172.21.15.97:0/1837398164 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb138009390 con 0x7fb14809af20 2024-09-13T18:39:15.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.243+0000 7fb13cff9640 1 -- 172.21.15.97:0/1837398164 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1400146d0 con 0x7fb14809af20 2024-09-13T18:39:15.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.243+0000 7fb14f080640 1 -- 172.21.15.97:0/1837398164 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14811ca70 con 0x7fb14809af20 2024-09-13T18:39:15.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.243+0000 7fb13cff9640 1 -- 172.21.15.97:0/1837398164 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fb140014a40 con 0x7fb14809af20 2024-09-13T18:39:15.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.244+0000 7fb13cff9640 1 -- 172.21.15.97:0/1837398164 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7fb140042d10 con 0x7fb14809af20 2024-09-13T18:39:15.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.244+0000 7fb14f080640 1 -- 172.21.15.97:0/1837398164 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb148064000 con 0x7fb14809af20 2024-09-13T18:39:15.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.248+0000 7fb13cff9640 1 -- 172.21.15.97:0/1837398164 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fb140018020 con 0x7fb14809af20 2024-09-13T18:39:15.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.433+0000 7fb14f080640 1 -- 172.21.15.97:0/1837398164 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb14806f720 con 0x7fb14809af20 2024-09-13T18:39:15.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.565+0000 7fb13cff9640 1 -- 172.21.15.97:0/1837398164 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v4) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb140024300 con 0x7fb14809af20 2024-09-13T18:39:15.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.567+0000 7fb14f080640 1 -- 172.21.15.97:0/1837398164 >> v1:172.21.15.97:6816/34603 conn(0x7fb134031160 legacy=0x7fb134033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:15.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.567+0000 7fb14f080640 1 -- 172.21.15.97:0/1837398164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14809af20 msgr2=0x7fb14813ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:15.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.567+0000 7fb14f080640 1 --2- 172.21.15.97:0/1837398164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14809af20 0x7fb14813ec50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb140009e20 tx=0x7fb14000b040 comp rx=0 tx=0).stop 2024-09-13T18:39:15.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.567+0000 7fb14f080640 1 -- 172.21.15.97:0/1837398164 shutdown_connections 2024-09-13T18:39:15.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.567+0000 7fb14f080640 1 --2- 172.21.15.97:0/1837398164 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb14809af20 0x7fb14813ec50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.567+0000 7fb14f080640 1 --2- 172.21.15.97:0/1837398164 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb14809ab50 0x7fb148132c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.567+0000 7fb14f080640 1 --2- 172.21.15.97:0/1837398164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb148067110 0x7fb148132720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.567+0000 7fb14f080640 1 -- 172.21.15.97:0/1837398164 >> 172.21.15.97:0/1837398164 conn(0x7fb14809f790 msgr2=0x7fb148098a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:15.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.567+0000 7fb14f080640 1 -- 172.21.15.97:0/1837398164 shutdown_connections 2024-09-13T18:39:15.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.567+0000 7fb14f080640 1 -- 172.21.15.97:0/1837398164 wait complete. 2024-09-13T18:39:15.580 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:39:15.581 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:39:15.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f75424ef640 1 Processor -- start 2024-09-13T18:39:15.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f75424ef640 1 -- start start 2024-09-13T18:39:15.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f75424ef640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f753c09dfb0 0x7f753c12c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:15.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f75424ef640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f753c12cd70 0x7f753c0970e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:15.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f75424ef640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753c09c820 con 0x7f753c12c920 2024-09-13T18:39:15.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f75424ef640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c09e380 con 0x7f753c12cd70 2024-09-13T18:39:15.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f75424ef640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f753c069ab0 con 0x7f753c09dfb0 2024-09-13T18:39:15.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f7540a8c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f753c12cd70 0x7f753c0970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:15.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f753bfff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f753c09dfb0 0x7f753c12c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:15.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f753b7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f753c12c920 0x7f753c0969d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:36072/0 (socket says 172.21.15.97:36072) 2024-09-13T18:39:15.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f753b7fe640 1 -- 172.21.15.97:0/1718747524 learned_addr learned my addr 172.21.15.97:0/1718747524 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:15.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f753bfff640 1 -- 172.21.15.97:0/1718747524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f753c12cd70 msgr2=0x7f753c0970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:15.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f753bfff640 1 --2- 172.21.15.97:0/1718747524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f753c12cd70 0x7f753c0970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f753affd640 1 -- 172.21.15.97:0/1718747524 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687240778 0 0) 0x7f753c09c820 con 0x7f753c12c920 2024-09-13T18:39:15.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f753bfff640 1 -- 172.21.15.97:0/1718747524 >> v1:172.21.15.97:6789/0 conn(0x7f753c12c920 legacy=0x7f753c0969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:15.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f753bfff640 1 -- 172.21.15.97:0/1718747524 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c09cbf0 con 0x7f753c09dfb0 2024-09-13T18:39:15.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.675+0000 7f7540a8c640 1 --2- 172.21.15.97:0/1718747524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f753c12cd70 0x7f753c0970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:15.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.676+0000 7f753bfff640 1 --2- 172.21.15.97:0/1718747524 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f753c09dfb0 0x7f753c12c3e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f752c0098b0 tx=0x7f752c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47ed6182c3854799 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:15.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.676+0000 7f753affd640 1 -- 172.21.15.97:0/1718747524 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c02ac40 con 0x7f753c09dfb0 2024-09-13T18:39:15.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.676+0000 7f753affd640 1 -- 172.21.15.97:0/1718747524 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c02ada0 con 0x7f753c09dfb0 2024-09-13T18:39:15.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.676+0000 7f753affd640 1 -- 172.21.15.97:0/1718747524 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c032670 con 0x7f753c09dfb0 2024-09-13T18:39:15.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.677+0000 7f75424ef640 1 -- 172.21.15.97:0/1718747524 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f753c09dfb0 msgr2=0x7f753c12c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:15.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.677+0000 7f75424ef640 1 --2- 172.21.15.97:0/1718747524 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f753c09dfb0 0x7f753c12c3e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f752c0098b0 tx=0x7f752c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.677+0000 7f75424ef640 1 -- 172.21.15.97:0/1718747524 shutdown_connections 2024-09-13T18:39:15.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.677+0000 7f75424ef640 1 --2- 172.21.15.97:0/1718747524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f753c12cd70 0x7f753c0970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.677+0000 7f75424ef640 1 --2- 172.21.15.97:0/1718747524 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f753c09dfb0 0x7f753c12c3e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.677+0000 7f75424ef640 1 -- 172.21.15.97:0/1718747524 >> 172.21.15.97:0/1718747524 conn(0x7f753c09b200 msgr2=0x7f753c09b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:15.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.677+0000 7f75424ef640 1 -- 172.21.15.97:0/1718747524 shutdown_connections 2024-09-13T18:39:15.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.677+0000 7f75424ef640 1 -- 172.21.15.97:0/1718747524 wait complete. 2024-09-13T18:39:15.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f75424ef640 1 Processor -- start 2024-09-13T18:39:15.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f75424ef640 1 -- start start 2024-09-13T18:39:15.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f75424ef640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f753c09dfb0 0x7f753c129560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:15.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f75424ef640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f753c12c920 0x7f753c115420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:15.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f75424ef640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f753c12cd70 0x7f753c115960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:15.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f75424ef640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c11be50 con 0x7f753c09dfb0 2024-09-13T18:39:15.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f75424ef640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c11cab0 con 0x7f753c12cd70 2024-09-13T18:39:15.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f75424ef640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f753c116840 con 0x7f753c12c920 2024-09-13T18:39:15.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f753bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f753c09dfb0 0x7f753c129560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:15.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f753b7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f753c12c920 0x7f753c115420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:15.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f7540a8c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f753c12cd70 0x7f753c115960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:15.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f753b7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f753c12c920 0x7f753c115420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59492/0 (socket says 172.21.15.97:59492) 2024-09-13T18:39:15.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f753b7fe640 1 -- 172.21.15.97:0/140576641 learned_addr learned my addr 172.21.15.97:0/140576641 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:15.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.678+0000 7f753bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f753c09dfb0 0x7f753c129560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40884/0 (socket says 172.21.15.97:40884) 2024-09-13T18:39:15.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.679+0000 7f753b7fe640 1 -- 172.21.15.97:0/140576641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f753c12cd70 msgr2=0x7f753c115960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:15.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.679+0000 7f753b7fe640 1 --2- 172.21.15.97:0/140576641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f753c12cd70 0x7f753c115960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.679+0000 7f753b7fe640 1 -- 172.21.15.97:0/140576641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f753c09dfb0 msgr2=0x7f753c129560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:15.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.679+0000 7f753b7fe640 1 --2- 172.21.15.97:0/140576641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f753c09dfb0 0x7f753c129560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:15.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.679+0000 7f753b7fe640 1 -- 172.21.15.97:0/140576641 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7534009a20 con 0x7f753c12c920 2024-09-13T18:39:15.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.679+0000 7f7540a8c640 1 --2- 172.21.15.97:0/140576641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f753c12cd70 0x7f753c115960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:15.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.679+0000 7f753b7fe640 1 --2- 172.21.15.97:0/140576641 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f753c12c920 0x7f753c115420 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7524001eb0 tx=0x7f7524007ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:15.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.679+0000 7f7533fff640 1 -- 172.21.15.97:0/140576641 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524005aa0 con 0x7f753c12c920 2024-09-13T18:39:15.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.679+0000 7f7533fff640 1 -- 172.21.15.97:0/140576641 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524005c20 con 0x7f753c12c920 2024-09-13T18:39:15.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.679+0000 7f75424ef640 1 -- 172.21.15.97:0/140576641 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c009390 con 0x7f753c12c920 2024-09-13T18:39:15.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.679+0000 7f7533fff640 1 -- 172.21.15.97:0/140576641 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524007320 con 0x7f753c12c920 2024-09-13T18:39:15.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.679+0000 7f75424ef640 1 -- 172.21.15.97:0/140576641 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753c116640 con 0x7f753c12c920 2024-09-13T18:39:15.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.680+0000 7f7533fff640 1 -- 172.21.15.97:0/140576641 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f752401b3b0 con 0x7f753c12c920 2024-09-13T18:39:15.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.680+0000 7f7533fff640 1 -- 172.21.15.97:0/140576641 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f75240413f0 con 0x7f753c12c920 2024-09-13T18:39:15.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.680+0000 7f75424ef640 1 -- 172.21.15.97:0/140576641 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753c11bf90 con 0x7f753c12c920 2024-09-13T18:39:15.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.684+0000 7f7533fff640 1 -- 172.21.15.97:0/140576641 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f753c11bf90 con 0x7f753c12c920 2024-09-13T18:39:15.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:15.868+0000 7f75424ef640 1 -- 172.21.15.97:0/140576641 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f753c11bf90 con 0x7f753c12c920 2024-09-13T18:39:16.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.572+0000 7f7533fff640 1 -- 172.21.15.97:0/140576641 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v5) v1 ==== 122+0+0 (secure 0 0 0) 0x7f753c11bf90 con 0x7f753c12c920 2024-09-13T18:39:16.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.574+0000 7f75424ef640 1 -- 172.21.15.97:0/140576641 >> v1:172.21.15.97:6816/34603 conn(0x7f751c031190 legacy=0x7f751c033640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:16.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.574+0000 7f75424ef640 1 -- 172.21.15.97:0/140576641 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f753c12c920 msgr2=0x7f753c115420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:16.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.574+0000 7f75424ef640 1 --2- 172.21.15.97:0/140576641 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f753c12c920 0x7f753c115420 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7524001eb0 tx=0x7f7524007ce0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.574+0000 7f75424ef640 1 -- 172.21.15.97:0/140576641 shutdown_connections 2024-09-13T18:39:16.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.574+0000 7f75424ef640 1 --2- 172.21.15.97:0/140576641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f753c12cd70 0x7f753c115960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.574+0000 7f75424ef640 1 --2- 172.21.15.97:0/140576641 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f753c12c920 0x7f753c115420 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.574+0000 7f75424ef640 1 --2- 172.21.15.97:0/140576641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f753c09dfb0 0x7f753c129560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.574+0000 7f75424ef640 1 -- 172.21.15.97:0/140576641 >> 172.21.15.97:0/140576641 conn(0x7f753c09b200 msgr2=0x7f753c12f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:16.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.574+0000 7f75424ef640 1 -- 172.21.15.97:0/140576641 shutdown_connections 2024-09-13T18:39:16.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.574+0000 7f75424ef640 1 -- 172.21.15.97:0/140576641 wait complete. 2024-09-13T18:39:16.589 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:39:16.589 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:39:16.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.682+0000 7fb784f9d640 1 Processor -- start 2024-09-13T18:39:16.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.682+0000 7fb784f9d640 1 -- start start 2024-09-13T18:39:16.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.682+0000 7fb784f9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb780098ab0 0x7fb78009cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:16.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.682+0000 7fb784f9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb780096e00 0x7fb78009d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:16.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.682+0000 7fb784f9d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb780097ff0 con 0x7fb78009d920 2024-09-13T18:39:16.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.682+0000 7fb784f9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78009dd70 con 0x7fb780098ab0 2024-09-13T18:39:16.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.682+0000 7fb784f9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb780098e80 con 0x7fb780096e00 2024-09-13T18:39:16.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.682+0000 7fb77e59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb780098ab0 0x7fb78009cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:16.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.682+0000 7fb77dd9b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb780096e00 0x7fb78009d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:16.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.682+0000 7fb77ed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb78009d920 0x7fb780131f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:36078/0 (socket says 172.21.15.97:36078) 2024-09-13T18:39:16.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.682+0000 7fb77ed9d640 1 -- 172.21.15.97:0/1974907424 learned_addr learned my addr 172.21.15.97:0/1974907424 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:16.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.683+0000 7fb77dd9b640 1 -- 172.21.15.97:0/1974907424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb780098ab0 msgr2=0x7fb78009cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:16.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.683+0000 7fb77d59a640 1 -- 172.21.15.97:0/1974907424 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500395014 0 0) 0x7fb780097ff0 con 0x7fb78009d920 2024-09-13T18:39:16.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.683+0000 7fb77dd9b640 1 --2- 172.21.15.97:0/1974907424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb780098ab0 0x7fb78009cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.683+0000 7fb77dd9b640 1 -- 172.21.15.97:0/1974907424 >> v1:172.21.15.97:6789/0 conn(0x7fb78009d920 legacy=0x7fb780131f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:16.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.683+0000 7fb77dd9b640 1 -- 172.21.15.97:0/1974907424 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78006eb80 con 0x7fb780096e00 2024-09-13T18:39:16.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.683+0000 7fb77e59c640 1 --2- 172.21.15.97:0/1974907424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb780098ab0 0x7fb78009cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:16.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.683+0000 7fb77dd9b640 1 --2- 172.21.15.97:0/1974907424 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb780096e00 0x7fb78009d3e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb7700098b0 tx=0x7fb7700090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=158a357a73517ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:16.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.683+0000 7fb77d59a640 1 -- 172.21.15.97:0/1974907424 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77002acc0 con 0x7fb780096e00 2024-09-13T18:39:16.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.684+0000 7fb77d59a640 1 -- 172.21.15.97:0/1974907424 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77002ae20 con 0x7fb780096e00 2024-09-13T18:39:16.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.684+0000 7fb77d59a640 1 -- 172.21.15.97:0/1974907424 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770032670 con 0x7fb780096e00 2024-09-13T18:39:16.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.684+0000 7fb784f9d640 1 -- 172.21.15.97:0/1974907424 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb780096e00 msgr2=0x7fb78009d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:16.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.684+0000 7fb784f9d640 1 --2- 172.21.15.97:0/1974907424 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb780096e00 0x7fb78009d3e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb7700098b0 tx=0x7fb7700090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.684+0000 7fb784f9d640 1 -- 172.21.15.97:0/1974907424 shutdown_connections 2024-09-13T18:39:16.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.684+0000 7fb784f9d640 1 --2- 172.21.15.97:0/1974907424 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb780096e00 0x7fb78009d3e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.684+0000 7fb784f9d640 1 --2- 172.21.15.97:0/1974907424 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb780098ab0 0x7fb78009cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.684+0000 7fb784f9d640 1 -- 172.21.15.97:0/1974907424 >> 172.21.15.97:0/1974907424 conn(0x7fb78009b200 msgr2=0x7fb78009b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:16.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.684+0000 7fb784f9d640 1 -- 172.21.15.97:0/1974907424 shutdown_connections 2024-09-13T18:39:16.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.684+0000 7fb784f9d640 1 -- 172.21.15.97:0/1974907424 wait complete. 2024-09-13T18:39:16.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb784f9d640 1 Processor -- start 2024-09-13T18:39:16.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb784f9d640 1 -- start start 2024-09-13T18:39:16.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb784f9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb780096e00 0x7fb78011f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:16.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb784f9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb780098ab0 0x7fb78011fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:16.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb784f9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb78009d920 0x7fb78011fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:16.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb784f9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78006ddf0 con 0x7fb78009d920 2024-09-13T18:39:16.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb784f9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7801219d0 con 0x7fb780096e00 2024-09-13T18:39:16.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb784f9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb780122910 con 0x7fb780098ab0 2024-09-13T18:39:16.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb77e59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb780096e00 0x7fb78011f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:16.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb77dd9b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb780098ab0 0x7fb78011fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:16.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb77e59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb780096e00 0x7fb78011f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:33936/0 (socket says 172.21.15.97:33936) 2024-09-13T18:39:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb77dd9b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb780098ab0 0x7fb78011fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59514/0 (socket says 172.21.15.97:59514) 2024-09-13T18:39:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb77e59c640 1 -- 172.21.15.97:0/1896767432 learned_addr learned my addr 172.21.15.97:0/1896767432 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.685+0000 7fb77ed9d640 1 --2- 172.21.15.97:0/1896767432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb78009d920 0x7fb78011fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.686+0000 7fb77e59c640 1 -- 172.21.15.97:0/1896767432 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb780098ab0 msgr2=0x7fb78011fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.686+0000 7fb77e59c640 1 --2- 172.21.15.97:0/1896767432 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb780098ab0 0x7fb78011fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.686+0000 7fb77e59c640 1 -- 172.21.15.97:0/1896767432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb78009d920 msgr2=0x7fb78011fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.686+0000 7fb77e59c640 1 --2- 172.21.15.97:0/1896767432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb78009d920 0x7fb78011fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.686+0000 7fb77e59c640 1 -- 172.21.15.97:0/1896767432 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76800b630 con 0x7fb780096e00 2024-09-13T18:39:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.686+0000 7fb77dd9b640 1 --2- 172.21.15.97:0/1896767432 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb780098ab0 0x7fb78011fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.686+0000 7fb77ed9d640 1 --2- 172.21.15.97:0/1896767432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb78009d920 0x7fb78011fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.686+0000 7fb77e59c640 1 --2- 172.21.15.97:0/1896767432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb780096e00 0x7fb78011f570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb76800ee10 tx=0x7fb76800b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.686+0000 7fb7767fc640 1 -- 172.21.15.97:0/1896767432 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768010440 con 0x7fb780096e00 2024-09-13T18:39:16.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.686+0000 7fb7767fc640 1 -- 172.21.15.97:0/1896767432 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7680105a0 con 0x7fb780096e00 2024-09-13T18:39:16.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.686+0000 7fb7767fc640 1 -- 172.21.15.97:0/1896767432 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768010920 con 0x7fb780096e00 2024-09-13T18:39:16.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.686+0000 7fb784f9d640 1 -- 172.21.15.97:0/1896767432 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb770009390 con 0x7fb780096e00 2024-09-13T18:39:16.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.686+0000 7fb784f9d640 1 -- 172.21.15.97:0/1896767432 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb780120a80 con 0x7fb780096e00 2024-09-13T18:39:16.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.687+0000 7fb7767fc640 1 -- 172.21.15.97:0/1896767432 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fb768010cd0 con 0x7fb780096e00 2024-09-13T18:39:16.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.687+0000 7fb7767fc640 1 -- 172.21.15.97:0/1896767432 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7fb7680423c0 con 0x7fb780096e00 2024-09-13T18:39:16.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.687+0000 7fb784f9d640 1 -- 172.21.15.97:0/1896767432 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb780064000 con 0x7fb780096e00 2024-09-13T18:39:16.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.691+0000 7fb7767fc640 1 -- 172.21.15.97:0/1896767432 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fb76801d030 con 0x7fb780096e00 2024-09-13T18:39:16.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.872+0000 7fb784f9d640 1 -- 172.21.15.97:0/1896767432 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb78006dbd0 con 0x7fb780096e00 2024-09-13T18:39:16.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.873+0000 7fb7767fc640 1 -- 172.21.15.97:0/1896767432 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2264 (secure 0 0 0) 0x7fb768027090 con 0x7fb780096e00 2024-09-13T18:39:16.876 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:16.876 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:13.885647+0000","modified":"2024-09-13T18:39:16.567097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6817/3890865357","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6817","nonce":3890865357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-09-13T18:39:16.876 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 5 2024-09-13T18:39:16.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.874+0000 7fb784f9d640 1 -- 172.21.15.97:0/1896767432 >> v1:172.21.15.97:6816/34603 conn(0x7fb760031160 legacy=0x7fb760033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:16.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.874+0000 7fb784f9d640 1 -- 172.21.15.97:0/1896767432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb780096e00 msgr2=0x7fb78011f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:16.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.874+0000 7fb784f9d640 1 --2- 172.21.15.97:0/1896767432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb780096e00 0x7fb78011f570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb76800ee10 tx=0x7fb76800b3b0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.875+0000 7fb784f9d640 1 -- 172.21.15.97:0/1896767432 shutdown_connections 2024-09-13T18:39:16.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.875+0000 7fb784f9d640 1 --2- 172.21.15.97:0/1896767432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb78009d920 0x7fb78011fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.875+0000 7fb784f9d640 1 --2- 172.21.15.97:0/1896767432 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb780098ab0 0x7fb78011fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.875+0000 7fb784f9d640 1 --2- 172.21.15.97:0/1896767432 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb780096e00 0x7fb78011f570 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.875+0000 7fb784f9d640 1 -- 172.21.15.97:0/1896767432 >> 172.21.15.97:0/1896767432 conn(0x7fb78009b200 msgr2=0x7fb78006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:16.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.875+0000 7fb784f9d640 1 -- 172.21.15.97:0/1896767432 shutdown_connections 2024-09-13T18:39:16.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.875+0000 7fb784f9d640 1 -- 172.21.15.97:0/1896767432 wait complete. 2024-09-13T18:39:16.888 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:16.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.977+0000 7f5cf839d640 1 Processor -- start 2024-09-13T18:39:16.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.977+0000 7f5cf839d640 1 -- start start 2024-09-13T18:39:16.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf839d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5cf00a32b0 0x7f5cf012f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:16.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf839d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5cf012fed0 0x7f5cf0068970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:16.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf839d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf00a3680 con 0x7f5cf0068eb0 2024-09-13T18:39:16.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf839d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf0097460 con 0x7f5cf00a32b0 2024-09-13T18:39:16.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf839d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01302c0 con 0x7f5cf012fed0 2024-09-13T18:39:16.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf5938640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5cf012fed0 0x7f5cf0068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:16.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf6139640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5cf00a32b0 0x7f5cf012f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:16.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf5938640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5cf012fed0 0x7f5cf0068970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59524/0 (socket says 172.21.15.97:59524) 2024-09-13T18:39:16.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf5938640 1 -- 172.21.15.97:0/1907275205 learned_addr learned my addr 172.21.15.97:0/1907275205 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:16.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf693a640 1 --1- 172.21.15.97:0/1907275205 >> v1:172.21.15.97:6789/0 conn(0x7f5cf0068eb0 0x7f5cf0136760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:36092/0 (socket says 172.21.15.97:36092) 2024-09-13T18:39:16.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf5938640 1 -- 172.21.15.97:0/1907275205 >> v2:172.21.15.97:3300/0 conn(0x7f5cf00a32b0 msgr2=0x7f5cf012f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:16.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf5938640 1 --2- 172.21.15.97:0/1907275205 >> v2:172.21.15.97:3300/0 conn(0x7f5cf00a32b0 0x7f5cf012f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf5938640 1 -- 172.21.15.97:0/1907275205 >> v1:172.21.15.97:6789/0 conn(0x7f5cf0068eb0 legacy=0x7f5cf0136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:16.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf5938640 1 -- 172.21.15.97:0/1907275205 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf012d770 con 0x7f5cf012fed0 2024-09-13T18:39:16.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf6139640 1 --2- 172.21.15.97:0/1907275205 >> v2:172.21.15.97:3300/0 conn(0x7f5cf00a32b0 0x7f5cf012f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:16.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.978+0000 7f5cf5137640 1 -- 172.21.15.97:0/1907275205 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284747851 0 0) 0x7f5cf00a3680 con 0x7f5cf0068eb0 2024-09-13T18:39:16.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.979+0000 7f5cf5938640 1 --2- 172.21.15.97:0/1907275205 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5cf012fed0 0x7f5cf0068970 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009910 tx=0x7f5ce40091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03e3d5e2b6788bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:16.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.979+0000 7f5cf5137640 1 -- 172.21.15.97:0/1907275205 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce402adb0 con 0x7f5cf012fed0 2024-09-13T18:39:16.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.979+0000 7f5cf5137640 1 -- 172.21.15.97:0/1907275205 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce4032440 con 0x7f5cf012fed0 2024-09-13T18:39:16.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.979+0000 7f5cf5137640 1 -- 172.21.15.97:0/1907275205 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40327e0 con 0x7f5cf012fed0 2024-09-13T18:39:16.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.980+0000 7f5cf839d640 1 -- 172.21.15.97:0/1907275205 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5cf012fed0 msgr2=0x7f5cf0068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:16.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.980+0000 7f5cf839d640 1 --2- 172.21.15.97:0/1907275205 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5cf012fed0 0x7f5cf0068970 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009910 tx=0x7f5ce40091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.980+0000 7f5cf839d640 1 -- 172.21.15.97:0/1907275205 shutdown_connections 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.980+0000 7f5cf839d640 1 --2- 172.21.15.97:0/1907275205 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5cf012fed0 0x7f5cf0068970 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.980+0000 7f5cf839d640 1 --2- 172.21.15.97:0/1907275205 >> v2:172.21.15.97:3300/0 conn(0x7f5cf00a32b0 0x7f5cf012f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.980+0000 7f5cf839d640 1 -- 172.21.15.97:0/1907275205 >> 172.21.15.97:0/1907275205 conn(0x7f5cf006eef0 msgr2=0x7f5cf00a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.980+0000 7f5cf839d640 1 -- 172.21.15.97:0/1907275205 shutdown_connections 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.980+0000 7f5cf839d640 1 -- 172.21.15.97:0/1907275205 wait complete. 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.980+0000 7f5cf839d640 1 Processor -- start 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf839d640 1 -- start start 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf839d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cf0068eb0 0x7f5cf013ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf839d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5cf00a32b0 0x7f5cf013efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf839d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf012fed0 0x7f5cf01190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf839d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf011ca50 con 0x7f5cf0068eb0 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf839d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00a2620 con 0x7f5cf012fed0 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf839d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf009e710 con 0x7f5cf00a32b0 2024-09-13T18:39:16.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf6139640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cf0068eb0 0x7f5cf013ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:16.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf5938640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5cf00a32b0 0x7f5cf013efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:16.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf6139640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cf0068eb0 0x7f5cf013ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40908/0 (socket says 172.21.15.97:40908) 2024-09-13T18:39:16.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf693a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf012fed0 0x7f5cf01190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:16.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf6139640 1 -- 172.21.15.97:0/1072422835 learned_addr learned my addr 172.21.15.97:0/1072422835 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:16.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf5938640 1 -- 172.21.15.97:0/1072422835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf012fed0 msgr2=0x7f5cf01190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:16.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf5938640 1 --2- 172.21.15.97:0/1072422835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf012fed0 0x7f5cf01190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf5938640 1 -- 172.21.15.97:0/1072422835 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cf0068eb0 msgr2=0x7f5cf013ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:16.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf5938640 1 --2- 172.21.15.97:0/1072422835 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cf0068eb0 0x7f5cf013ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:16.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf5938640 1 -- 172.21.15.97:0/1072422835 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec009390 con 0x7f5cf00a32b0 2024-09-13T18:39:16.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.981+0000 7f5cf6139640 1 --2- 172.21.15.97:0/1072422835 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cf0068eb0 0x7f5cf013ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:16.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.982+0000 7f5cf5938640 1 --2- 172.21.15.97:0/1072422835 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5cf00a32b0 0x7f5cf013efb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4031000 tx=0x7f5ce4032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:16.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.982+0000 7f5ce27fc640 1 -- 172.21.15.97:0/1072422835 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4031de0 con 0x7f5cf00a32b0 2024-09-13T18:39:16.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.982+0000 7f5ce27fc640 1 -- 172.21.15.97:0/1072422835 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce4000c40 con 0x7f5cf00a32b0 2024-09-13T18:39:16.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.982+0000 7f5ce27fc640 1 -- 172.21.15.97:0/1072422835 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce403d690 con 0x7f5cf00a32b0 2024-09-13T18:39:16.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.982+0000 7f5cf839d640 1 -- 172.21.15.97:0/1072422835 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce4009450 con 0x7f5cf00a32b0 2024-09-13T18:39:16.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.982+0000 7f5cf839d640 1 -- 172.21.15.97:0/1072422835 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf013f4f0 con 0x7f5cf00a32b0 2024-09-13T18:39:16.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.982+0000 7f5ce27fc640 1 -- 172.21.15.97:0/1072422835 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f5ce4039040 con 0x7f5cf00a32b0 2024-09-13T18:39:16.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.983+0000 7f5ce27fc640 1 -- 172.21.15.97:0/1072422835 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f5ce4062000 con 0x7f5cf00a32b0 2024-09-13T18:39:16.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.983+0000 7f5cf839d640 1 -- 172.21.15.97:0/1072422835 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf0064000 con 0x7f5cf00a32b0 2024-09-13T18:39:16.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:16.987+0000 7f5ce27fc640 1 -- 172.21.15.97:0/1072422835 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f5ce4037080 con 0x7f5cf00a32b0 2024-09-13T18:39:17.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.138+0000 7f5cf839d640 1 -- 172.21.15.97:0/1072422835 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cf011a8d0 con 0x7f5cf00a32b0 2024-09-13T18:39:17.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.138+0000 7f5ce27fc640 1 -- 172.21.15.97:0/1072422835 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+11343 (secure 0 0 0) 0x7f5ce403a390 con 0x7f5cf00a32b0 2024-09-13T18:39:17.141 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:17.141 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:14.949504+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:17.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.140+0000 7f5cf839d640 1 -- 172.21.15.97:0/1072422835 >> v1:172.21.15.97:6816/34603 conn(0x7f5cd4031160 legacy=0x7f5cd4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.140+0000 7f5cf839d640 1 -- 172.21.15.97:0/1072422835 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5cf00a32b0 msgr2=0x7f5cf013efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.140+0000 7f5cf839d640 1 --2- 172.21.15.97:0/1072422835 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5cf00a32b0 0x7f5cf013efb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4031000 tx=0x7f5ce4032000 comp rx=0 tx=0).stop 2024-09-13T18:39:17.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.140+0000 7f5cf839d640 1 -- 172.21.15.97:0/1072422835 shutdown_connections 2024-09-13T18:39:17.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.140+0000 7f5cf839d640 1 --2- 172.21.15.97:0/1072422835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5cf012fed0 0x7f5cf01190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.140+0000 7f5cf839d640 1 --2- 172.21.15.97:0/1072422835 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5cf00a32b0 0x7f5cf013efb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.140+0000 7f5cf839d640 1 --2- 172.21.15.97:0/1072422835 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5cf0068eb0 0x7f5cf013ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.140+0000 7f5cf839d640 1 -- 172.21.15.97:0/1072422835 >> 172.21.15.97:0/1072422835 conn(0x7f5cf006eef0 msgr2=0x7f5cf00a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:17.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.140+0000 7f5cf839d640 1 -- 172.21.15.97:0/1072422835 shutdown_connections 2024-09-13T18:39:17.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.140+0000 7f5cf839d640 1 -- 172.21.15.97:0/1072422835 wait complete. 2024-09-13T18:39:17.154 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:39:17.154 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:39:17.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.244+0000 7f96f039d640 1 Processor -- start 2024-09-13T18:39:17.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.244+0000 7f96f039d640 1 -- start start 2024-09-13T18:39:17.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96f039d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f96e809dfb0 0x7f96e8096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96f039d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80974c0 0x7f96e812c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96f039d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e806a190 con 0x7f96e80969d0 2024-09-13T18:39:17.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96f039d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e809e380 con 0x7f96e809dfb0 2024-09-13T18:39:17.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96f039d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8098870 con 0x7f96e80974c0 2024-09-13T18:39:17.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96ee93a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80974c0 0x7f96e812c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96ee139640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f96e809dfb0 0x7f96e8096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96ed938640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f96e80969d0 0x7f96e812bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:36108/0 (socket says 172.21.15.97:36108) 2024-09-13T18:39:17.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96ee93a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80974c0 0x7f96e812c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59550/0 (socket says 172.21.15.97:59550) 2024-09-13T18:39:17.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96ed938640 1 -- 172.21.15.97:0/354858815 learned_addr learned my addr 172.21.15.97:0/354858815 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:17.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96ee93a640 1 -- 172.21.15.97:0/354858815 >> v2:172.21.15.97:3300/0 conn(0x7f96e809dfb0 msgr2=0x7f96e8096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:17.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96ee93a640 1 --2- 172.21.15.97:0/354858815 >> v2:172.21.15.97:3300/0 conn(0x7f96e809dfb0 0x7f96e8096f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96ee93a640 1 -- 172.21.15.97:0/354858815 >> v1:172.21.15.97:6789/0 conn(0x7f96e80969d0 legacy=0x7f96e812bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96ee93a640 1 -- 172.21.15.97:0/354858815 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8097940 con 0x7f96e80974c0 2024-09-13T18:39:17.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96ed137640 1 -- 172.21.15.97:0/354858815 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827694263 0 0) 0x7f96e806a190 con 0x7f96e80969d0 2024-09-13T18:39:17.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.245+0000 7f96ee139640 1 --2- 172.21.15.97:0/354858815 >> v2:172.21.15.97:3300/0 conn(0x7f96e809dfb0 0x7f96e8096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:17.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.246+0000 7f96ee93a640 1 --2- 172.21.15.97:0/354858815 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80974c0 0x7f96e812c680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009850 tx=0x7f96d80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cf1f61beee239e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:17.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.246+0000 7f96ed137640 1 -- 172.21.15.97:0/354858815 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d802ad00 con 0x7f96e80974c0 2024-09-13T18:39:17.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.246+0000 7f96ed137640 1 -- 172.21.15.97:0/354858815 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d802ae60 con 0x7f96e80974c0 2024-09-13T18:39:17.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.246+0000 7f96ed137640 1 -- 172.21.15.97:0/354858815 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8032670 con 0x7f96e80974c0 2024-09-13T18:39:17.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.247+0000 7f96f039d640 1 -- 172.21.15.97:0/354858815 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80974c0 msgr2=0x7f96e812c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.247+0000 7f96f039d640 1 --2- 172.21.15.97:0/354858815 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80974c0 0x7f96e812c680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009850 tx=0x7f96d80090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.247+0000 7f96f039d640 1 -- 172.21.15.97:0/354858815 shutdown_connections 2024-09-13T18:39:17.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.247+0000 7f96f039d640 1 --2- 172.21.15.97:0/354858815 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80974c0 0x7f96e812c680 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.247+0000 7f96f039d640 1 --2- 172.21.15.97:0/354858815 >> v2:172.21.15.97:3300/0 conn(0x7f96e809dfb0 0x7f96e8096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.247+0000 7f96f039d640 1 -- 172.21.15.97:0/354858815 >> 172.21.15.97:0/354858815 conn(0x7f96e809b200 msgr2=0x7f96e809b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:17.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.247+0000 7f96f039d640 1 -- 172.21.15.97:0/354858815 shutdown_connections 2024-09-13T18:39:17.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.247+0000 7f96f039d640 1 -- 172.21.15.97:0/354858815 wait complete. 2024-09-13T18:39:17.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96f039d640 1 Processor -- start 2024-09-13T18:39:17.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96f039d640 1 -- start start 2024-09-13T18:39:17.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96f039d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80969d0 0x7f96e812c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96f039d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e80974c0 0x7f96e811d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96f039d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e809dfb0 0x7f96e811da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96f039d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e811e850 con 0x7f96e809dfb0 2024-09-13T18:39:17.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96f039d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e806a4a0 con 0x7f96e80974c0 2024-09-13T18:39:17.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96f039d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8097e10 con 0x7f96e80969d0 2024-09-13T18:39:17.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96ee139640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80969d0 0x7f96e812c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96ed938640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e80974c0 0x7f96e811d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96ee139640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80969d0 0x7f96e812c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59562/0 (socket says 172.21.15.97:59562) 2024-09-13T18:39:17.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96ee139640 1 -- 172.21.15.97:0/3716461082 learned_addr learned my addr 172.21.15.97:0/3716461082 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:17.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96ee93a640 1 --2- 172.21.15.97:0/3716461082 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e809dfb0 0x7f96e811da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96ee139640 1 -- 172.21.15.97:0/3716461082 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e80974c0 msgr2=0x7f96e811d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96ee139640 1 --2- 172.21.15.97:0/3716461082 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e80974c0 0x7f96e811d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96ee139640 1 -- 172.21.15.97:0/3716461082 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e809dfb0 msgr2=0x7f96e811da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96ee139640 1 --2- 172.21.15.97:0/3716461082 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e809dfb0 0x7f96e811da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.248+0000 7f96ee139640 1 -- 172.21.15.97:0/3716461082 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e0009390 con 0x7f96e80969d0 2024-09-13T18:39:17.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.249+0000 7f96ee139640 1 --2- 172.21.15.97:0/3716461082 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80969d0 0x7f96e812c260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f96e000ec80 tx=0x7f96e00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:17.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.249+0000 7f96e67fc640 1 -- 172.21.15.97:0/3716461082 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e000eec0 con 0x7f96e80969d0 2024-09-13T18:39:17.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.249+0000 7f96e67fc640 1 -- 172.21.15.97:0/3716461082 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e000cbc0 con 0x7f96e80969d0 2024-09-13T18:39:17.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.249+0000 7f96f039d640 1 -- 172.21.15.97:0/3716461082 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d8009390 con 0x7f96e80969d0 2024-09-13T18:39:17.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.249+0000 7f96e67fc640 1 -- 172.21.15.97:0/3716461082 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0013470 con 0x7f96e80969d0 2024-09-13T18:39:17.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.249+0000 7f96f039d640 1 -- 172.21.15.97:0/3716461082 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e809d870 con 0x7f96e80969d0 2024-09-13T18:39:17.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.250+0000 7f96e67fc640 1 -- 172.21.15.97:0/3716461082 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f96e00137e0 con 0x7f96e80969d0 2024-09-13T18:39:17.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.250+0000 7f96e67fc640 1 -- 172.21.15.97:0/3716461082 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f96e0042420 con 0x7f96e80969d0 2024-09-13T18:39:17.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.250+0000 7f96f039d640 1 -- 172.21.15.97:0/3716461082 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e811f9b0 con 0x7f96e80969d0 2024-09-13T18:39:17.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.254+0000 7f96e67fc640 1 -- 172.21.15.97:0/3716461082 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f96e0023aa0 con 0x7f96e80969d0 2024-09-13T18:39:17.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.405+0000 7f96f039d640 1 -- 172.21.15.97:0/3716461082 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96e8064000 con 0x7f96d4031160 2024-09-13T18:39:17.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.411+0000 7f96e67fc640 1 -- 172.21.15.97:0/3716461082 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271513 (unknown 2965378022 0 2274998159) 0x7f96e8064000 con 0x7f96d4031160 2024-09-13T18:39:17.417 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:17.418 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:39:17.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.414+0000 7f96f039d640 1 -- 172.21.15.97:0/3716461082 >> v1:172.21.15.97:6816/34603 conn(0x7f96d4031160 legacy=0x7f96d4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.414+0000 7f96f039d640 1 -- 172.21.15.97:0/3716461082 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80969d0 msgr2=0x7f96e812c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.414+0000 7f96f039d640 1 --2- 172.21.15.97:0/3716461082 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80969d0 0x7f96e812c260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f96e000ec80 tx=0x7f96e00090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.414+0000 7f96f039d640 1 -- 172.21.15.97:0/3716461082 shutdown_connections 2024-09-13T18:39:17.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.414+0000 7f96f039d640 1 --2- 172.21.15.97:0/3716461082 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e809dfb0 0x7f96e811da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.414+0000 7f96f039d640 1 --2- 172.21.15.97:0/3716461082 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e80974c0 0x7f96e811d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.414+0000 7f96f039d640 1 --2- 172.21.15.97:0/3716461082 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e80969d0 0x7f96e812c260 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.414+0000 7f96f039d640 1 -- 172.21.15.97:0/3716461082 >> 172.21.15.97:0/3716461082 conn(0x7f96e809b200 msgr2=0x7f96e8114d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:17.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.414+0000 7f96f039d640 1 -- 172.21.15.97:0/3716461082 shutdown_connections 2024-09-13T18:39:17.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.414+0000 7f96f039d640 1 -- 172.21.15.97:0/3716461082 wait complete. 2024-09-13T18:39:17.427 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-13T18:39:17.349352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592725,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":125,"num_write_kb":1121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":201,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1191312,"kb_used_data":1868,"kb_used_omap":6,"kb_used_meta":1189369,"kb_avail":376296048,"statfs":{"total":386547056640,"available":385327153152,"internally_reserved":0,"allocated":1912832,"data_stored":1393726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1217914208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.804245"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600365+0000","last_change":"2024-09-13T18:39:14.592723+0000","last_active":"2024-09-13T18:39:14.600365+0000","last_peered":"2024-09-13T18:39:14.600365+0000","last_clean":"2024-09-13T18:39:14.600365+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:39:14.600365+0000","last_undegraded":"2024-09-13T18:39:14.600365+0000","last_fullsized":"2024-09-13T18:39:14.600365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:09.304808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.587573+0000","last_change":"2024-09-13T18:39:14.581266+0000","last_active":"2024-09-13T18:39:14.587573+0000","last_peered":"2024-09-13T18:39:14.587573+0000","last_clean":"2024-09-13T18:39:14.587573+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:39:14.587573+0000","last_undegraded":"2024-09-13T18:39:14.587573+0000","last_fullsized":"2024-09-13T18:39:14.587573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594566+0000","last_change":"2024-09-13T18:39:14.586254+0000","last_active":"2024-09-13T18:39:14.594566+0000","last_peered":"2024-09-13T18:39:14.594566+0000","last_clean":"2024-09-13T18:39:14.594566+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:39:14.594566+0000","last_undegraded":"2024-09-13T18:39:14.594566+0000","last_fullsized":"2024-09-13T18:39:14.594566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594551+0000","last_change":"2024-09-13T18:39:14.583960+0000","last_active":"2024-09-13T18:39:14.594551+0000","last_peered":"2024-09-13T18:39:14.594551+0000","last_clean":"2024-09-13T18:39:14.594551+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:39:14.594551+0000","last_undegraded":"2024-09-13T18:39:14.594551+0000","last_fullsized":"2024-09-13T18:39:14.594551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.589815+0000","last_change":"2024-09-13T18:39:14.577865+0000","last_active":"2024-09-13T18:39:14.589815+0000","last_peered":"2024-09-13T18:39:14.589815+0000","last_clean":"2024-09-13T18:39:14.589815+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:39:14.589815+0000","last_undegraded":"2024-09-13T18:39:14.589815+0000","last_fullsized":"2024-09-13T18:39:14.589815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595808+0000","last_change":"2024-09-13T18:39:14.590785+0000","last_active":"2024-09-13T18:39:14.595808+0000","last_peered":"2024-09-13T18:39:14.595808+0000","last_clean":"2024-09-13T18:39:14.595808+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:39:14.595808+0000","last_undegraded":"2024-09-13T18:39:14.595808+0000","last_fullsized":"2024-09-13T18:39:14.595808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:24.453184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596969+0000","last_change":"2024-09-13T18:39:14.590893+0000","last_active":"2024-09-13T18:39:14.596969+0000","last_peered":"2024-09-13T18:39:14.596969+0000","last_clean":"2024-09-13T18:39:14.596969+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:39:14.596969+0000","last_undegraded":"2024-09-13T18:39:14.596969+0000","last_fullsized":"2024-09-13T18:39:14.596969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:57.986187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601078+0000","last_change":"2024-09-13T18:39:14.595160+0000","last_active":"2024-09-13T18:39:14.601078+0000","last_peered":"2024-09-13T18:39:14.601078+0000","last_clean":"2024-09-13T18:39:14.601078+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:39:14.601078+0000","last_undegraded":"2024-09-13T18:39:14.601078+0000","last_fullsized":"2024-09-13T18:39:14.601078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595272+0000","last_change":"2024-09-13T18:39:14.586790+0000","last_active":"2024-09-13T18:39:14.595272+0000","last_peered":"2024-09-13T18:39:14.595272+0000","last_clean":"2024-09-13T18:39:14.595272+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:39:14.595272+0000","last_undegraded":"2024-09-13T18:39:14.595272+0000","last_fullsized":"2024-09-13T18:39:14.595272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:49.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601065+0000","last_change":"2024-09-13T18:39:14.591231+0000","last_active":"2024-09-13T18:39:14.601065+0000","last_peered":"2024-09-13T18:39:14.601065+0000","last_clean":"2024-09-13T18:39:14.601065+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:39:14.601065+0000","last_undegraded":"2024-09-13T18:39:14.601065+0000","last_fullsized":"2024-09-13T18:39:14.601065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600581+0000","last_change":"2024-09-13T18:39:14.589017+0000","last_active":"2024-09-13T18:39:14.600581+0000","last_peered":"2024-09-13T18:39:14.600581+0000","last_clean":"2024-09-13T18:39:14.600581+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:39:14.600581+0000","last_undegraded":"2024-09-13T18:39:14.600581+0000","last_fullsized":"2024-09-13T18:39:14.600581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600392+0000","last_change":"2024-09-13T18:39:14.592629+0000","last_active":"2024-09-13T18:39:14.600392+0000","last_peered":"2024-09-13T18:39:14.600392+0000","last_clean":"2024-09-13T18:39:14.600392+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:39:14.600392+0000","last_undegraded":"2024-09-13T18:39:14.600392+0000","last_fullsized":"2024-09-13T18:39:14.600392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602649+0000","last_change":"2024-09-13T18:39:14.597709+0000","last_active":"2024-09-13T18:39:14.602649+0000","last_peered":"2024-09-13T18:39:14.602649+0000","last_clean":"2024-09-13T18:39:14.602649+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:39:14.602649+0000","last_undegraded":"2024-09-13T18:39:14.602649+0000","last_fullsized":"2024-09-13T18:39:14.602649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.367739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.580120+0000","last_change":"2024-09-13T18:39:14.572267+0000","last_active":"2024-09-13T18:39:14.580120+0000","last_peered":"2024-09-13T18:39:14.580120+0000","last_clean":"2024-09-13T18:39:14.580120+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:39:14.580120+0000","last_undegraded":"2024-09-13T18:39:14.580120+0000","last_fullsized":"2024-09-13T18:39:14.580120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595134+0000","last_change":"2024-09-13T18:39:14.583318+0000","last_active":"2024-09-13T18:39:14.595134+0000","last_peered":"2024-09-13T18:39:14.595134+0000","last_clean":"2024-09-13T18:39:14.595134+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:39:14.595134+0000","last_undegraded":"2024-09-13T18:39:14.595134+0000","last_fullsized":"2024-09-13T18:39:14.595134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596097+0000","last_change":"2024-09-13T18:39:14.592378+0000","last_active":"2024-09-13T18:39:14.596097+0000","last_peered":"2024-09-13T18:39:14.596097+0000","last_clean":"2024-09-13T18:39:14.596097+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:39:14.596097+0000","last_undegraded":"2024-09-13T18:39:14.596097+0000","last_fullsized":"2024-09-13T18:39:14.596097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:02.414361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596564+0000","last_change":"2024-09-13T18:39:14.586945+0000","last_active":"2024-09-13T18:39:14.596564+0000","last_peered":"2024-09-13T18:39:14.596564+0000","last_clean":"2024-09-13T18:39:14.596564+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:39:14.596564+0000","last_undegraded":"2024-09-13T18:39:14.596564+0000","last_fullsized":"2024-09-13T18:39:14.596564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:57.889039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596311+0000","last_change":"2024-09-13T18:39:14.587172+0000","last_active":"2024-09-13T18:39:14.596311+0000","last_peered":"2024-09-13T18:39:14.596311+0000","last_clean":"2024-09-13T18:39:14.596311+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:39:14.596311+0000","last_undegraded":"2024-09-13T18:39:14.596311+0000","last_fullsized":"2024-09-13T18:39:14.596311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600634+0000","last_change":"2024-09-13T18:39:14.594291+0000","last_active":"2024-09-13T18:39:14.600634+0000","last_peered":"2024-09-13T18:39:14.600634+0000","last_clean":"2024-09-13T18:39:14.600634+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:39:14.600634+0000","last_undegraded":"2024-09-13T18:39:14.600634+0000","last_fullsized":"2024-09-13T18:39:14.600634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:29.208875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600015+0000","last_change":"2024-09-13T18:39:14.585973+0000","last_active":"2024-09-13T18:39:14.600015+0000","last_peered":"2024-09-13T18:39:14.600015+0000","last_clean":"2024-09-13T18:39:14.600015+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:39:14.600015+0000","last_undegraded":"2024-09-13T18:39:14.600015+0000","last_fullsized":"2024-09-13T18:39:14.600015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:48.875040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601035+0000","last_change":"2024-09-13T18:39:14.595451+0000","last_active":"2024-09-13T18:39:14.601035+0000","last_peered":"2024-09-13T18:39:14.601035+0000","last_clean":"2024-09-13T18:39:14.601035+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:39:14.601035+0000","last_undegraded":"2024-09-13T18:39:14.601035+0000","last_fullsized":"2024-09-13T18:39:14.601035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:45.368802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594643+0000","last_change":"2024-09-13T18:39:14.583590+0000","last_active":"2024-09-13T18:39:14.594643+0000","last_peered":"2024-09-13T18:39:14.594643+0000","last_clean":"2024-09-13T18:39:14.594643+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:39:14.594643+0000","last_undegraded":"2024-09-13T18:39:14.594643+0000","last_fullsized":"2024-09-13T18:39:14.594643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596929+0000","last_change":"2024-09-13T18:39:14.590724+0000","last_active":"2024-09-13T18:39:14.596929+0000","last_peered":"2024-09-13T18:39:14.596929+0000","last_clean":"2024-09-13T18:39:14.596929+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:39:14.596929+0000","last_undegraded":"2024-09-13T18:39:14.596929+0000","last_fullsized":"2024-09-13T18:39:14.596929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:09.353955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.581250+0000","last_change":"2024-09-13T18:39:14.577642+0000","last_active":"2024-09-13T18:39:14.581250+0000","last_peered":"2024-09-13T18:39:14.581250+0000","last_clean":"2024-09-13T18:39:14.581250+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:39:14.581250+0000","last_undegraded":"2024-09-13T18:39:14.581250+0000","last_fullsized":"2024-09-13T18:39:14.581250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601088+0000","last_change":"2024-09-13T18:39:14.592432+0000","last_active":"2024-09-13T18:39:14.601088+0000","last_peered":"2024-09-13T18:39:14.601088+0000","last_clean":"2024-09-13T18:39:14.601088+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:39:14.601088+0000","last_undegraded":"2024-09-13T18:39:14.601088+0000","last_fullsized":"2024-09-13T18:39:14.601088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:43.945214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.577721+0000","last_change":"2024-09-13T18:39:14.571893+0000","last_active":"2024-09-13T18:39:14.577721+0000","last_peered":"2024-09-13T18:39:14.577721+0000","last_clean":"2024-09-13T18:39:14.577721+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:39:14.577721+0000","last_undegraded":"2024-09-13T18:39:14.577721+0000","last_fullsized":"2024-09-13T18:39:14.577721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596328+0000","last_change":"2024-09-13T18:39:14.594222+0000","last_active":"2024-09-13T18:39:14.596328+0000","last_peered":"2024-09-13T18:39:14.596328+0000","last_clean":"2024-09-13T18:39:14.596328+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:39:14.596328+0000","last_undegraded":"2024-09-13T18:39:14.596328+0000","last_fullsized":"2024-09-13T18:39:14.596328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:20.265556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.580499+0000","last_change":"2024-09-13T18:39:14.576203+0000","last_active":"2024-09-13T18:39:14.580499+0000","last_peered":"2024-09-13T18:39:14.580499+0000","last_clean":"2024-09-13T18:39:14.580499+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:39:14.580499+0000","last_undegraded":"2024-09-13T18:39:14.580499+0000","last_fullsized":"2024-09-13T18:39:14.580499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593337+0000","last_change":"2024-09-13T18:39:14.586374+0000","last_active":"2024-09-13T18:39:14.593337+0000","last_peered":"2024-09-13T18:39:14.593337+0000","last_clean":"2024-09-13T18:39:14.593337+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:39:14.593337+0000","last_undegraded":"2024-09-13T18:39:14.593337+0000","last_fullsized":"2024-09-13T18:39:14.593337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:03.191196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.589263+0000","last_change":"2024-09-13T18:39:14.577392+0000","last_active":"2024-09-13T18:39:14.589263+0000","last_peered":"2024-09-13T18:39:14.589263+0000","last_clean":"2024-09-13T18:39:14.589263+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:39:14.589263+0000","last_undegraded":"2024-09-13T18:39:14.589263+0000","last_fullsized":"2024-09-13T18:39:14.589263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:26.709807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.584973+0000","last_change":"2024-09-13T18:39:14.580898+0000","last_active":"2024-09-13T18:39:14.584973+0000","last_peered":"2024-09-13T18:39:14.584973+0000","last_clean":"2024-09-13T18:39:14.584973+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:39:14.584973+0000","last_undegraded":"2024-09-13T18:39:14.584973+0000","last_fullsized":"2024-09-13T18:39:14.584973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:23.630337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.579587+0000","last_change":"2024-09-13T18:39:14.574811+0000","last_active":"2024-09-13T18:39:14.579587+0000","last_peered":"2024-09-13T18:39:14.579587+0000","last_clean":"2024-09-13T18:39:14.579587+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:39:14.579587+0000","last_undegraded":"2024-09-13T18:39:14.579587+0000","last_fullsized":"2024-09-13T18:39:14.579587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.582621+0000","last_change":"2024-09-13T18:39:14.579494+0000","last_active":"2024-09-13T18:39:14.582621+0000","last_peered":"2024-09-13T18:39:14.582621+0000","last_clean":"2024-09-13T18:39:14.582621+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:39:14.582621+0000","last_undegraded":"2024-09-13T18:39:14.582621+0000","last_fullsized":"2024-09-13T18:39:14.582621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:19.432936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.598948+0000","last_change":"2024-09-13T18:39:13.575179+0000","last_active":"2024-09-13T18:39:14.598948+0000","last_peered":"2024-09-13T18:39:14.598948+0000","last_clean":"2024-09-13T18:39:14.598948+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:39:14.598948+0000","last_undegraded":"2024-09-13T18:39:14.598948+0000","last_fullsized":"2024-09-13T18:39:14.598948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:25.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596311+0000","last_change":"2024-09-13T18:39:14.594066+0000","last_active":"2024-09-13T18:39:14.596311+0000","last_peered":"2024-09-13T18:39:14.596311+0000","last_clean":"2024-09-13T18:39:14.596311+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:39:14.596311+0000","last_undegraded":"2024-09-13T18:39:14.596311+0000","last_fullsized":"2024-09-13T18:39:14.596311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:14.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.565149+0000","last_change":"2024-09-13T18:39:13.570778+0000","last_active":"2024-09-13T18:39:14.565149+0000","last_peered":"2024-09-13T18:39:14.565149+0000","last_clean":"2024-09-13T18:39:14.565149+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:39:14.565149+0000","last_undegraded":"2024-09-13T18:39:14.565149+0000","last_fullsized":"2024-09-13T18:39:14.565149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596329+0000","last_change":"2024-09-13T18:39:14.587863+0000","last_active":"2024-09-13T18:39:14.596329+0000","last_peered":"2024-09-13T18:39:14.596329+0000","last_clean":"2024-09-13T18:39:14.596329+0000","last_became_active":"2024-09-13T18:39:14.587626+0000","last_became_peered":"2024-09-13T18:39:14.587626+0000","last_unstale":"2024-09-13T18:39:14.596329+0000","last_undegraded":"2024-09-13T18:39:14.596329+0000","last_fullsized":"2024-09-13T18:39:14.596329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.566954+0000","last_change":"2024-09-13T18:39:13.575436+0000","last_active":"2024-09-13T18:39:14.566954+0000","last_peered":"2024-09-13T18:39:14.566954+0000","last_clean":"2024-09-13T18:39:14.566954+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:39:14.566954+0000","last_undegraded":"2024-09-13T18:39:14.566954+0000","last_fullsized":"2024-09-13T18:39:14.566954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:34.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588763+0000","last_change":"2024-09-13T18:39:14.584791+0000","last_active":"2024-09-13T18:39:14.588763+0000","last_peered":"2024-09-13T18:39:14.588763+0000","last_clean":"2024-09-13T18:39:14.588763+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:39:14.588763+0000","last_undegraded":"2024-09-13T18:39:14.588763+0000","last_fullsized":"2024-09-13T18:39:14.588763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:08.799126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601033+0000","last_change":"2024-09-13T18:39:13.578940+0000","last_active":"2024-09-13T18:39:14.601033+0000","last_peered":"2024-09-13T18:39:14.601033+0000","last_clean":"2024-09-13T18:39:14.601033+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:39:14.601033+0000","last_undegraded":"2024-09-13T18:39:14.601033+0000","last_fullsized":"2024-09-13T18:39:14.601033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:34.109209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.585065+0000","last_change":"2024-09-13T18:39:13.583184+0000","last_active":"2024-09-13T18:39:14.585065+0000","last_peered":"2024-09-13T18:39:14.585065+0000","last_clean":"2024-09-13T18:39:14.585065+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:39:14.585065+0000","last_undegraded":"2024-09-13T18:39:14.585065+0000","last_fullsized":"2024-09-13T18:39:14.585065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588808+0000","last_change":"2024-09-13T18:39:14.582349+0000","last_active":"2024-09-13T18:39:14.588808+0000","last_peered":"2024-09-13T18:39:14.588808+0000","last_clean":"2024-09-13T18:39:14.588808+0000","last_became_active":"2024-09-13T18:39:14.581643+0000","last_became_peered":"2024-09-13T18:39:14.581643+0000","last_unstale":"2024-09-13T18:39:14.588808+0000","last_undegraded":"2024-09-13T18:39:14.588808+0000","last_fullsized":"2024-09-13T18:39:14.588808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:34.221522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588626+0000","last_change":"2024-09-13T18:39:13.571043+0000","last_active":"2024-09-13T18:39:14.588626+0000","last_peered":"2024-09-13T18:39:14.588626+0000","last_clean":"2024-09-13T18:39:14.588626+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:39:14.588626+0000","last_undegraded":"2024-09-13T18:39:14.588626+0000","last_fullsized":"2024-09-13T18:39:14.588626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.757855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.580443+0000","last_change":"2024-09-13T18:39:14.577177+0000","last_active":"2024-09-13T18:39:14.580443+0000","last_peered":"2024-09-13T18:39:14.580443+0000","last_clean":"2024-09-13T18:39:14.580443+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:39:14.580443+0000","last_undegraded":"2024-09-13T18:39:14.580443+0000","last_fullsized":"2024-09-13T18:39:14.580443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601502+0000","last_change":"2024-09-13T18:39:13.581627+0000","last_active":"2024-09-13T18:39:14.601502+0000","last_peered":"2024-09-13T18:39:14.601502+0000","last_clean":"2024-09-13T18:39:14.601502+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:39:14.601502+0000","last_undegraded":"2024-09-13T18:39:14.601502+0000","last_fullsized":"2024-09-13T18:39:14.601502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:48.023626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602556+0000","last_change":"2024-09-13T18:39:14.596602+0000","last_active":"2024-09-13T18:39:14.602556+0000","last_peered":"2024-09-13T18:39:14.602556+0000","last_clean":"2024-09-13T18:39:14.602556+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:39:14.602556+0000","last_undegraded":"2024-09-13T18:39:14.602556+0000","last_fullsized":"2024-09-13T18:39:14.602556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:35.414913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.570529+0000","last_change":"2024-09-13T18:39:13.570169+0000","last_active":"2024-09-13T18:39:14.570529+0000","last_peered":"2024-09-13T18:39:14.570529+0000","last_clean":"2024-09-13T18:39:14.570529+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:39:14.570529+0000","last_undegraded":"2024-09-13T18:39:14.570529+0000","last_fullsized":"2024-09-13T18:39:14.570529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594596+0000","last_change":"2024-09-13T18:39:14.584580+0000","last_active":"2024-09-13T18:39:14.594596+0000","last_peered":"2024-09-13T18:39:14.594596+0000","last_clean":"2024-09-13T18:39:14.594596+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:39:14.594596+0000","last_undegraded":"2024-09-13T18:39:14.594596+0000","last_fullsized":"2024-09-13T18:39:14.594596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.598820+0000","last_change":"2024-09-13T18:39:13.575713+0000","last_active":"2024-09-13T18:39:14.598820+0000","last_peered":"2024-09-13T18:39:14.598820+0000","last_clean":"2024-09-13T18:39:14.598820+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:39:14.598820+0000","last_undegraded":"2024-09-13T18:39:14.598820+0000","last_fullsized":"2024-09-13T18:39:14.598820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:59.985917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.589332+0000","last_change":"2024-09-13T18:39:14.577151+0000","last_active":"2024-09-13T18:39:14.589332+0000","last_peered":"2024-09-13T18:39:14.589332+0000","last_clean":"2024-09-13T18:39:14.589332+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:39:14.589332+0000","last_undegraded":"2024-09-13T18:39:14.589332+0000","last_fullsized":"2024-09-13T18:39:14.589332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.559598+0000","last_change":"2024-09-13T18:39:13.581445+0000","last_active":"2024-09-13T18:39:14.559598+0000","last_peered":"2024-09-13T18:39:14.559598+0000","last_clean":"2024-09-13T18:39:14.559598+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:39:14.559598+0000","last_undegraded":"2024-09-13T18:39:14.559598+0000","last_fullsized":"2024-09-13T18:39:14.559598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:39.003339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593363+0000","last_change":"2024-09-13T18:39:14.584122+0000","last_active":"2024-09-13T18:39:14.593363+0000","last_peered":"2024-09-13T18:39:14.593363+0000","last_clean":"2024-09-13T18:39:14.593363+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:39:14.593363+0000","last_undegraded":"2024-09-13T18:39:14.593363+0000","last_fullsized":"2024-09-13T18:39:14.593363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:30.405734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.563524+0000","last_change":"2024-09-13T18:39:13.575316+0000","last_active":"2024-09-13T18:39:14.563524+0000","last_peered":"2024-09-13T18:39:14.563524+0000","last_clean":"2024-09-13T18:39:14.563524+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:39:14.563524+0000","last_undegraded":"2024-09-13T18:39:14.563524+0000","last_fullsized":"2024-09-13T18:39:14.563524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:06.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600699+0000","last_change":"2024-09-13T18:39:14.593058+0000","last_active":"2024-09-13T18:39:14.600699+0000","last_peered":"2024-09-13T18:39:14.600699+0000","last_clean":"2024-09-13T18:39:14.600699+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:39:14.600699+0000","last_undegraded":"2024-09-13T18:39:14.600699+0000","last_fullsized":"2024-09-13T18:39:14.600699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:24.454698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.560704+0000","last_change":"2024-09-13T18:39:13.581217+0000","last_active":"2024-09-13T18:39:14.560704+0000","last_peered":"2024-09-13T18:39:14.560704+0000","last_clean":"2024-09-13T18:39:14.560704+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:39:14.560704+0000","last_undegraded":"2024-09-13T18:39:14.560704+0000","last_fullsized":"2024-09-13T18:39:14.560704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:27.361025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601513+0000","last_change":"2024-09-13T18:39:14.596597+0000","last_active":"2024-09-13T18:39:14.601513+0000","last_peered":"2024-09-13T18:39:14.601513+0000","last_clean":"2024-09-13T18:39:14.601513+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:39:14.601513+0000","last_undegraded":"2024-09-13T18:39:14.601513+0000","last_fullsized":"2024-09-13T18:39:14.601513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:47.680908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.565720+0000","last_change":"2024-09-13T18:39:03.413753+0000","last_active":"2024-09-13T18:39:14.565720+0000","last_peered":"2024-09-13T18:39:14.565720+0000","last_clean":"2024-09-13T18:39:14.565720+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:39:14.565720+0000","last_undegraded":"2024-09-13T18:39:14.565720+0000","last_fullsized":"2024-09-13T18:39:14.565720+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.425159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:05.703287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954507+0000","last_change":"2024-09-13T18:39:09.531787+0000","last_active":"2024-09-13T18:39:14.954507+0000","last_peered":"2024-09-13T18:39:14.954507+0000","last_clean":"2024-09-13T18:39:14.954507+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:39:14.954507+0000","last_undegraded":"2024-09-13T18:39:14.954507+0000","last_fullsized":"2024-09-13T18:39:14.954507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:21.652872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.560046+0000","last_change":"2024-09-13T18:39:13.575940+0000","last_active":"2024-09-13T18:39:14.560046+0000","last_peered":"2024-09-13T18:39:14.560046+0000","last_clean":"2024-09-13T18:39:14.560046+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:39:14.560046+0000","last_undegraded":"2024-09-13T18:39:14.560046+0000","last_fullsized":"2024-09-13T18:39:14.560046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:23.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593382+0000","last_change":"2024-09-13T18:39:14.584292+0000","last_active":"2024-09-13T18:39:14.593382+0000","last_peered":"2024-09-13T18:39:14.593382+0000","last_clean":"2024-09-13T18:39:14.593382+0000","last_became_active":"2024-09-13T18:39:14.583817+0000","last_became_peered":"2024-09-13T18:39:14.583817+0000","last_unstale":"2024-09-13T18:39:14.593382+0000","last_undegraded":"2024-09-13T18:39:14.593382+0000","last_fullsized":"2024-09-13T18:39:14.593382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:19.897995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954284+0000","last_change":"2024-09-13T18:39:09.531377+0000","last_active":"2024-09-13T18:39:14.954284+0000","last_peered":"2024-09-13T18:39:14.954284+0000","last_clean":"2024-09-13T18:39:14.954284+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:39:14.954284+0000","last_undegraded":"2024-09-13T18:39:14.954284+0000","last_fullsized":"2024-09-13T18:39:14.954284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.568234+0000","last_change":"2024-09-13T18:39:13.563570+0000","last_active":"2024-09-13T18:39:14.568234+0000","last_peered":"2024-09-13T18:39:14.568234+0000","last_clean":"2024-09-13T18:39:14.568234+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:39:14.568234+0000","last_undegraded":"2024-09-13T18:39:14.568234+0000","last_fullsized":"2024-09-13T18:39:14.568234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596295+0000","last_change":"2024-09-13T18:39:14.587017+0000","last_active":"2024-09-13T18:39:14.596295+0000","last_peered":"2024-09-13T18:39:14.596295+0000","last_clean":"2024-09-13T18:39:14.596295+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:39:14.596295+0000","last_undegraded":"2024-09-13T18:39:14.596295+0000","last_fullsized":"2024-09-13T18:39:14.596295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.955787+0000","last_change":"2024-09-13T18:39:09.533004+0000","last_active":"2024-09-13T18:39:14.955787+0000","last_peered":"2024-09-13T18:39:14.955787+0000","last_clean":"2024-09-13T18:39:14.955787+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:39:14.955787+0000","last_undegraded":"2024-09-13T18:39:14.955787+0000","last_fullsized":"2024-09-13T18:39:14.955787+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:41.079838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.565570+0000","last_change":"2024-09-13T18:39:13.579066+0000","last_active":"2024-09-13T18:39:14.565570+0000","last_peered":"2024-09-13T18:39:14.565570+0000","last_clean":"2024-09-13T18:39:14.565570+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:39:14.565570+0000","last_undegraded":"2024-09-13T18:39:14.565570+0000","last_fullsized":"2024-09-13T18:39:14.565570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600806+0000","last_change":"2024-09-13T18:39:14.589734+0000","last_active":"2024-09-13T18:39:14.600806+0000","last_peered":"2024-09-13T18:39:14.600806+0000","last_clean":"2024-09-13T18:39:14.600806+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:39:14.600806+0000","last_undegraded":"2024-09-13T18:39:14.600806+0000","last_fullsized":"2024-09-13T18:39:14.600806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954495+0000","last_change":"2024-09-13T18:39:09.532311+0000","last_active":"2024-09-13T18:39:14.954495+0000","last_peered":"2024-09-13T18:39:14.954495+0000","last_clean":"2024-09-13T18:39:14.954495+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:39:14.954495+0000","last_undegraded":"2024-09-13T18:39:14.954495+0000","last_fullsized":"2024-09-13T18:39:14.954495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:53.060128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.571185+0000","last_change":"2024-09-13T18:39:13.571488+0000","last_active":"2024-09-13T18:39:14.571185+0000","last_peered":"2024-09-13T18:39:14.571185+0000","last_clean":"2024-09-13T18:39:14.571185+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:39:14.571185+0000","last_undegraded":"2024-09-13T18:39:14.571185+0000","last_fullsized":"2024-09-13T18:39:14.571185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:44.121699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.581996+0000","last_change":"2024-09-13T18:39:14.579779+0000","last_active":"2024-09-13T18:39:14.581996+0000","last_peered":"2024-09-13T18:39:14.581996+0000","last_clean":"2024-09-13T18:39:14.581996+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:39:14.581996+0000","last_undegraded":"2024-09-13T18:39:14.581996+0000","last_fullsized":"2024-09-13T18:39:14.581996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.558628+0000","last_change":"2024-09-13T18:39:13.577844+0000","last_active":"2024-09-13T18:39:14.558628+0000","last_peered":"2024-09-13T18:39:14.558628+0000","last_clean":"2024-09-13T18:39:14.558628+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:39:14.558628+0000","last_undegraded":"2024-09-13T18:39:14.558628+0000","last_fullsized":"2024-09-13T18:39:14.558628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954762+0000","last_change":"2024-09-13T18:39:09.533091+0000","last_active":"2024-09-13T18:39:14.954762+0000","last_peered":"2024-09-13T18:39:14.954762+0000","last_clean":"2024-09-13T18:39:14.954762+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:39:14.954762+0000","last_undegraded":"2024-09-13T18:39:14.954762+0000","last_fullsized":"2024-09-13T18:39:14.954762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601570+0000","last_change":"2024-09-13T18:39:14.597238+0000","last_active":"2024-09-13T18:39:14.601570+0000","last_peered":"2024-09-13T18:39:14.601570+0000","last_clean":"2024-09-13T18:39:14.601570+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:39:14.601570+0000","last_undegraded":"2024-09-13T18:39:14.601570+0000","last_fullsized":"2024-09-13T18:39:14.601570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.849783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.561344+0000","last_change":"2024-09-13T18:39:13.583071+0000","last_active":"2024-09-13T18:39:14.561344+0000","last_peered":"2024-09-13T18:39:14.561344+0000","last_clean":"2024-09-13T18:39:14.561344+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:39:14.561344+0000","last_undegraded":"2024-09-13T18:39:14.561344+0000","last_fullsized":"2024-09-13T18:39:14.561344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.956131+0000","last_change":"2024-09-13T18:39:09.532042+0000","last_active":"2024-09-13T18:39:14.956131+0000","last_peered":"2024-09-13T18:39:14.956131+0000","last_clean":"2024-09-13T18:39:14.956131+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:39:14.956131+0000","last_undegraded":"2024-09-13T18:39:14.956131+0000","last_fullsized":"2024-09-13T18:39:14.956131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:24.541036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594579+0000","last_change":"2024-09-13T18:39:14.584428+0000","last_active":"2024-09-13T18:39:14.594579+0000","last_peered":"2024-09-13T18:39:14.594579+0000","last_clean":"2024-09-13T18:39:14.594579+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:39:14.594579+0000","last_undegraded":"2024-09-13T18:39:14.594579+0000","last_fullsized":"2024-09-13T18:39:14.594579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601380+0000","last_change":"2024-09-13T18:39:13.583868+0000","last_active":"2024-09-13T18:39:14.601380+0000","last_peered":"2024-09-13T18:39:14.601380+0000","last_clean":"2024-09-13T18:39:14.601380+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:39:14.601380+0000","last_undegraded":"2024-09-13T18:39:14.601380+0000","last_fullsized":"2024-09-13T18:39:14.601380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:52.540883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.956669+0000","last_change":"2024-09-13T18:39:09.532757+0000","last_active":"2024-09-13T18:39:14.956669+0000","last_peered":"2024-09-13T18:39:14.956669+0000","last_clean":"2024-09-13T18:39:14.956669+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:39:14.956669+0000","last_undegraded":"2024-09-13T18:39:14.956669+0000","last_fullsized":"2024-09-13T18:39:14.956669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:32.617744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588824+0000","last_change":"2024-09-13T18:39:14.582490+0000","last_active":"2024-09-13T18:39:14.588824+0000","last_peered":"2024-09-13T18:39:14.588824+0000","last_clean":"2024-09-13T18:39:14.588824+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:39:14.588824+0000","last_undegraded":"2024-09-13T18:39:14.588824+0000","last_fullsized":"2024-09-13T18:39:14.588824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:44.239715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.572182+0000","last_change":"2024-09-13T18:39:13.583929+0000","last_active":"2024-09-13T18:39:14.572182+0000","last_peered":"2024-09-13T18:39:14.572182+0000","last_clean":"2024-09-13T18:39:14.572182+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:39:14.572182+0000","last_undegraded":"2024-09-13T18:39:14.572182+0000","last_fullsized":"2024-09-13T18:39:14.572182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:57.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954641+0000","last_change":"2024-09-13T18:39:09.531717+0000","last_active":"2024-09-13T18:39:14.954641+0000","last_peered":"2024-09-13T18:39:14.954641+0000","last_clean":"2024-09-13T18:39:14.954641+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:39:14.954641+0000","last_undegraded":"2024-09-13T18:39:14.954641+0000","last_fullsized":"2024-09-13T18:39:14.954641+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:33.878130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602684+0000","last_change":"2024-09-13T18:39:14.598033+0000","last_active":"2024-09-13T18:39:14.602684+0000","last_peered":"2024-09-13T18:39:14.602684+0000","last_clean":"2024-09-13T18:39:14.602684+0000","last_became_active":"2024-09-13T18:39:14.597783+0000","last_became_peered":"2024-09-13T18:39:14.597783+0000","last_unstale":"2024-09-13T18:39:14.602684+0000","last_undegraded":"2024-09-13T18:39:14.602684+0000","last_fullsized":"2024-09-13T18:39:14.602684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:32.548971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600676+0000","last_change":"2024-09-13T18:39:14.593754+0000","last_active":"2024-09-13T18:39:14.600676+0000","last_peered":"2024-09-13T18:39:14.600676+0000","last_clean":"2024-09-13T18:39:14.600676+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:39:14.600676+0000","last_undegraded":"2024-09-13T18:39:14.600676+0000","last_fullsized":"2024-09-13T18:39:14.600676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:07.651837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.604681+0000","last_change":"2024-09-13T18:39:13.575507+0000","last_active":"2024-09-13T18:39:14.604681+0000","last_peered":"2024-09-13T18:39:14.604681+0000","last_clean":"2024-09-13T18:39:14.604681+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:39:14.604681+0000","last_undegraded":"2024-09-13T18:39:14.604681+0000","last_fullsized":"2024-09-13T18:39:14.604681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:42.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601588+0000","last_change":"2024-09-13T18:39:14.598160+0000","last_active":"2024-09-13T18:39:14.601588+0000","last_peered":"2024-09-13T18:39:14.601588+0000","last_clean":"2024-09-13T18:39:14.601588+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:39:14.601588+0000","last_undegraded":"2024-09-13T18:39:14.601588+0000","last_fullsized":"2024-09-13T18:39:14.601588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.585676+0000","last_change":"2024-09-13T18:39:13.572017+0000","last_active":"2024-09-13T18:39:14.585676+0000","last_peered":"2024-09-13T18:39:14.585676+0000","last_clean":"2024-09-13T18:39:14.585676+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:39:14.585676+0000","last_undegraded":"2024-09-13T18:39:14.585676+0000","last_fullsized":"2024-09-13T18:39:14.585676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:25.536255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.561009+0000","last_change":"2024-09-13T18:39:13.571792+0000","last_active":"2024-09-13T18:39:14.561009+0000","last_peered":"2024-09-13T18:39:14.561009+0000","last_clean":"2024-09-13T18:39:14.561009+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:39:14.561009+0000","last_undegraded":"2024-09-13T18:39:14.561009+0000","last_fullsized":"2024-09-13T18:39:14.561009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596950+0000","last_change":"2024-09-13T18:39:14.590748+0000","last_active":"2024-09-13T18:39:14.596950+0000","last_peered":"2024-09-13T18:39:14.596950+0000","last_clean":"2024-09-13T18:39:14.596950+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:39:14.596950+0000","last_undegraded":"2024-09-13T18:39:14.596950+0000","last_fullsized":"2024-09-13T18:39:14.596950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:49.557245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.572729+0000","last_change":"2024-09-13T18:39:13.569863+0000","last_active":"2024-09-13T18:39:14.572729+0000","last_peered":"2024-09-13T18:39:14.572729+0000","last_clean":"2024-09-13T18:39:14.572729+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:39:14.572729+0000","last_undegraded":"2024-09-13T18:39:14.572729+0000","last_fullsized":"2024-09-13T18:39:14.572729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588790+0000","last_change":"2024-09-13T18:39:14.582205+0000","last_active":"2024-09-13T18:39:14.588790+0000","last_peered":"2024-09-13T18:39:14.588790+0000","last_clean":"2024-09-13T18:39:14.588790+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:39:14.588790+0000","last_undegraded":"2024-09-13T18:39:14.588790+0000","last_fullsized":"2024-09-13T18:39:14.588790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.186210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588744+0000","last_change":"2024-09-13T18:39:14.584622+0000","last_active":"2024-09-13T18:39:14.588744+0000","last_peered":"2024-09-13T18:39:14.588744+0000","last_clean":"2024-09-13T18:39:14.588744+0000","last_became_active":"2024-09-13T18:39:14.584061+0000","last_became_peered":"2024-09-13T18:39:14.584061+0000","last_unstale":"2024-09-13T18:39:14.588744+0000","last_undegraded":"2024-09-13T18:39:14.588744+0000","last_fullsized":"2024-09-13T18:39:14.588744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:55.751927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.560638+0000","last_change":"2024-09-13T18:39:13.573803+0000","last_active":"2024-09-13T18:39:14.560638+0000","last_peered":"2024-09-13T18:39:14.560638+0000","last_clean":"2024-09-13T18:39:14.560638+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:39:14.560638+0000","last_undegraded":"2024-09-13T18:39:14.560638+0000","last_fullsized":"2024-09-13T18:39:14.560638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:08.298094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596277+0000","last_change":"2024-09-13T18:39:14.586848+0000","last_active":"2024-09-13T18:39:14.596277+0000","last_peered":"2024-09-13T18:39:14.596277+0000","last_clean":"2024-09-13T18:39:14.596277+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:39:14.596277+0000","last_undegraded":"2024-09-13T18:39:14.596277+0000","last_fullsized":"2024-09-13T18:39:14.596277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.564950+0000","last_change":"2024-09-13T18:39:13.586123+0000","last_active":"2024-09-13T18:39:14.564950+0000","last_peered":"2024-09-13T18:39:14.564950+0000","last_clean":"2024-09-13T18:39:14.564950+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:39:14.564950+0000","last_undegraded":"2024-09-13T18:39:14.564950+0000","last_fullsized":"2024-09-13T18:39:14.564950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.582711+0000","last_change":"2024-09-13T18:39:14.579531+0000","last_active":"2024-09-13T18:39:14.582711+0000","last_peered":"2024-09-13T18:39:14.582711+0000","last_clean":"2024-09-13T18:39:14.582711+0000","last_became_active":"2024-09-13T18:39:14.579269+0000","last_became_peered":"2024-09-13T18:39:14.579269+0000","last_unstale":"2024-09-13T18:39:14.582711+0000","last_undegraded":"2024-09-13T18:39:14.582711+0000","last_fullsized":"2024-09-13T18:39:14.582711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:09.638652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595556+0000","last_change":"2024-09-13T18:39:13.575435+0000","last_active":"2024-09-13T18:39:14.595556+0000","last_peered":"2024-09-13T18:39:14.595556+0000","last_clean":"2024-09-13T18:39:14.595556+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:39:14.595556+0000","last_undegraded":"2024-09-13T18:39:14.595556+0000","last_fullsized":"2024-09-13T18:39:14.595556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.585728+0000","last_change":"2024-09-13T18:39:14.580846+0000","last_active":"2024-09-13T18:39:14.585728+0000","last_peered":"2024-09-13T18:39:14.585728+0000","last_clean":"2024-09-13T18:39:14.585728+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:39:14.585728+0000","last_undegraded":"2024-09-13T18:39:14.585728+0000","last_fullsized":"2024-09-13T18:39:14.585728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.010053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588802+0000","last_change":"2024-09-13T18:39:13.571042+0000","last_active":"2024-09-13T18:39:14.588802+0000","last_peered":"2024-09-13T18:39:14.588802+0000","last_clean":"2024-09-13T18:39:14.588802+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:39:14.588802+0000","last_undegraded":"2024-09-13T18:39:14.588802+0000","last_fullsized":"2024-09-13T18:39:14.588802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.288993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600660+0000","last_change":"2024-09-13T18:39:14.593258+0000","last_active":"2024-09-13T18:39:14.600660+0000","last_peered":"2024-09-13T18:39:14.600660+0000","last_clean":"2024-09-13T18:39:14.600660+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:39:14.600660+0000","last_undegraded":"2024-09-13T18:39:14.600660+0000","last_fullsized":"2024-09-13T18:39:14.600660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:21.972039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600247+0000","last_change":"2024-09-13T18:39:13.584903+0000","last_active":"2024-09-13T18:39:14.600247+0000","last_peered":"2024-09-13T18:39:14.600247+0000","last_clean":"2024-09-13T18:39:14.600247+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:39:14.600247+0000","last_undegraded":"2024-09-13T18:39:14.600247+0000","last_fullsized":"2024-09-13T18:39:14.600247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:46.551317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602577+0000","last_change":"2024-09-13T18:39:14.597339+0000","last_active":"2024-09-13T18:39:14.602577+0000","last_peered":"2024-09-13T18:39:14.602577+0000","last_clean":"2024-09-13T18:39:14.602577+0000","last_became_active":"2024-09-13T18:39:14.594896+0000","last_became_peered":"2024-09-13T18:39:14.594896+0000","last_unstale":"2024-09-13T18:39:14.602577+0000","last_undegraded":"2024-09-13T18:39:14.602577+0000","last_fullsized":"2024-09-13T18:39:14.602577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:00.992631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593279+0000","last_change":"2024-09-13T18:39:13.574044+0000","last_active":"2024-09-13T18:39:14.593279+0000","last_peered":"2024-09-13T18:39:14.593279+0000","last_clean":"2024-09-13T18:39:14.593279+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:39:14.593279+0000","last_undegraded":"2024-09-13T18:39:14.593279+0000","last_fullsized":"2024-09-13T18:39:14.593279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:12.168801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596996+0000","last_change":"2024-09-13T18:39:14.591381+0000","last_active":"2024-09-13T18:39:14.596996+0000","last_peered":"2024-09-13T18:39:14.596996+0000","last_clean":"2024-09-13T18:39:14.596996+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:39:14.596996+0000","last_undegraded":"2024-09-13T18:39:14.596996+0000","last_fullsized":"2024-09-13T18:39:14.596996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:17.239023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602768+0000","last_change":"2024-09-13T18:39:13.575357+0000","last_active":"2024-09-13T18:39:14.602768+0000","last_peered":"2024-09-13T18:39:14.602768+0000","last_clean":"2024-09-13T18:39:14.602768+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:39:14.602768+0000","last_undegraded":"2024-09-13T18:39:14.602768+0000","last_fullsized":"2024-09-13T18:39:14.602768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:20.965325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.587405+0000","last_change":"2024-09-13T18:39:14.580750+0000","last_active":"2024-09-13T18:39:14.587405+0000","last_peered":"2024-09-13T18:39:14.587405+0000","last_clean":"2024-09-13T18:39:14.587405+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:39:14.587405+0000","last_undegraded":"2024-09-13T18:39:14.587405+0000","last_fullsized":"2024-09-13T18:39:14.587405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:08.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.584973+0000","last_change":"2024-09-13T18:39:13.583221+0000","last_active":"2024-09-13T18:39:14.584973+0000","last_peered":"2024-09-13T18:39:14.584973+0000","last_clean":"2024-09-13T18:39:14.584973+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:39:14.584973+0000","last_undegraded":"2024-09-13T18:39:14.584973+0000","last_fullsized":"2024-09-13T18:39:14.584973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":200704,"data_stored":57550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":155648,"data_stored":46772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":782336,"data_stored":646834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":774144,"data_stored":642570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.216}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:39:17.434 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:39:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.557+0000 7fdbaad5d640 1 Processor -- start 2024-09-13T18:39:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.557+0000 7fdbaad5d640 1 -- start start 2024-09-13T18:39:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdbaad5d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdba40a32b0 0x7fdba412f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdbaad5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdba412fed0 0x7fdba4068970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdbaad5d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba40a3680 con 0x7fdba4068eb0 2024-09-13T18:39:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdbaad5d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba4097460 con 0x7fdba40a32b0 2024-09-13T18:39:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdbaad5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba41302c0 con 0x7fdba412fed0 2024-09-13T18:39:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdba8af9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdba40a32b0 0x7fdba412f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdba412fed0 0x7fdba4068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdba92fa640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdba4068eb0 0x7fdba4136760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47762/0 (socket says 172.21.15.97:47762) 2024-09-13T18:39:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdba92fa640 1 -- 172.21.15.97:0/2332831716 learned_addr learned my addr 172.21.15.97:0/2332831716 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:17.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdba3fff640 1 -- 172.21.15.97:0/2332831716 >> v2:172.21.15.97:3300/0 conn(0x7fdba40a32b0 msgr2=0x7fdba412f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:17.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdba3fff640 1 --2- 172.21.15.97:0/2332831716 >> v2:172.21.15.97:3300/0 conn(0x7fdba40a32b0 0x7fdba412f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdba3fff640 1 -- 172.21.15.97:0/2332831716 >> v1:172.21.15.97:6789/0 conn(0x7fdba4068eb0 legacy=0x7fdba4136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdba3fff640 1 -- 172.21.15.97:0/2332831716 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba412d770 con 0x7fdba412fed0 2024-09-13T18:39:17.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdba37fe640 1 -- 172.21.15.97:0/2332831716 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292087138 0 0) 0x7fdba40a3680 con 0x7fdba4068eb0 2024-09-13T18:39:17.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.558+0000 7fdba8af9640 1 --2- 172.21.15.97:0/2332831716 >> v2:172.21.15.97:3300/0 conn(0x7fdba40a32b0 0x7fdba412f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:17.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.559+0000 7fdba3fff640 1 --2- 172.21.15.97:0/2332831716 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdba412fed0 0x7fdba4068970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009850 tx=0x7fdb900090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=227f8b64bd335f3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:17.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.559+0000 7fdba37fe640 1 -- 172.21.15.97:0/2332831716 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9002ad00 con 0x7fdba412fed0 2024-09-13T18:39:17.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.559+0000 7fdba37fe640 1 -- 172.21.15.97:0/2332831716 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9002ae60 con 0x7fdba412fed0 2024-09-13T18:39:17.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.559+0000 7fdba37fe640 1 -- 172.21.15.97:0/2332831716 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90032670 con 0x7fdba412fed0 2024-09-13T18:39:17.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.560+0000 7fdbaad5d640 1 -- 172.21.15.97:0/2332831716 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdba412fed0 msgr2=0x7fdba4068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.560+0000 7fdbaad5d640 1 --2- 172.21.15.97:0/2332831716 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdba412fed0 0x7fdba4068970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009850 tx=0x7fdb900090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.560+0000 7fdbaad5d640 1 -- 172.21.15.97:0/2332831716 shutdown_connections 2024-09-13T18:39:17.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.560+0000 7fdbaad5d640 1 --2- 172.21.15.97:0/2332831716 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdba412fed0 0x7fdba4068970 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.560+0000 7fdbaad5d640 1 --2- 172.21.15.97:0/2332831716 >> v2:172.21.15.97:3300/0 conn(0x7fdba40a32b0 0x7fdba412f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.560+0000 7fdbaad5d640 1 -- 172.21.15.97:0/2332831716 >> 172.21.15.97:0/2332831716 conn(0x7fdba406eef0 msgr2=0x7fdba40a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:17.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.560+0000 7fdbaad5d640 1 -- 172.21.15.97:0/2332831716 shutdown_connections 2024-09-13T18:39:17.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.560+0000 7fdbaad5d640 1 -- 172.21.15.97:0/2332831716 wait complete. 2024-09-13T18:39:17.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdbaad5d640 1 Processor -- start 2024-09-13T18:39:17.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdbaad5d640 1 -- start start 2024-09-13T18:39:17.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdbaad5d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdba4068eb0 0x7fdba413ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdbaad5d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdba40a32b0 0x7fdba413efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdbaad5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdba412fed0 0x7fdba41190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdbaad5d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba411ca50 con 0x7fdba40a32b0 2024-09-13T18:39:17.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdbaad5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40a2620 con 0x7fdba412fed0 2024-09-13T18:39:17.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdbaad5d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdba409e710 con 0x7fdba4068eb0 2024-09-13T18:39:17.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdba8af9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdba4068eb0 0x7fdba413ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdba92fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdba412fed0 0x7fdba41190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdba40a32b0 0x7fdba413efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdba40a32b0 0x7fdba413efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37490/0 (socket says 172.21.15.97:37490) 2024-09-13T18:39:17.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdba92fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdba412fed0 0x7fdba41190b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35762/0 (socket says 172.21.15.97:35762) 2024-09-13T18:39:17.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.561+0000 7fdba3fff640 1 -- 172.21.15.97:0/1753415545 learned_addr learned my addr 172.21.15.97:0/1753415545 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:17.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.562+0000 7fdba92fa640 1 -- 172.21.15.97:0/1753415545 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdba4068eb0 msgr2=0x7fdba413ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.562+0000 7fdba92fa640 1 --2- 172.21.15.97:0/1753415545 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdba4068eb0 0x7fdba413ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.562+0000 7fdba92fa640 1 -- 172.21.15.97:0/1753415545 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdba40a32b0 msgr2=0x7fdba413efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.562+0000 7fdba92fa640 1 --2- 172.21.15.97:0/1753415545 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdba40a32b0 0x7fdba413efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.562+0000 7fdba92fa640 1 -- 172.21.15.97:0/1753415545 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98009390 con 0x7fdba412fed0 2024-09-13T18:39:17.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.562+0000 7fdba8af9640 1 --2- 172.21.15.97:0/1753415545 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdba4068eb0 0x7fdba413ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:17.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.562+0000 7fdba3fff640 1 --2- 172.21.15.97:0/1753415545 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdba40a32b0 0x7fdba413efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:17.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.562+0000 7fdba92fa640 1 --2- 172.21.15.97:0/1753415545 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdba412fed0 0x7fdba41190b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00cbe0 tx=0x7fdb9c0019a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:17.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.562+0000 7fdba0ff9640 1 -- 172.21.15.97:0/1753415545 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c00ce00 con 0x7fdba412fed0 2024-09-13T18:39:17.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.562+0000 7fdba0ff9640 1 -- 172.21.15.97:0/1753415545 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c00a850 con 0x7fdba412fed0 2024-09-13T18:39:17.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.562+0000 7fdbaad5d640 1 -- 172.21.15.97:0/1753415545 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb90009390 con 0x7fdba412fed0 2024-09-13T18:39:17.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.562+0000 7fdba0ff9640 1 -- 172.21.15.97:0/1753415545 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c00ac90 con 0x7fdba412fed0 2024-09-13T18:39:17.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.562+0000 7fdbaad5d640 1 -- 172.21.15.97:0/1753415545 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba413f4f0 con 0x7fdba412fed0 2024-09-13T18:39:17.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.563+0000 7fdba0ff9640 1 -- 172.21.15.97:0/1753415545 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fdb9c007300 con 0x7fdba412fed0 2024-09-13T18:39:17.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.563+0000 7fdba0ff9640 1 -- 172.21.15.97:0/1753415545 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7fdb9c0420a0 con 0x7fdba412fed0 2024-09-13T18:39:17.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.563+0000 7fdbaad5d640 1 -- 172.21.15.97:0/1753415545 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba413f7a0 con 0x7fdba412fed0 2024-09-13T18:39:17.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.567+0000 7fdba0ff9640 1 -- 172.21.15.97:0/1753415545 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fdb9c0075b0 con 0x7fdba412fed0 2024-09-13T18:39:17.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.718+0000 7fdbaad5d640 1 -- 172.21.15.97:0/1753415545 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdba411a2f0 con 0x7fdb88031160 2024-09-13T18:39:17.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.724+0000 7fdba0ff9640 1 -- 172.21.15.97:0/1753415545 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271513 (unknown 2965378022 0 2274998159) 0x7fdba411a2f0 con 0x7fdb88031160 2024-09-13T18:39:17.729 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:17.731 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:39:17.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.727+0000 7fdbaad5d640 1 -- 172.21.15.97:0/1753415545 >> v1:172.21.15.97:6816/34603 conn(0x7fdb88031160 legacy=0x7fdb88033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.727+0000 7fdbaad5d640 1 -- 172.21.15.97:0/1753415545 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdba412fed0 msgr2=0x7fdba41190b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.727+0000 7fdbaad5d640 1 --2- 172.21.15.97:0/1753415545 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdba412fed0 0x7fdba41190b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00cbe0 tx=0x7fdb9c0019a0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.727+0000 7fdbaad5d640 1 -- 172.21.15.97:0/1753415545 shutdown_connections 2024-09-13T18:39:17.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.727+0000 7fdbaad5d640 1 --2- 172.21.15.97:0/1753415545 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdba412fed0 0x7fdba41190b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.727+0000 7fdbaad5d640 1 --2- 172.21.15.97:0/1753415545 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdba40a32b0 0x7fdba413efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.727+0000 7fdbaad5d640 1 --2- 172.21.15.97:0/1753415545 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdba4068eb0 0x7fdba413ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.727+0000 7fdbaad5d640 1 -- 172.21.15.97:0/1753415545 >> 172.21.15.97:0/1753415545 conn(0x7fdba406eef0 msgr2=0x7fdba40a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:17.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.727+0000 7fdbaad5d640 1 -- 172.21.15.97:0/1753415545 shutdown_connections 2024-09-13T18:39:17.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.727+0000 7fdbaad5d640 1 -- 172.21.15.97:0/1753415545 wait complete. 2024-09-13T18:39:17.740 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-13T18:39:17.349352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592725,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":125,"num_write_kb":1121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":201,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1191312,"kb_used_data":1868,"kb_used_omap":6,"kb_used_meta":1189369,"kb_avail":376296048,"statfs":{"total":386547056640,"available":385327153152,"internally_reserved":0,"allocated":1912832,"data_stored":1393726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1217914208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.804245"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600365+0000","last_change":"2024-09-13T18:39:14.592723+0000","last_active":"2024-09-13T18:39:14.600365+0000","last_peered":"2024-09-13T18:39:14.600365+0000","last_clean":"2024-09-13T18:39:14.600365+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:39:14.600365+0000","last_undegraded":"2024-09-13T18:39:14.600365+0000","last_fullsized":"2024-09-13T18:39:14.600365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:09.304808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.587573+0000","last_change":"2024-09-13T18:39:14.581266+0000","last_active":"2024-09-13T18:39:14.587573+0000","last_peered":"2024-09-13T18:39:14.587573+0000","last_clean":"2024-09-13T18:39:14.587573+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:39:14.587573+0000","last_undegraded":"2024-09-13T18:39:14.587573+0000","last_fullsized":"2024-09-13T18:39:14.587573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594566+0000","last_change":"2024-09-13T18:39:14.586254+0000","last_active":"2024-09-13T18:39:14.594566+0000","last_peered":"2024-09-13T18:39:14.594566+0000","last_clean":"2024-09-13T18:39:14.594566+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:39:14.594566+0000","last_undegraded":"2024-09-13T18:39:14.594566+0000","last_fullsized":"2024-09-13T18:39:14.594566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594551+0000","last_change":"2024-09-13T18:39:14.583960+0000","last_active":"2024-09-13T18:39:14.594551+0000","last_peered":"2024-09-13T18:39:14.594551+0000","last_clean":"2024-09-13T18:39:14.594551+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:39:14.594551+0000","last_undegraded":"2024-09-13T18:39:14.594551+0000","last_fullsized":"2024-09-13T18:39:14.594551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.589815+0000","last_change":"2024-09-13T18:39:14.577865+0000","last_active":"2024-09-13T18:39:14.589815+0000","last_peered":"2024-09-13T18:39:14.589815+0000","last_clean":"2024-09-13T18:39:14.589815+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:39:14.589815+0000","last_undegraded":"2024-09-13T18:39:14.589815+0000","last_fullsized":"2024-09-13T18:39:14.589815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595808+0000","last_change":"2024-09-13T18:39:14.590785+0000","last_active":"2024-09-13T18:39:14.595808+0000","last_peered":"2024-09-13T18:39:14.595808+0000","last_clean":"2024-09-13T18:39:14.595808+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:39:14.595808+0000","last_undegraded":"2024-09-13T18:39:14.595808+0000","last_fullsized":"2024-09-13T18:39:14.595808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:24.453184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596969+0000","last_change":"2024-09-13T18:39:14.590893+0000","last_active":"2024-09-13T18:39:14.596969+0000","last_peered":"2024-09-13T18:39:14.596969+0000","last_clean":"2024-09-13T18:39:14.596969+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:39:14.596969+0000","last_undegraded":"2024-09-13T18:39:14.596969+0000","last_fullsized":"2024-09-13T18:39:14.596969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:57.986187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601078+0000","last_change":"2024-09-13T18:39:14.595160+0000","last_active":"2024-09-13T18:39:14.601078+0000","last_peered":"2024-09-13T18:39:14.601078+0000","last_clean":"2024-09-13T18:39:14.601078+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:39:14.601078+0000","last_undegraded":"2024-09-13T18:39:14.601078+0000","last_fullsized":"2024-09-13T18:39:14.601078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595272+0000","last_change":"2024-09-13T18:39:14.586790+0000","last_active":"2024-09-13T18:39:14.595272+0000","last_peered":"2024-09-13T18:39:14.595272+0000","last_clean":"2024-09-13T18:39:14.595272+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:39:14.595272+0000","last_undegraded":"2024-09-13T18:39:14.595272+0000","last_fullsized":"2024-09-13T18:39:14.595272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:49.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601065+0000","last_change":"2024-09-13T18:39:14.591231+0000","last_active":"2024-09-13T18:39:14.601065+0000","last_peered":"2024-09-13T18:39:14.601065+0000","last_clean":"2024-09-13T18:39:14.601065+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:39:14.601065+0000","last_undegraded":"2024-09-13T18:39:14.601065+0000","last_fullsized":"2024-09-13T18:39:14.601065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600581+0000","last_change":"2024-09-13T18:39:14.589017+0000","last_active":"2024-09-13T18:39:14.600581+0000","last_peered":"2024-09-13T18:39:14.600581+0000","last_clean":"2024-09-13T18:39:14.600581+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:39:14.600581+0000","last_undegraded":"2024-09-13T18:39:14.600581+0000","last_fullsized":"2024-09-13T18:39:14.600581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600392+0000","last_change":"2024-09-13T18:39:14.592629+0000","last_active":"2024-09-13T18:39:14.600392+0000","last_peered":"2024-09-13T18:39:14.600392+0000","last_clean":"2024-09-13T18:39:14.600392+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:39:14.600392+0000","last_undegraded":"2024-09-13T18:39:14.600392+0000","last_fullsized":"2024-09-13T18:39:14.600392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602649+0000","last_change":"2024-09-13T18:39:14.597709+0000","last_active":"2024-09-13T18:39:14.602649+0000","last_peered":"2024-09-13T18:39:14.602649+0000","last_clean":"2024-09-13T18:39:14.602649+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:39:14.602649+0000","last_undegraded":"2024-09-13T18:39:14.602649+0000","last_fullsized":"2024-09-13T18:39:14.602649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.367739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.580120+0000","last_change":"2024-09-13T18:39:14.572267+0000","last_active":"2024-09-13T18:39:14.580120+0000","last_peered":"2024-09-13T18:39:14.580120+0000","last_clean":"2024-09-13T18:39:14.580120+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:39:14.580120+0000","last_undegraded":"2024-09-13T18:39:14.580120+0000","last_fullsized":"2024-09-13T18:39:14.580120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595134+0000","last_change":"2024-09-13T18:39:14.583318+0000","last_active":"2024-09-13T18:39:14.595134+0000","last_peered":"2024-09-13T18:39:14.595134+0000","last_clean":"2024-09-13T18:39:14.595134+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:39:14.595134+0000","last_undegraded":"2024-09-13T18:39:14.595134+0000","last_fullsized":"2024-09-13T18:39:14.595134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596097+0000","last_change":"2024-09-13T18:39:14.592378+0000","last_active":"2024-09-13T18:39:14.596097+0000","last_peered":"2024-09-13T18:39:14.596097+0000","last_clean":"2024-09-13T18:39:14.596097+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:39:14.596097+0000","last_undegraded":"2024-09-13T18:39:14.596097+0000","last_fullsized":"2024-09-13T18:39:14.596097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:02.414361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596564+0000","last_change":"2024-09-13T18:39:14.586945+0000","last_active":"2024-09-13T18:39:14.596564+0000","last_peered":"2024-09-13T18:39:14.596564+0000","last_clean":"2024-09-13T18:39:14.596564+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:39:14.596564+0000","last_undegraded":"2024-09-13T18:39:14.596564+0000","last_fullsized":"2024-09-13T18:39:14.596564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:57.889039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596311+0000","last_change":"2024-09-13T18:39:14.587172+0000","last_active":"2024-09-13T18:39:14.596311+0000","last_peered":"2024-09-13T18:39:14.596311+0000","last_clean":"2024-09-13T18:39:14.596311+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:39:14.596311+0000","last_undegraded":"2024-09-13T18:39:14.596311+0000","last_fullsized":"2024-09-13T18:39:14.596311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600634+0000","last_change":"2024-09-13T18:39:14.594291+0000","last_active":"2024-09-13T18:39:14.600634+0000","last_peered":"2024-09-13T18:39:14.600634+0000","last_clean":"2024-09-13T18:39:14.600634+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:39:14.600634+0000","last_undegraded":"2024-09-13T18:39:14.600634+0000","last_fullsized":"2024-09-13T18:39:14.600634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:29.208875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600015+0000","last_change":"2024-09-13T18:39:14.585973+0000","last_active":"2024-09-13T18:39:14.600015+0000","last_peered":"2024-09-13T18:39:14.600015+0000","last_clean":"2024-09-13T18:39:14.600015+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:39:14.600015+0000","last_undegraded":"2024-09-13T18:39:14.600015+0000","last_fullsized":"2024-09-13T18:39:14.600015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:48.875040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601035+0000","last_change":"2024-09-13T18:39:14.595451+0000","last_active":"2024-09-13T18:39:14.601035+0000","last_peered":"2024-09-13T18:39:14.601035+0000","last_clean":"2024-09-13T18:39:14.601035+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:39:14.601035+0000","last_undegraded":"2024-09-13T18:39:14.601035+0000","last_fullsized":"2024-09-13T18:39:14.601035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:45.368802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594643+0000","last_change":"2024-09-13T18:39:14.583590+0000","last_active":"2024-09-13T18:39:14.594643+0000","last_peered":"2024-09-13T18:39:14.594643+0000","last_clean":"2024-09-13T18:39:14.594643+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:39:14.594643+0000","last_undegraded":"2024-09-13T18:39:14.594643+0000","last_fullsized":"2024-09-13T18:39:14.594643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596929+0000","last_change":"2024-09-13T18:39:14.590724+0000","last_active":"2024-09-13T18:39:14.596929+0000","last_peered":"2024-09-13T18:39:14.596929+0000","last_clean":"2024-09-13T18:39:14.596929+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:39:14.596929+0000","last_undegraded":"2024-09-13T18:39:14.596929+0000","last_fullsized":"2024-09-13T18:39:14.596929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:09.353955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.581250+0000","last_change":"2024-09-13T18:39:14.577642+0000","last_active":"2024-09-13T18:39:14.581250+0000","last_peered":"2024-09-13T18:39:14.581250+0000","last_clean":"2024-09-13T18:39:14.581250+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:39:14.581250+0000","last_undegraded":"2024-09-13T18:39:14.581250+0000","last_fullsized":"2024-09-13T18:39:14.581250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601088+0000","last_change":"2024-09-13T18:39:14.592432+0000","last_active":"2024-09-13T18:39:14.601088+0000","last_peered":"2024-09-13T18:39:14.601088+0000","last_clean":"2024-09-13T18:39:14.601088+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:39:14.601088+0000","last_undegraded":"2024-09-13T18:39:14.601088+0000","last_fullsized":"2024-09-13T18:39:14.601088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:43.945214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.577721+0000","last_change":"2024-09-13T18:39:14.571893+0000","last_active":"2024-09-13T18:39:14.577721+0000","last_peered":"2024-09-13T18:39:14.577721+0000","last_clean":"2024-09-13T18:39:14.577721+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:39:14.577721+0000","last_undegraded":"2024-09-13T18:39:14.577721+0000","last_fullsized":"2024-09-13T18:39:14.577721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596328+0000","last_change":"2024-09-13T18:39:14.594222+0000","last_active":"2024-09-13T18:39:14.596328+0000","last_peered":"2024-09-13T18:39:14.596328+0000","last_clean":"2024-09-13T18:39:14.596328+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:39:14.596328+0000","last_undegraded":"2024-09-13T18:39:14.596328+0000","last_fullsized":"2024-09-13T18:39:14.596328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:20.265556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.580499+0000","last_change":"2024-09-13T18:39:14.576203+0000","last_active":"2024-09-13T18:39:14.580499+0000","last_peered":"2024-09-13T18:39:14.580499+0000","last_clean":"2024-09-13T18:39:14.580499+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:39:14.580499+0000","last_undegraded":"2024-09-13T18:39:14.580499+0000","last_fullsized":"2024-09-13T18:39:14.580499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593337+0000","last_change":"2024-09-13T18:39:14.586374+0000","last_active":"2024-09-13T18:39:14.593337+0000","last_peered":"2024-09-13T18:39:14.593337+0000","last_clean":"2024-09-13T18:39:14.593337+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:39:14.593337+0000","last_undegraded":"2024-09-13T18:39:14.593337+0000","last_fullsized":"2024-09-13T18:39:14.593337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:03.191196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.589263+0000","last_change":"2024-09-13T18:39:14.577392+0000","last_active":"2024-09-13T18:39:14.589263+0000","last_peered":"2024-09-13T18:39:14.589263+0000","last_clean":"2024-09-13T18:39:14.589263+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:39:14.589263+0000","last_undegraded":"2024-09-13T18:39:14.589263+0000","last_fullsized":"2024-09-13T18:39:14.589263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:26.709807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.584973+0000","last_change":"2024-09-13T18:39:14.580898+0000","last_active":"2024-09-13T18:39:14.584973+0000","last_peered":"2024-09-13T18:39:14.584973+0000","last_clean":"2024-09-13T18:39:14.584973+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:39:14.584973+0000","last_undegraded":"2024-09-13T18:39:14.584973+0000","last_fullsized":"2024-09-13T18:39:14.584973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:23.630337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.579587+0000","last_change":"2024-09-13T18:39:14.574811+0000","last_active":"2024-09-13T18:39:14.579587+0000","last_peered":"2024-09-13T18:39:14.579587+0000","last_clean":"2024-09-13T18:39:14.579587+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:39:14.579587+0000","last_undegraded":"2024-09-13T18:39:14.579587+0000","last_fullsized":"2024-09-13T18:39:14.579587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.582621+0000","last_change":"2024-09-13T18:39:14.579494+0000","last_active":"2024-09-13T18:39:14.582621+0000","last_peered":"2024-09-13T18:39:14.582621+0000","last_clean":"2024-09-13T18:39:14.582621+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:39:14.582621+0000","last_undegraded":"2024-09-13T18:39:14.582621+0000","last_fullsized":"2024-09-13T18:39:14.582621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:19.432936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.598948+0000","last_change":"2024-09-13T18:39:13.575179+0000","last_active":"2024-09-13T18:39:14.598948+0000","last_peered":"2024-09-13T18:39:14.598948+0000","last_clean":"2024-09-13T18:39:14.598948+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:39:14.598948+0000","last_undegraded":"2024-09-13T18:39:14.598948+0000","last_fullsized":"2024-09-13T18:39:14.598948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:25.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596311+0000","last_change":"2024-09-13T18:39:14.594066+0000","last_active":"2024-09-13T18:39:14.596311+0000","last_peered":"2024-09-13T18:39:14.596311+0000","last_clean":"2024-09-13T18:39:14.596311+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:39:14.596311+0000","last_undegraded":"2024-09-13T18:39:14.596311+0000","last_fullsized":"2024-09-13T18:39:14.596311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:14.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.565149+0000","last_change":"2024-09-13T18:39:13.570778+0000","last_active":"2024-09-13T18:39:14.565149+0000","last_peered":"2024-09-13T18:39:14.565149+0000","last_clean":"2024-09-13T18:39:14.565149+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:39:14.565149+0000","last_undegraded":"2024-09-13T18:39:14.565149+0000","last_fullsized":"2024-09-13T18:39:14.565149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596329+0000","last_change":"2024-09-13T18:39:14.587863+0000","last_active":"2024-09-13T18:39:14.596329+0000","last_peered":"2024-09-13T18:39:14.596329+0000","last_clean":"2024-09-13T18:39:14.596329+0000","last_became_active":"2024-09-13T18:39:14.587626+0000","last_became_peered":"2024-09-13T18:39:14.587626+0000","last_unstale":"2024-09-13T18:39:14.596329+0000","last_undegraded":"2024-09-13T18:39:14.596329+0000","last_fullsized":"2024-09-13T18:39:14.596329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.566954+0000","last_change":"2024-09-13T18:39:13.575436+0000","last_active":"2024-09-13T18:39:14.566954+0000","last_peered":"2024-09-13T18:39:14.566954+0000","last_clean":"2024-09-13T18:39:14.566954+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:39:14.566954+0000","last_undegraded":"2024-09-13T18:39:14.566954+0000","last_fullsized":"2024-09-13T18:39:14.566954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:34.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588763+0000","last_change":"2024-09-13T18:39:14.584791+0000","last_active":"2024-09-13T18:39:14.588763+0000","last_peered":"2024-09-13T18:39:14.588763+0000","last_clean":"2024-09-13T18:39:14.588763+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:39:14.588763+0000","last_undegraded":"2024-09-13T18:39:14.588763+0000","last_fullsized":"2024-09-13T18:39:14.588763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:08.799126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601033+0000","last_change":"2024-09-13T18:39:13.578940+0000","last_active":"2024-09-13T18:39:14.601033+0000","last_peered":"2024-09-13T18:39:14.601033+0000","last_clean":"2024-09-13T18:39:14.601033+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:39:14.601033+0000","last_undegraded":"2024-09-13T18:39:14.601033+0000","last_fullsized":"2024-09-13T18:39:14.601033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:34.109209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.585065+0000","last_change":"2024-09-13T18:39:13.583184+0000","last_active":"2024-09-13T18:39:14.585065+0000","last_peered":"2024-09-13T18:39:14.585065+0000","last_clean":"2024-09-13T18:39:14.585065+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:39:14.585065+0000","last_undegraded":"2024-09-13T18:39:14.585065+0000","last_fullsized":"2024-09-13T18:39:14.585065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588808+0000","last_change":"2024-09-13T18:39:14.582349+0000","last_active":"2024-09-13T18:39:14.588808+0000","last_peered":"2024-09-13T18:39:14.588808+0000","last_clean":"2024-09-13T18:39:14.588808+0000","last_became_active":"2024-09-13T18:39:14.581643+0000","last_became_peered":"2024-09-13T18:39:14.581643+0000","last_unstale":"2024-09-13T18:39:14.588808+0000","last_undegraded":"2024-09-13T18:39:14.588808+0000","last_fullsized":"2024-09-13T18:39:14.588808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:34.221522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588626+0000","last_change":"2024-09-13T18:39:13.571043+0000","last_active":"2024-09-13T18:39:14.588626+0000","last_peered":"2024-09-13T18:39:14.588626+0000","last_clean":"2024-09-13T18:39:14.588626+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:39:14.588626+0000","last_undegraded":"2024-09-13T18:39:14.588626+0000","last_fullsized":"2024-09-13T18:39:14.588626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.757855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.580443+0000","last_change":"2024-09-13T18:39:14.577177+0000","last_active":"2024-09-13T18:39:14.580443+0000","last_peered":"2024-09-13T18:39:14.580443+0000","last_clean":"2024-09-13T18:39:14.580443+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:39:14.580443+0000","last_undegraded":"2024-09-13T18:39:14.580443+0000","last_fullsized":"2024-09-13T18:39:14.580443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601502+0000","last_change":"2024-09-13T18:39:13.581627+0000","last_active":"2024-09-13T18:39:14.601502+0000","last_peered":"2024-09-13T18:39:14.601502+0000","last_clean":"2024-09-13T18:39:14.601502+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:39:14.601502+0000","last_undegraded":"2024-09-13T18:39:14.601502+0000","last_fullsized":"2024-09-13T18:39:14.601502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:48.023626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602556+0000","last_change":"2024-09-13T18:39:14.596602+0000","last_active":"2024-09-13T18:39:14.602556+0000","last_peered":"2024-09-13T18:39:14.602556+0000","last_clean":"2024-09-13T18:39:14.602556+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:39:14.602556+0000","last_undegraded":"2024-09-13T18:39:14.602556+0000","last_fullsized":"2024-09-13T18:39:14.602556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:35.414913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.570529+0000","last_change":"2024-09-13T18:39:13.570169+0000","last_active":"2024-09-13T18:39:14.570529+0000","last_peered":"2024-09-13T18:39:14.570529+0000","last_clean":"2024-09-13T18:39:14.570529+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:39:14.570529+0000","last_undegraded":"2024-09-13T18:39:14.570529+0000","last_fullsized":"2024-09-13T18:39:14.570529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594596+0000","last_change":"2024-09-13T18:39:14.584580+0000","last_active":"2024-09-13T18:39:14.594596+0000","last_peered":"2024-09-13T18:39:14.594596+0000","last_clean":"2024-09-13T18:39:14.594596+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:39:14.594596+0000","last_undegraded":"2024-09-13T18:39:14.594596+0000","last_fullsized":"2024-09-13T18:39:14.594596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.598820+0000","last_change":"2024-09-13T18:39:13.575713+0000","last_active":"2024-09-13T18:39:14.598820+0000","last_peered":"2024-09-13T18:39:14.598820+0000","last_clean":"2024-09-13T18:39:14.598820+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:39:14.598820+0000","last_undegraded":"2024-09-13T18:39:14.598820+0000","last_fullsized":"2024-09-13T18:39:14.598820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:59.985917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.589332+0000","last_change":"2024-09-13T18:39:14.577151+0000","last_active":"2024-09-13T18:39:14.589332+0000","last_peered":"2024-09-13T18:39:14.589332+0000","last_clean":"2024-09-13T18:39:14.589332+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:39:14.589332+0000","last_undegraded":"2024-09-13T18:39:14.589332+0000","last_fullsized":"2024-09-13T18:39:14.589332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.559598+0000","last_change":"2024-09-13T18:39:13.581445+0000","last_active":"2024-09-13T18:39:14.559598+0000","last_peered":"2024-09-13T18:39:14.559598+0000","last_clean":"2024-09-13T18:39:14.559598+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:39:14.559598+0000","last_undegraded":"2024-09-13T18:39:14.559598+0000","last_fullsized":"2024-09-13T18:39:14.559598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:39.003339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593363+0000","last_change":"2024-09-13T18:39:14.584122+0000","last_active":"2024-09-13T18:39:14.593363+0000","last_peered":"2024-09-13T18:39:14.593363+0000","last_clean":"2024-09-13T18:39:14.593363+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:39:14.593363+0000","last_undegraded":"2024-09-13T18:39:14.593363+0000","last_fullsized":"2024-09-13T18:39:14.593363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:30.405734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.563524+0000","last_change":"2024-09-13T18:39:13.575316+0000","last_active":"2024-09-13T18:39:14.563524+0000","last_peered":"2024-09-13T18:39:14.563524+0000","last_clean":"2024-09-13T18:39:14.563524+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:39:14.563524+0000","last_undegraded":"2024-09-13T18:39:14.563524+0000","last_fullsized":"2024-09-13T18:39:14.563524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:06.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600699+0000","last_change":"2024-09-13T18:39:14.593058+0000","last_active":"2024-09-13T18:39:14.600699+0000","last_peered":"2024-09-13T18:39:14.600699+0000","last_clean":"2024-09-13T18:39:14.600699+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:39:14.600699+0000","last_undegraded":"2024-09-13T18:39:14.600699+0000","last_fullsized":"2024-09-13T18:39:14.600699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:24.454698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.560704+0000","last_change":"2024-09-13T18:39:13.581217+0000","last_active":"2024-09-13T18:39:14.560704+0000","last_peered":"2024-09-13T18:39:14.560704+0000","last_clean":"2024-09-13T18:39:14.560704+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:39:14.560704+0000","last_undegraded":"2024-09-13T18:39:14.560704+0000","last_fullsized":"2024-09-13T18:39:14.560704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:27.361025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601513+0000","last_change":"2024-09-13T18:39:14.596597+0000","last_active":"2024-09-13T18:39:14.601513+0000","last_peered":"2024-09-13T18:39:14.601513+0000","last_clean":"2024-09-13T18:39:14.601513+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:39:14.601513+0000","last_undegraded":"2024-09-13T18:39:14.601513+0000","last_fullsized":"2024-09-13T18:39:14.601513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:47.680908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.565720+0000","last_change":"2024-09-13T18:39:03.413753+0000","last_active":"2024-09-13T18:39:14.565720+0000","last_peered":"2024-09-13T18:39:14.565720+0000","last_clean":"2024-09-13T18:39:14.565720+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:39:14.565720+0000","last_undegraded":"2024-09-13T18:39:14.565720+0000","last_fullsized":"2024-09-13T18:39:14.565720+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.425159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:05.703287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954507+0000","last_change":"2024-09-13T18:39:09.531787+0000","last_active":"2024-09-13T18:39:14.954507+0000","last_peered":"2024-09-13T18:39:14.954507+0000","last_clean":"2024-09-13T18:39:14.954507+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:39:14.954507+0000","last_undegraded":"2024-09-13T18:39:14.954507+0000","last_fullsized":"2024-09-13T18:39:14.954507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:21.652872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.560046+0000","last_change":"2024-09-13T18:39:13.575940+0000","last_active":"2024-09-13T18:39:14.560046+0000","last_peered":"2024-09-13T18:39:14.560046+0000","last_clean":"2024-09-13T18:39:14.560046+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:39:14.560046+0000","last_undegraded":"2024-09-13T18:39:14.560046+0000","last_fullsized":"2024-09-13T18:39:14.560046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:23.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593382+0000","last_change":"2024-09-13T18:39:14.584292+0000","last_active":"2024-09-13T18:39:14.593382+0000","last_peered":"2024-09-13T18:39:14.593382+0000","last_clean":"2024-09-13T18:39:14.593382+0000","last_became_active":"2024-09-13T18:39:14.583817+0000","last_became_peered":"2024-09-13T18:39:14.583817+0000","last_unstale":"2024-09-13T18:39:14.593382+0000","last_undegraded":"2024-09-13T18:39:14.593382+0000","last_fullsized":"2024-09-13T18:39:14.593382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:19.897995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954284+0000","last_change":"2024-09-13T18:39:09.531377+0000","last_active":"2024-09-13T18:39:14.954284+0000","last_peered":"2024-09-13T18:39:14.954284+0000","last_clean":"2024-09-13T18:39:14.954284+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:39:14.954284+0000","last_undegraded":"2024-09-13T18:39:14.954284+0000","last_fullsized":"2024-09-13T18:39:14.954284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.568234+0000","last_change":"2024-09-13T18:39:13.563570+0000","last_active":"2024-09-13T18:39:14.568234+0000","last_peered":"2024-09-13T18:39:14.568234+0000","last_clean":"2024-09-13T18:39:14.568234+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:39:14.568234+0000","last_undegraded":"2024-09-13T18:39:14.568234+0000","last_fullsized":"2024-09-13T18:39:14.568234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596295+0000","last_change":"2024-09-13T18:39:14.587017+0000","last_active":"2024-09-13T18:39:14.596295+0000","last_peered":"2024-09-13T18:39:14.596295+0000","last_clean":"2024-09-13T18:39:14.596295+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:39:14.596295+0000","last_undegraded":"2024-09-13T18:39:14.596295+0000","last_fullsized":"2024-09-13T18:39:14.596295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.955787+0000","last_change":"2024-09-13T18:39:09.533004+0000","last_active":"2024-09-13T18:39:14.955787+0000","last_peered":"2024-09-13T18:39:14.955787+0000","last_clean":"2024-09-13T18:39:14.955787+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:39:14.955787+0000","last_undegraded":"2024-09-13T18:39:14.955787+0000","last_fullsized":"2024-09-13T18:39:14.955787+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:41.079838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.565570+0000","last_change":"2024-09-13T18:39:13.579066+0000","last_active":"2024-09-13T18:39:14.565570+0000","last_peered":"2024-09-13T18:39:14.565570+0000","last_clean":"2024-09-13T18:39:14.565570+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:39:14.565570+0000","last_undegraded":"2024-09-13T18:39:14.565570+0000","last_fullsized":"2024-09-13T18:39:14.565570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600806+0000","last_change":"2024-09-13T18:39:14.589734+0000","last_active":"2024-09-13T18:39:14.600806+0000","last_peered":"2024-09-13T18:39:14.600806+0000","last_clean":"2024-09-13T18:39:14.600806+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:39:14.600806+0000","last_undegraded":"2024-09-13T18:39:14.600806+0000","last_fullsized":"2024-09-13T18:39:14.600806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954495+0000","last_change":"2024-09-13T18:39:09.532311+0000","last_active":"2024-09-13T18:39:14.954495+0000","last_peered":"2024-09-13T18:39:14.954495+0000","last_clean":"2024-09-13T18:39:14.954495+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:39:14.954495+0000","last_undegraded":"2024-09-13T18:39:14.954495+0000","last_fullsized":"2024-09-13T18:39:14.954495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:53.060128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.571185+0000","last_change":"2024-09-13T18:39:13.571488+0000","last_active":"2024-09-13T18:39:14.571185+0000","last_peered":"2024-09-13T18:39:14.571185+0000","last_clean":"2024-09-13T18:39:14.571185+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:39:14.571185+0000","last_undegraded":"2024-09-13T18:39:14.571185+0000","last_fullsized":"2024-09-13T18:39:14.571185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:44.121699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.581996+0000","last_change":"2024-09-13T18:39:14.579779+0000","last_active":"2024-09-13T18:39:14.581996+0000","last_peered":"2024-09-13T18:39:14.581996+0000","last_clean":"2024-09-13T18:39:14.581996+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:39:14.581996+0000","last_undegraded":"2024-09-13T18:39:14.581996+0000","last_fullsized":"2024-09-13T18:39:14.581996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.558628+0000","last_change":"2024-09-13T18:39:13.577844+0000","last_active":"2024-09-13T18:39:14.558628+0000","last_peered":"2024-09-13T18:39:14.558628+0000","last_clean":"2024-09-13T18:39:14.558628+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:39:14.558628+0000","last_undegraded":"2024-09-13T18:39:14.558628+0000","last_fullsized":"2024-09-13T18:39:14.558628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954762+0000","last_change":"2024-09-13T18:39:09.533091+0000","last_active":"2024-09-13T18:39:14.954762+0000","last_peered":"2024-09-13T18:39:14.954762+0000","last_clean":"2024-09-13T18:39:14.954762+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:39:14.954762+0000","last_undegraded":"2024-09-13T18:39:14.954762+0000","last_fullsized":"2024-09-13T18:39:14.954762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601570+0000","last_change":"2024-09-13T18:39:14.597238+0000","last_active":"2024-09-13T18:39:14.601570+0000","last_peered":"2024-09-13T18:39:14.601570+0000","last_clean":"2024-09-13T18:39:14.601570+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:39:14.601570+0000","last_undegraded":"2024-09-13T18:39:14.601570+0000","last_fullsized":"2024-09-13T18:39:14.601570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.849783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.561344+0000","last_change":"2024-09-13T18:39:13.583071+0000","last_active":"2024-09-13T18:39:14.561344+0000","last_peered":"2024-09-13T18:39:14.561344+0000","last_clean":"2024-09-13T18:39:14.561344+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:39:14.561344+0000","last_undegraded":"2024-09-13T18:39:14.561344+0000","last_fullsized":"2024-09-13T18:39:14.561344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.956131+0000","last_change":"2024-09-13T18:39:09.532042+0000","last_active":"2024-09-13T18:39:14.956131+0000","last_peered":"2024-09-13T18:39:14.956131+0000","last_clean":"2024-09-13T18:39:14.956131+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:39:14.956131+0000","last_undegraded":"2024-09-13T18:39:14.956131+0000","last_fullsized":"2024-09-13T18:39:14.956131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:24.541036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594579+0000","last_change":"2024-09-13T18:39:14.584428+0000","last_active":"2024-09-13T18:39:14.594579+0000","last_peered":"2024-09-13T18:39:14.594579+0000","last_clean":"2024-09-13T18:39:14.594579+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:39:14.594579+0000","last_undegraded":"2024-09-13T18:39:14.594579+0000","last_fullsized":"2024-09-13T18:39:14.594579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601380+0000","last_change":"2024-09-13T18:39:13.583868+0000","last_active":"2024-09-13T18:39:14.601380+0000","last_peered":"2024-09-13T18:39:14.601380+0000","last_clean":"2024-09-13T18:39:14.601380+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:39:14.601380+0000","last_undegraded":"2024-09-13T18:39:14.601380+0000","last_fullsized":"2024-09-13T18:39:14.601380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:52.540883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.956669+0000","last_change":"2024-09-13T18:39:09.532757+0000","last_active":"2024-09-13T18:39:14.956669+0000","last_peered":"2024-09-13T18:39:14.956669+0000","last_clean":"2024-09-13T18:39:14.956669+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:39:14.956669+0000","last_undegraded":"2024-09-13T18:39:14.956669+0000","last_fullsized":"2024-09-13T18:39:14.956669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:32.617744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588824+0000","last_change":"2024-09-13T18:39:14.582490+0000","last_active":"2024-09-13T18:39:14.588824+0000","last_peered":"2024-09-13T18:39:14.588824+0000","last_clean":"2024-09-13T18:39:14.588824+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:39:14.588824+0000","last_undegraded":"2024-09-13T18:39:14.588824+0000","last_fullsized":"2024-09-13T18:39:14.588824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:44.239715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.572182+0000","last_change":"2024-09-13T18:39:13.583929+0000","last_active":"2024-09-13T18:39:14.572182+0000","last_peered":"2024-09-13T18:39:14.572182+0000","last_clean":"2024-09-13T18:39:14.572182+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:39:14.572182+0000","last_undegraded":"2024-09-13T18:39:14.572182+0000","last_fullsized":"2024-09-13T18:39:14.572182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:57.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954641+0000","last_change":"2024-09-13T18:39:09.531717+0000","last_active":"2024-09-13T18:39:14.954641+0000","last_peered":"2024-09-13T18:39:14.954641+0000","last_clean":"2024-09-13T18:39:14.954641+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:39:14.954641+0000","last_undegraded":"2024-09-13T18:39:14.954641+0000","last_fullsized":"2024-09-13T18:39:14.954641+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:33.878130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602684+0000","last_change":"2024-09-13T18:39:14.598033+0000","last_active":"2024-09-13T18:39:14.602684+0000","last_peered":"2024-09-13T18:39:14.602684+0000","last_clean":"2024-09-13T18:39:14.602684+0000","last_became_active":"2024-09-13T18:39:14.597783+0000","last_became_peered":"2024-09-13T18:39:14.597783+0000","last_unstale":"2024-09-13T18:39:14.602684+0000","last_undegraded":"2024-09-13T18:39:14.602684+0000","last_fullsized":"2024-09-13T18:39:14.602684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:32.548971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600676+0000","last_change":"2024-09-13T18:39:14.593754+0000","last_active":"2024-09-13T18:39:14.600676+0000","last_peered":"2024-09-13T18:39:14.600676+0000","last_clean":"2024-09-13T18:39:14.600676+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:39:14.600676+0000","last_undegraded":"2024-09-13T18:39:14.600676+0000","last_fullsized":"2024-09-13T18:39:14.600676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:07.651837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.604681+0000","last_change":"2024-09-13T18:39:13.575507+0000","last_active":"2024-09-13T18:39:14.604681+0000","last_peered":"2024-09-13T18:39:14.604681+0000","last_clean":"2024-09-13T18:39:14.604681+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:39:14.604681+0000","last_undegraded":"2024-09-13T18:39:14.604681+0000","last_fullsized":"2024-09-13T18:39:14.604681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:42.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601588+0000","last_change":"2024-09-13T18:39:14.598160+0000","last_active":"2024-09-13T18:39:14.601588+0000","last_peered":"2024-09-13T18:39:14.601588+0000","last_clean":"2024-09-13T18:39:14.601588+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:39:14.601588+0000","last_undegraded":"2024-09-13T18:39:14.601588+0000","last_fullsized":"2024-09-13T18:39:14.601588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.585676+0000","last_change":"2024-09-13T18:39:13.572017+0000","last_active":"2024-09-13T18:39:14.585676+0000","last_peered":"2024-09-13T18:39:14.585676+0000","last_clean":"2024-09-13T18:39:14.585676+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:39:14.585676+0000","last_undegraded":"2024-09-13T18:39:14.585676+0000","last_fullsized":"2024-09-13T18:39:14.585676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:25.536255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.561009+0000","last_change":"2024-09-13T18:39:13.571792+0000","last_active":"2024-09-13T18:39:14.561009+0000","last_peered":"2024-09-13T18:39:14.561009+0000","last_clean":"2024-09-13T18:39:14.561009+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:39:14.561009+0000","last_undegraded":"2024-09-13T18:39:14.561009+0000","last_fullsized":"2024-09-13T18:39:14.561009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596950+0000","last_change":"2024-09-13T18:39:14.590748+0000","last_active":"2024-09-13T18:39:14.596950+0000","last_peered":"2024-09-13T18:39:14.596950+0000","last_clean":"2024-09-13T18:39:14.596950+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:39:14.596950+0000","last_undegraded":"2024-09-13T18:39:14.596950+0000","last_fullsized":"2024-09-13T18:39:14.596950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:49.557245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.572729+0000","last_change":"2024-09-13T18:39:13.569863+0000","last_active":"2024-09-13T18:39:14.572729+0000","last_peered":"2024-09-13T18:39:14.572729+0000","last_clean":"2024-09-13T18:39:14.572729+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:39:14.572729+0000","last_undegraded":"2024-09-13T18:39:14.572729+0000","last_fullsized":"2024-09-13T18:39:14.572729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588790+0000","last_change":"2024-09-13T18:39:14.582205+0000","last_active":"2024-09-13T18:39:14.588790+0000","last_peered":"2024-09-13T18:39:14.588790+0000","last_clean":"2024-09-13T18:39:14.588790+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:39:14.588790+0000","last_undegraded":"2024-09-13T18:39:14.588790+0000","last_fullsized":"2024-09-13T18:39:14.588790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.186210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588744+0000","last_change":"2024-09-13T18:39:14.584622+0000","last_active":"2024-09-13T18:39:14.588744+0000","last_peered":"2024-09-13T18:39:14.588744+0000","last_clean":"2024-09-13T18:39:14.588744+0000","last_became_active":"2024-09-13T18:39:14.584061+0000","last_became_peered":"2024-09-13T18:39:14.584061+0000","last_unstale":"2024-09-13T18:39:14.588744+0000","last_undegraded":"2024-09-13T18:39:14.588744+0000","last_fullsized":"2024-09-13T18:39:14.588744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:55.751927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.560638+0000","last_change":"2024-09-13T18:39:13.573803+0000","last_active":"2024-09-13T18:39:14.560638+0000","last_peered":"2024-09-13T18:39:14.560638+0000","last_clean":"2024-09-13T18:39:14.560638+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:39:14.560638+0000","last_undegraded":"2024-09-13T18:39:14.560638+0000","last_fullsized":"2024-09-13T18:39:14.560638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:08.298094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596277+0000","last_change":"2024-09-13T18:39:14.586848+0000","last_active":"2024-09-13T18:39:14.596277+0000","last_peered":"2024-09-13T18:39:14.596277+0000","last_clean":"2024-09-13T18:39:14.596277+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:39:14.596277+0000","last_undegraded":"2024-09-13T18:39:14.596277+0000","last_fullsized":"2024-09-13T18:39:14.596277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.564950+0000","last_change":"2024-09-13T18:39:13.586123+0000","last_active":"2024-09-13T18:39:14.564950+0000","last_peered":"2024-09-13T18:39:14.564950+0000","last_clean":"2024-09-13T18:39:14.564950+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:39:14.564950+0000","last_undegraded":"2024-09-13T18:39:14.564950+0000","last_fullsized":"2024-09-13T18:39:14.564950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.582711+0000","last_change":"2024-09-13T18:39:14.579531+0000","last_active":"2024-09-13T18:39:14.582711+0000","last_peered":"2024-09-13T18:39:14.582711+0000","last_clean":"2024-09-13T18:39:14.582711+0000","last_became_active":"2024-09-13T18:39:14.579269+0000","last_became_peered":"2024-09-13T18:39:14.579269+0000","last_unstale":"2024-09-13T18:39:14.582711+0000","last_undegraded":"2024-09-13T18:39:14.582711+0000","last_fullsized":"2024-09-13T18:39:14.582711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:09.638652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595556+0000","last_change":"2024-09-13T18:39:13.575435+0000","last_active":"2024-09-13T18:39:14.595556+0000","last_peered":"2024-09-13T18:39:14.595556+0000","last_clean":"2024-09-13T18:39:14.595556+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:39:14.595556+0000","last_undegraded":"2024-09-13T18:39:14.595556+0000","last_fullsized":"2024-09-13T18:39:14.595556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.585728+0000","last_change":"2024-09-13T18:39:14.580846+0000","last_active":"2024-09-13T18:39:14.585728+0000","last_peered":"2024-09-13T18:39:14.585728+0000","last_clean":"2024-09-13T18:39:14.585728+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:39:14.585728+0000","last_undegraded":"2024-09-13T18:39:14.585728+0000","last_fullsized":"2024-09-13T18:39:14.585728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.010053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588802+0000","last_change":"2024-09-13T18:39:13.571042+0000","last_active":"2024-09-13T18:39:14.588802+0000","last_peered":"2024-09-13T18:39:14.588802+0000","last_clean":"2024-09-13T18:39:14.588802+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:39:14.588802+0000","last_undegraded":"2024-09-13T18:39:14.588802+0000","last_fullsized":"2024-09-13T18:39:14.588802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.288993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600660+0000","last_change":"2024-09-13T18:39:14.593258+0000","last_active":"2024-09-13T18:39:14.600660+0000","last_peered":"2024-09-13T18:39:14.600660+0000","last_clean":"2024-09-13T18:39:14.600660+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:39:14.600660+0000","last_undegraded":"2024-09-13T18:39:14.600660+0000","last_fullsized":"2024-09-13T18:39:14.600660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:21.972039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600247+0000","last_change":"2024-09-13T18:39:13.584903+0000","last_active":"2024-09-13T18:39:14.600247+0000","last_peered":"2024-09-13T18:39:14.600247+0000","last_clean":"2024-09-13T18:39:14.600247+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:39:14.600247+0000","last_undegraded":"2024-09-13T18:39:14.600247+0000","last_fullsized":"2024-09-13T18:39:14.600247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:46.551317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602577+0000","last_change":"2024-09-13T18:39:14.597339+0000","last_active":"2024-09-13T18:39:14.602577+0000","last_peered":"2024-09-13T18:39:14.602577+0000","last_clean":"2024-09-13T18:39:14.602577+0000","last_became_active":"2024-09-13T18:39:14.594896+0000","last_became_peered":"2024-09-13T18:39:14.594896+0000","last_unstale":"2024-09-13T18:39:14.602577+0000","last_undegraded":"2024-09-13T18:39:14.602577+0000","last_fullsized":"2024-09-13T18:39:14.602577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:00.992631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593279+0000","last_change":"2024-09-13T18:39:13.574044+0000","last_active":"2024-09-13T18:39:14.593279+0000","last_peered":"2024-09-13T18:39:14.593279+0000","last_clean":"2024-09-13T18:39:14.593279+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:39:14.593279+0000","last_undegraded":"2024-09-13T18:39:14.593279+0000","last_fullsized":"2024-09-13T18:39:14.593279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:12.168801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596996+0000","last_change":"2024-09-13T18:39:14.591381+0000","last_active":"2024-09-13T18:39:14.596996+0000","last_peered":"2024-09-13T18:39:14.596996+0000","last_clean":"2024-09-13T18:39:14.596996+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:39:14.596996+0000","last_undegraded":"2024-09-13T18:39:14.596996+0000","last_fullsized":"2024-09-13T18:39:14.596996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:17.239023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602768+0000","last_change":"2024-09-13T18:39:13.575357+0000","last_active":"2024-09-13T18:39:14.602768+0000","last_peered":"2024-09-13T18:39:14.602768+0000","last_clean":"2024-09-13T18:39:14.602768+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:39:14.602768+0000","last_undegraded":"2024-09-13T18:39:14.602768+0000","last_fullsized":"2024-09-13T18:39:14.602768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:20.965325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.587405+0000","last_change":"2024-09-13T18:39:14.580750+0000","last_active":"2024-09-13T18:39:14.587405+0000","last_peered":"2024-09-13T18:39:14.587405+0000","last_clean":"2024-09-13T18:39:14.587405+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:39:14.587405+0000","last_undegraded":"2024-09-13T18:39:14.587405+0000","last_fullsized":"2024-09-13T18:39:14.587405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:08.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.584973+0000","last_change":"2024-09-13T18:39:13.583221+0000","last_active":"2024-09-13T18:39:14.584973+0000","last_peered":"2024-09-13T18:39:14.584973+0000","last_clean":"2024-09-13T18:39:14.584973+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:39:14.584973+0000","last_undegraded":"2024-09-13T18:39:14.584973+0000","last_fullsized":"2024-09-13T18:39:14.584973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":200704,"data_stored":57550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":155648,"data_stored":46772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":782336,"data_stored":646834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":774144,"data_stored":642570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.216}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:39:17.745 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:39:17.745 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:39:17.745 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:39:17.745 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T18:39:17.746 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T18:39:17.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eb675d640 1 Processor -- start 2024-09-13T18:39:17.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eb675d640 1 -- start start 2024-09-13T18:39:17.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eb675d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 0x7f1eb0132870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eb675d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1eb0132db0 0x7f1eb0135190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eb675d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb009cca0 con 0x7f1eb009cea0 2024-09-13T18:39:17.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eb675d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb009cac0 con 0x7f1eb0132db0 2024-09-13T18:39:17.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eb675d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb006a350 con 0x7f1eb0130490 2024-09-13T18:39:17.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 0x7f1eb0132870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eaffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1eb009cea0 0x7f1eb009d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47772/0 (socket says 172.21.15.97:47772) 2024-09-13T18:39:17.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 0x7f1eb0132870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47938/0 (socket says 172.21.15.97:47938) 2024-09-13T18:39:17.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eaffff640 1 -- 172.21.15.97:0/3477437721 learned_addr learned my addr 172.21.15.97:0/3477437721 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:17.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eb4cfa640 1 --2- 172.21.15.97:0/3477437721 >> v2:172.21.15.97:3300/0 conn(0x7f1eb0132db0 0x7f1eb0135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eaf7fe640 1 -- 172.21.15.97:0/3477437721 >> v2:172.21.15.97:3300/0 conn(0x7f1eb0132db0 msgr2=0x7f1eb0135190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:17.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.871+0000 7f1eaf7fe640 1 --2- 172.21.15.97:0/3477437721 >> v2:172.21.15.97:3300/0 conn(0x7f1eb0132db0 0x7f1eb0135190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.872+0000 7f1eaf7fe640 1 -- 172.21.15.97:0/3477437721 >> v1:172.21.15.97:6789/0 conn(0x7f1eb009cea0 legacy=0x7f1eb009d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.872+0000 7f1eaf7fe640 1 -- 172.21.15.97:0/3477437721 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb006e930 con 0x7f1eb0130490 2024-09-13T18:39:17.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.872+0000 7f1eb4cfa640 1 --2- 172.21.15.97:0/3477437721 >> v2:172.21.15.97:3300/0 conn(0x7f1eb0132db0 0x7f1eb0135190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:17.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.872+0000 7f1eaf7fe640 1 --2- 172.21.15.97:0/3477437721 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 0x7f1eb0132870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009850 tx=0x7f1e980090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80dd767813a5f66a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:17.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.872+0000 7f1eaeffd640 1 -- 172.21.15.97:0/3477437721 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9802ac80 con 0x7f1eb0130490 2024-09-13T18:39:17.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.872+0000 7f1eaeffd640 1 -- 172.21.15.97:0/3477437721 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9802ade0 con 0x7f1eb0130490 2024-09-13T18:39:17.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.872+0000 7f1eaeffd640 1 -- 172.21.15.97:0/3477437721 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98032670 con 0x7f1eb0130490 2024-09-13T18:39:17.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.873+0000 7f1eb675d640 1 -- 172.21.15.97:0/3477437721 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 msgr2=0x7f1eb0132870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.873+0000 7f1eb675d640 1 --2- 172.21.15.97:0/3477437721 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 0x7f1eb0132870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009850 tx=0x7f1e980090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.873+0000 7f1eb675d640 1 -- 172.21.15.97:0/3477437721 shutdown_connections 2024-09-13T18:39:17.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.873+0000 7f1eb675d640 1 --2- 172.21.15.97:0/3477437721 >> v2:172.21.15.97:3300/0 conn(0x7f1eb0132db0 0x7f1eb0135190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.873+0000 7f1eb675d640 1 --2- 172.21.15.97:0/3477437721 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 0x7f1eb0132870 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.873+0000 7f1eb675d640 1 -- 172.21.15.97:0/3477437721 >> 172.21.15.97:0/3477437721 conn(0x7f1eb009b200 msgr2=0x7f1eb009b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:17.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.873+0000 7f1eb675d640 1 -- 172.21.15.97:0/3477437721 shutdown_connections 2024-09-13T18:39:17.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.873+0000 7f1eb675d640 1 -- 172.21.15.97:0/3477437721 wait complete. 2024-09-13T18:39:17.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eb675d640 1 Processor -- start 2024-09-13T18:39:17.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eb675d640 1 -- start start 2024-09-13T18:39:17.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eb675d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eb009cea0 0x7f1eb00969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eb675d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 0x7f1eb0096f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eb675d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1eb0132db0 0x7f1eb0097450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:17.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eb675d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb011e9c0 con 0x7f1eb009cea0 2024-09-13T18:39:17.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eb675d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb0097e20 con 0x7f1eb0132db0 2024-09-13T18:39:17.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eb675d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb0132a40 con 0x7f1eb0130490 2024-09-13T18:39:17.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eaffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eb009cea0 0x7f1eb00969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 0x7f1eb0096f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 0x7f1eb0096f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47944/0 (socket says 172.21.15.97:47944) 2024-09-13T18:39:17.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eaf7fe640 1 -- 172.21.15.97:0/596374518 learned_addr learned my addr 172.21.15.97:0/596374518 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:17.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eaffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eb009cea0 0x7f1eb00969d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37512/0 (socket says 172.21.15.97:37512) 2024-09-13T18:39:17.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.874+0000 7f1eb4cfa640 1 --2- 172.21.15.97:0/596374518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1eb0132db0 0x7f1eb0097450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:17.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.875+0000 7f1eaf7fe640 1 -- 172.21.15.97:0/596374518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1eb0132db0 msgr2=0x7f1eb0097450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.875+0000 7f1eaf7fe640 1 --2- 172.21.15.97:0/596374518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1eb0132db0 0x7f1eb0097450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.875+0000 7f1eaf7fe640 1 -- 172.21.15.97:0/596374518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eb009cea0 msgr2=0x7f1eb00969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:17.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.875+0000 7f1eaf7fe640 1 --2- 172.21.15.97:0/596374518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eb009cea0 0x7f1eb00969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:17.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.875+0000 7f1eaf7fe640 1 -- 172.21.15.97:0/596374518 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea8009a20 con 0x7f1eb0130490 2024-09-13T18:39:17.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.875+0000 7f1eaffff640 1 --2- 172.21.15.97:0/596374518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eb009cea0 0x7f1eb00969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:17.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.875+0000 7f1eaf7fe640 1 --2- 172.21.15.97:0/596374518 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 0x7f1eb0096f10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009850 tx=0x7f1e98032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:17.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.875+0000 7f1ea7fff640 1 -- 172.21.15.97:0/596374518 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9803d720 con 0x7f1eb0130490 2024-09-13T18:39:17.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.875+0000 7f1ea7fff640 1 -- 172.21.15.97:0/596374518 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9803d880 con 0x7f1eb0130490 2024-09-13T18:39:17.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.875+0000 7f1eb675d640 1 -- 172.21.15.97:0/596374518 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e98009390 con 0x7f1eb0130490 2024-09-13T18:39:17.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.875+0000 7f1ea7fff640 1 -- 172.21.15.97:0/596374518 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9803dc20 con 0x7f1eb0130490 2024-09-13T18:39:17.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.875+0000 7f1eb675d640 1 -- 172.21.15.97:0/596374518 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb011c670 con 0x7f1eb0130490 2024-09-13T18:39:17.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.876+0000 7f1ea7fff640 1 -- 172.21.15.97:0/596374518 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f1e98039040 con 0x7f1eb0130490 2024-09-13T18:39:17.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.876+0000 7f1ea7fff640 1 -- 172.21.15.97:0/596374518 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f1e98061b20 con 0x7f1eb0130490 2024-09-13T18:39:17.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.876+0000 7f1eb675d640 1 -- 172.21.15.97:0/596374518 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb0064000 con 0x7f1eb0130490 2024-09-13T18:39:17.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:17.880+0000 7f1ea7fff640 1 -- 172.21.15.97:0/596374518 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f1e98037030 con 0x7f1eb0130490 2024-09-13T18:39:18.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.070+0000 7f1eb675d640 1 -- 172.21.15.97:0/596374518 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1eb005e310 con 0x7f1eb0130490 2024-09-13T18:39:18.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.072+0000 7f1ea7fff640 1 -- 172.21.15.97:0/596374518 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+73552 (secure 0 0 0) 0x7f1e98037030 con 0x7f1eb0130490 2024-09-13T18:39:18.075 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:18.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.074+0000 7f1eb675d640 1 -- 172.21.15.97:0/596374518 >> v1:172.21.15.97:6816/34603 conn(0x7f1e90031160 legacy=0x7f1e90033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.074+0000 7f1eb675d640 1 -- 172.21.15.97:0/596374518 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 msgr2=0x7f1eb0096f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.074+0000 7f1eb675d640 1 --2- 172.21.15.97:0/596374518 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 0x7f1eb0096f10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009850 tx=0x7f1e98032000 comp rx=0 tx=0).stop 2024-09-13T18:39:18.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.074+0000 7f1eb675d640 1 -- 172.21.15.97:0/596374518 shutdown_connections 2024-09-13T18:39:18.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.074+0000 7f1eb675d640 1 --2- 172.21.15.97:0/596374518 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1eb0132db0 0x7f1eb0097450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.074+0000 7f1eb675d640 1 --2- 172.21.15.97:0/596374518 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1eb0130490 0x7f1eb0096f10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.074+0000 7f1eb675d640 1 --2- 172.21.15.97:0/596374518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eb009cea0 0x7f1eb00969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.074+0000 7f1eb675d640 1 -- 172.21.15.97:0/596374518 >> 172.21.15.97:0/596374518 conn(0x7f1eb009b200 msgr2=0x7f1eb012f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.074+0000 7f1eb675d640 1 -- 172.21.15.97:0/596374518 shutdown_connections 2024-09-13T18:39:18.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.074+0000 7f1eb675d640 1 -- 172.21.15.97:0/596374518 wait complete. 2024-09-13T18:39:18.087 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6816","nonce":34603}]},"active_addr":"172.21.15.97:6816/34603","active_change":"2024-09-13T18:38:53.339366+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":1159338426}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":1371460631}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":670133140}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":3762677274}]}]} 2024-09-13T18:39:18.089 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T18:39:18.089 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T18:39:18.089 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f427531d640 1 Processor -- start 2024-09-13T18:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f427531d640 1 -- start start 2024-09-13T18:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f427531d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f42700a32b0 0x7f427012f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f427531d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f427012fed0 0x7f4270068970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f427531d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4270068eb0 0x7f4270069330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f427531d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4270096b70 con 0x7f427012fed0 2024-09-13T18:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f427531d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42700a3680 con 0x7f4270068eb0 2024-09-13T18:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f427531d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4270097460 con 0x7f42700a32b0 2024-09-13T18:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f426f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4270068eb0 0x7f4270069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f426effd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f42700a32b0 0x7f427012f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f4267fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f427012fed0 0x7f4270068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f4267fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f427012fed0 0x7f4270068970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37528/0 (socket says 172.21.15.97:37528) 2024-09-13T18:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f426f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4270068eb0 0x7f4270069330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35770/0 (socket says 172.21.15.97:35770) 2024-09-13T18:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f4267fff640 1 -- 172.21.15.97:0/3383098199 learned_addr learned my addr 172.21.15.97:0/3383098199 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.181+0000 7f426effd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f42700a32b0 0x7f427012f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47952/0 (socket says 172.21.15.97:47952) 2024-09-13T18:39:18.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.182+0000 7f426f7fe640 1 -- 172.21.15.97:0/3383098199 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f42700a32b0 msgr2=0x7f427012f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.182+0000 7f426f7fe640 1 --2- 172.21.15.97:0/3383098199 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f42700a32b0 0x7f427012f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.182+0000 7f426f7fe640 1 -- 172.21.15.97:0/3383098199 >> v2:172.21.15.97:3300/0 conn(0x7f427012fed0 msgr2=0x7f4270068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.182+0000 7f426f7fe640 1 --2- 172.21.15.97:0/3383098199 >> v2:172.21.15.97:3300/0 conn(0x7f427012fed0 0x7f4270068970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.182+0000 7f426f7fe640 1 -- 172.21.15.97:0/3383098199 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42701302c0 con 0x7f4270068eb0 2024-09-13T18:39:18.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.182+0000 7f426effd640 1 --2- 172.21.15.97:0/3383098199 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f42700a32b0 0x7f427012f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:18.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.182+0000 7f426f7fe640 1 --2- 172.21.15.97:0/3383098199 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4270068eb0 0x7f4270069330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4268009e90 tx=0x7f4268009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6e477b2c74f0221 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.182+0000 7f426e7fc640 1 -- 172.21.15.97:0/3383098199 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268031400 con 0x7f4270068eb0 2024-09-13T18:39:18.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.182+0000 7f426e7fc640 1 -- 172.21.15.97:0/3383098199 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426802d050 con 0x7f4270068eb0 2024-09-13T18:39:18.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.182+0000 7f426e7fc640 1 -- 172.21.15.97:0/3383098199 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42680317d0 con 0x7f4270068eb0 2024-09-13T18:39:18.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.183+0000 7f427531d640 1 -- 172.21.15.97:0/3383098199 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4270068eb0 msgr2=0x7f4270069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.183+0000 7f427531d640 1 --2- 172.21.15.97:0/3383098199 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4270068eb0 0x7f4270069330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4268009e90 tx=0x7f4268009780 comp rx=0 tx=0).stop 2024-09-13T18:39:18.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.183+0000 7f427531d640 1 -- 172.21.15.97:0/3383098199 shutdown_connections 2024-09-13T18:39:18.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.183+0000 7f427531d640 1 --2- 172.21.15.97:0/3383098199 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4270068eb0 0x7f4270069330 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.183+0000 7f427531d640 1 --2- 172.21.15.97:0/3383098199 >> v2:172.21.15.97:3300/0 conn(0x7f427012fed0 0x7f4270068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.183+0000 7f427531d640 1 --2- 172.21.15.97:0/3383098199 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f42700a32b0 0x7f427012f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.183+0000 7f427531d640 1 -- 172.21.15.97:0/3383098199 >> 172.21.15.97:0/3383098199 conn(0x7f427006eef0 msgr2=0x7f42700a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.183+0000 7f427531d640 1 -- 172.21.15.97:0/3383098199 shutdown_connections 2024-09-13T18:39:18.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.183+0000 7f427531d640 1 -- 172.21.15.97:0/3383098199 wait complete. 2024-09-13T18:39:18.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f427531d640 1 Processor -- start 2024-09-13T18:39:18.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f427531d640 1 -- start start 2024-09-13T18:39:18.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f427531d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4270068eb0 0x7f427011bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f427531d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42700a32b0 0x7f427011c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f427531d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f427012fed0 0x7f427011c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f427531d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427011f330 con 0x7f42700a32b0 2024-09-13T18:39:18.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f427531d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42700a27a0 con 0x7f427012fed0 2024-09-13T18:39:18.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f427531d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f427009e710 con 0x7f4270068eb0 2024-09-13T18:39:18.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f426effd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4270068eb0 0x7f427011bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f4267fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42700a32b0 0x7f427011c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f426effd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4270068eb0 0x7f427011bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47964/0 (socket says 172.21.15.97:47964) 2024-09-13T18:39:18.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f4267fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42700a32b0 0x7f427011c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37544/0 (socket says 172.21.15.97:37544) 2024-09-13T18:39:18.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f426effd640 1 -- 172.21.15.97:0/727463963 learned_addr learned my addr 172.21.15.97:0/727463963 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.184+0000 7f426f7fe640 1 --2- 172.21.15.97:0/727463963 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f427012fed0 0x7f427011c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.185+0000 7f426effd640 1 -- 172.21.15.97:0/727463963 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f427012fed0 msgr2=0x7f427011c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.185+0000 7f426effd640 1 --2- 172.21.15.97:0/727463963 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f427012fed0 0x7f427011c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.185+0000 7f426effd640 1 -- 172.21.15.97:0/727463963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42700a32b0 msgr2=0x7f427011c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.185+0000 7f426effd640 1 --2- 172.21.15.97:0/727463963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42700a32b0 0x7f427011c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.185+0000 7f426effd640 1 -- 172.21.15.97:0/727463963 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4260009390 con 0x7f4270068eb0 2024-09-13T18:39:18.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.185+0000 7f4267fff640 1 --2- 172.21.15.97:0/727463963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42700a32b0 0x7f427011c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:18.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.185+0000 7f426effd640 1 --2- 172.21.15.97:0/727463963 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4270068eb0 0x7f427011bec0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f426000ece0 tx=0x7f42600090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.185+0000 7f4266ffd640 1 -- 172.21.15.97:0/727463963 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000cbc0 con 0x7f4270068eb0 2024-09-13T18:39:18.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.185+0000 7f4266ffd640 1 -- 172.21.15.97:0/727463963 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426000cd20 con 0x7f4270068eb0 2024-09-13T18:39:18.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.185+0000 7f427531d640 1 -- 172.21.15.97:0/727463963 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4268009a20 con 0x7f4270068eb0 2024-09-13T18:39:18.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.185+0000 7f4266ffd640 1 -- 172.21.15.97:0/727463963 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260013680 con 0x7f4270068eb0 2024-09-13T18:39:18.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.185+0000 7f427531d640 1 -- 172.21.15.97:0/727463963 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427011d420 con 0x7f4270068eb0 2024-09-13T18:39:18.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.186+0000 7f4266ffd640 1 -- 172.21.15.97:0/727463963 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f42600139f0 con 0x7f4270068eb0 2024-09-13T18:39:18.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.186+0000 7f4266ffd640 1 -- 172.21.15.97:0/727463963 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f4260042790 con 0x7f4270068eb0 2024-09-13T18:39:18.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.186+0000 7f427531d640 1 -- 172.21.15.97:0/727463963 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427011ef40 con 0x7f4270068eb0 2024-09-13T18:39:18.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.190+0000 7f4266ffd640 1 -- 172.21.15.97:0/727463963 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f4260013ca0 con 0x7f4270068eb0 2024-09-13T18:39:18.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.344+0000 7f427531d640 1 -- 172.21.15.97:0/727463963 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4270064000 con 0x7f4270068eb0 2024-09-13T18:39:18.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.345+0000 7f4266ffd640 1 -- 172.21.15.97:0/727463963 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+11343 (secure 0 0 0) 0x7f426001b3b0 con 0x7f4270068eb0 2024-09-13T18:39:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:18.347 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:14.949504+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:18.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.347+0000 7f427531d640 1 -- 172.21.15.97:0/727463963 >> v1:172.21.15.97:6816/34603 conn(0x7f4250031160 legacy=0x7f4250033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.347+0000 7f427531d640 1 -- 172.21.15.97:0/727463963 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4270068eb0 msgr2=0x7f427011bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.347+0000 7f427531d640 1 --2- 172.21.15.97:0/727463963 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4270068eb0 0x7f427011bec0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f426000ece0 tx=0x7f42600090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.347+0000 7f427531d640 1 -- 172.21.15.97:0/727463963 shutdown_connections 2024-09-13T18:39:18.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.347+0000 7f427531d640 1 --2- 172.21.15.97:0/727463963 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f427012fed0 0x7f427011c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.347+0000 7f427531d640 1 --2- 172.21.15.97:0/727463963 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42700a32b0 0x7f427011c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.347+0000 7f427531d640 1 --2- 172.21.15.97:0/727463963 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4270068eb0 0x7f427011bec0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.347+0000 7f427531d640 1 -- 172.21.15.97:0/727463963 >> 172.21.15.97:0/727463963 conn(0x7f427006eef0 msgr2=0x7f42700a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.347+0000 7f427531d640 1 -- 172.21.15.97:0/727463963 shutdown_connections 2024-09-13T18:39:18.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.347+0000 7f427531d640 1 -- 172.21.15.97:0/727463963 wait complete. 2024-09-13T18:39:18.360 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T18:39:18.361 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:18.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.451+0000 7f976c44f640 1 Processor -- start 2024-09-13T18:39:18.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.451+0000 7f976c44f640 1 -- start start 2024-09-13T18:39:18.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f976c44f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97640a32b0 0x7f976412f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f976c44f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f976412fed0 0x7f9764068970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f976c44f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97640a3680 con 0x7f9764068eb0 2024-09-13T18:39:18.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f976c44f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9764097460 con 0x7f976412fed0 2024-09-13T18:39:18.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f976c44f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97641302c0 con 0x7f97640a32b0 2024-09-13T18:39:18.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f976a1eb640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97640a32b0 0x7f976412f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f97699ea640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f976412fed0 0x7f9764068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f976a1eb640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97640a32b0 0x7f976412f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47968/0 (socket says 172.21.15.97:47968) 2024-09-13T18:39:18.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f97699ea640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f976412fed0 0x7f9764068970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37548/0 (socket says 172.21.15.97:37548) 2024-09-13T18:39:18.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f976a1eb640 1 -- 172.21.15.97:0/230008803 learned_addr learned my addr 172.21.15.97:0/230008803 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f976a9ec640 1 --1- 172.21.15.97:0/230008803 >> v1:172.21.15.97:6789/0 conn(0x7f9764068eb0 0x7f9764136760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47788/0 (socket says 172.21.15.97:47788) 2024-09-13T18:39:18.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f976a1eb640 1 -- 172.21.15.97:0/230008803 >> v2:172.21.15.97:3300/0 conn(0x7f976412fed0 msgr2=0x7f9764068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f976a1eb640 1 --2- 172.21.15.97:0/230008803 >> v2:172.21.15.97:3300/0 conn(0x7f976412fed0 0x7f9764068970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f976a1eb640 1 -- 172.21.15.97:0/230008803 >> v1:172.21.15.97:6789/0 conn(0x7f9764068eb0 legacy=0x7f9764136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f976a1eb640 1 -- 172.21.15.97:0/230008803 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976412d770 con 0x7f97640a32b0 2024-09-13T18:39:18.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f97691e9640 1 -- 172.21.15.97:0/230008803 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968466551 0 0) 0x7f97640a3680 con 0x7f9764068eb0 2024-09-13T18:39:18.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.452+0000 7f97699ea640 1 --2- 172.21.15.97:0/230008803 >> v2:172.21.15.97:3300/0 conn(0x7f976412fed0 0x7f9764068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:18.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.453+0000 7f976a1eb640 1 --2- 172.21.15.97:0/230008803 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97640a32b0 0x7f976412f990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9760009910 tx=0x7f97600091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8f9d8d652324307 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.453+0000 7f97691e9640 1 -- 172.21.15.97:0/230008803 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976002add0 con 0x7f97640a32b0 2024-09-13T18:39:18.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.453+0000 7f97691e9640 1 -- 172.21.15.97:0/230008803 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9760032440 con 0x7f97640a32b0 2024-09-13T18:39:18.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.453+0000 7f97691e9640 1 -- 172.21.15.97:0/230008803 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600327e0 con 0x7f97640a32b0 2024-09-13T18:39:18.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.454+0000 7f976c44f640 1 -- 172.21.15.97:0/230008803 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97640a32b0 msgr2=0x7f976412f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.454+0000 7f976c44f640 1 --2- 172.21.15.97:0/230008803 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97640a32b0 0x7f976412f990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9760009910 tx=0x7f97600091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.454+0000 7f976c44f640 1 -- 172.21.15.97:0/230008803 shutdown_connections 2024-09-13T18:39:18.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.454+0000 7f976c44f640 1 --2- 172.21.15.97:0/230008803 >> v2:172.21.15.97:3300/0 conn(0x7f976412fed0 0x7f9764068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.454+0000 7f976c44f640 1 --2- 172.21.15.97:0/230008803 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97640a32b0 0x7f976412f990 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.454+0000 7f976c44f640 1 -- 172.21.15.97:0/230008803 >> 172.21.15.97:0/230008803 conn(0x7f976406eef0 msgr2=0x7f97640a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.454+0000 7f976c44f640 1 -- 172.21.15.97:0/230008803 shutdown_connections 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.454+0000 7f976c44f640 1 -- 172.21.15.97:0/230008803 wait complete. 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976c44f640 1 Processor -- start 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976c44f640 1 -- start start 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976c44f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9764068eb0 0x7f976413eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976c44f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97640a32b0 0x7f976413f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976c44f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f976412fed0 0x7f97641190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976c44f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976411ca80 con 0x7f976412fed0 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976c44f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976411a340 con 0x7f97640a32b0 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976c44f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f976411be60 con 0x7f9764068eb0 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976a9ec640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f976412fed0 0x7f97641190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976a1eb640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9764068eb0 0x7f976413eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976a9ec640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f976412fed0 0x7f97641190b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37560/0 (socket says 172.21.15.97:37560) 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f97699ea640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97640a32b0 0x7f976413f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976a9ec640 1 -- 172.21.15.97:0/1976720732 learned_addr learned my addr 172.21.15.97:0/1976720732 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976a1eb640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9764068eb0 0x7f976413eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47978/0 (socket says 172.21.15.97:47978) 2024-09-13T18:39:18.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976a9ec640 1 -- 172.21.15.97:0/1976720732 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9764068eb0 msgr2=0x7f976413eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976a9ec640 1 --2- 172.21.15.97:0/1976720732 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9764068eb0 0x7f976413eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976a9ec640 1 -- 172.21.15.97:0/1976720732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97640a32b0 msgr2=0x7f976413f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976a9ec640 1 --2- 172.21.15.97:0/1976720732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97640a32b0 0x7f976413f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976a9ec640 1 -- 172.21.15.97:0/1976720732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9754009390 con 0x7f976412fed0 2024-09-13T18:39:18.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f976a1eb640 1 --2- 172.21.15.97:0/1976720732 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9764068eb0 0x7f976413eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:18.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.455+0000 7f97699ea640 1 --2- 172.21.15.97:0/1976720732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97640a32b0 0x7f976413f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:18.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.456+0000 7f976a9ec640 1 --2- 172.21.15.97:0/1976720732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f976412fed0 0x7f97641190b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f975c00c960 tx=0x7f975c0016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.456+0000 7f975a7fc640 1 -- 172.21.15.97:0/1976720732 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c005d60 con 0x7f976412fed0 2024-09-13T18:39:18.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.456+0000 7f975a7fc640 1 -- 172.21.15.97:0/1976720732 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c00a640 con 0x7f976412fed0 2024-09-13T18:39:18.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.456+0000 7f975a7fc640 1 -- 172.21.15.97:0/1976720732 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c00aa00 con 0x7f976412fed0 2024-09-13T18:39:18.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.456+0000 7f976c44f640 1 -- 172.21.15.97:0/1976720732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9760009450 con 0x7f976412fed0 2024-09-13T18:39:18.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.456+0000 7f976c44f640 1 -- 172.21.15.97:0/1976720732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976413f580 con 0x7f976412fed0 2024-09-13T18:39:18.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.457+0000 7f975a7fc640 1 -- 172.21.15.97:0/1976720732 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f975c0070f0 con 0x7f976412fed0 2024-09-13T18:39:18.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.457+0000 7f975a7fc640 1 -- 172.21.15.97:0/1976720732 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f975c041d50 con 0x7f976412fed0 2024-09-13T18:39:18.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.457+0000 7f976c44f640 1 -- 172.21.15.97:0/1976720732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9764064000 con 0x7f976412fed0 2024-09-13T18:39:18.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.461+0000 7f975a7fc640 1 -- 172.21.15.97:0/1976720732 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f975c010d70 con 0x7f976412fed0 2024-09-13T18:39:18.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.619+0000 7f976c44f640 1 -- 172.21.15.97:0/1976720732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f976413f830 con 0x7f976412fed0 2024-09-13T18:39:18.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.619+0000 7f975a7fc640 1 -- 172.21.15.97:0/1976720732 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+11343 (secure 0 0 0) 0x7f975c010770 con 0x7f976412fed0 2024-09-13T18:39:18.625 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:18.625 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:14.949504+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:18.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.621+0000 7f976c44f640 1 -- 172.21.15.97:0/1976720732 >> v1:172.21.15.97:6816/34603 conn(0x7f9748031160 legacy=0x7f9748033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.621+0000 7f976c44f640 1 -- 172.21.15.97:0/1976720732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f976412fed0 msgr2=0x7f97641190b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.621+0000 7f976c44f640 1 --2- 172.21.15.97:0/1976720732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f976412fed0 0x7f97641190b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f975c00c960 tx=0x7f975c0016c0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.621+0000 7f976c44f640 1 -- 172.21.15.97:0/1976720732 shutdown_connections 2024-09-13T18:39:18.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.621+0000 7f976c44f640 1 --2- 172.21.15.97:0/1976720732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f976412fed0 0x7f97641190b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.621+0000 7f976c44f640 1 --2- 172.21.15.97:0/1976720732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97640a32b0 0x7f976413f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.621+0000 7f976c44f640 1 --2- 172.21.15.97:0/1976720732 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9764068eb0 0x7f976413eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.621+0000 7f976c44f640 1 -- 172.21.15.97:0/1976720732 >> 172.21.15.97:0/1976720732 conn(0x7f976406eef0 msgr2=0x7f976412eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.621+0000 7f976c44f640 1 -- 172.21.15.97:0/1976720732 shutdown_connections 2024-09-13T18:39:18.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.621+0000 7f976c44f640 1 -- 172.21.15.97:0/1976720732 wait complete. 2024-09-13T18:39:18.636 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T18:39:18.636 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T18:39:18.637 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T18:39:18.638 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T18:39:18.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.734+0000 7f1dd326f640 1 Processor -- start 2024-09-13T18:39:18.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.734+0000 7f0f1f19d640 1 Processor -- start 2024-09-13T18:39:18.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.734+0000 7f65de0c0640 1 Processor -- start 2024-09-13T18:39:18.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.734+0000 7f4c5e234640 1 Processor -- start 2024-09-13T18:39:18.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.734+0000 7f1dd326f640 1 -- start start 2024-09-13T18:39:18.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.734+0000 7f65de0c0640 1 -- start start 2024-09-13T18:39:18.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.734+0000 7f4c5e234640 1 -- start start 2024-09-13T18:39:18.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.734+0000 7f0f1f19d640 1 -- start start 2024-09-13T18:39:18.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f1dd326f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dcc1300a0 0x7f1dcc134750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f65de0c0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65d8097690 0x7f65d8131350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f65de0c0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65d80969d0 0x7f65d81338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f65de0c0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d806a190 con 0x7f65d809dfb0 2024-09-13T18:39:18.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f65de0c0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d809e380 con 0x7f65d80969d0 2024-09-13T18:39:18.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f65de0c0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d8098870 con 0x7f65d8097690 2024-09-13T18:39:18.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f1dd326f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dcc134c90 0x7f1dcc137070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f1dd080a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dcc1300a0 0x7f1dcc134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f0f1f19d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0f1809d340 0x7f0f18138b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f0f1f19d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1809d750 0x7f0f1813b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f0f1f19d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f180974f0 con 0x7f0f18098240 2024-09-13T18:39:18.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f0f1f19d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f18098610 con 0x7f0f1809d340 2024-09-13T18:39:18.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f0f1f19d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18097eb0 con 0x7f0f1809d750 2024-09-13T18:39:18.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f4c5e234640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c5809dfb0 0x7f4c58096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f65d6ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65d8097690 0x7f65d8131350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f65d6ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65d8097690 0x7f65d8131350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35782/0 (socket says 172.21.15.97:35782) 2024-09-13T18:39:18.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f65d6ffd640 1 -- 172.21.15.97:0/1417551686 learned_addr learned my addr 172.21.15.97:0/1417551686 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f1dd080a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dcc1300a0 0x7f1dcc134750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47994/0 (socket says 172.21.15.97:47994) 2024-09-13T18:39:18.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f1dd080a640 1 -- 172.21.15.97:0/3293956910 learned_addr learned my addr 172.21.15.97:0/3293956910 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f1dd326f640 1 -- 172.21.15.97:0/3293956910 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc096b70 con 0x7f1dcc0a32b0 2024-09-13T18:39:18.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f4c5e234640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4c580969d0 0x7f4c580974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f1dd326f640 1 -- 172.21.15.97:0/3293956910 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0a3680 con 0x7f1dcc134c90 2024-09-13T18:39:18.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f1dd326f640 1 -- 172.21.15.97:0/3293956910 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc097460 con 0x7f1dcc1300a0 2024-09-13T18:39:18.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f65d7fff640 1 --2- 172.21.15.97:0/1417551686 >> v2:172.21.15.97:3300/0 conn(0x7f65d80969d0 0x7f65d81338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f1dd180c640 1 --2- 172.21.15.97:0/3293956910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dcc134c90 0x7f1dcc137070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f65d6ffd640 1 -- 172.21.15.97:0/1417551686 >> v2:172.21.15.97:3300/0 conn(0x7f65d80969d0 msgr2=0x7f65d81338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f65d6ffd640 1 --2- 172.21.15.97:0/1417551686 >> v2:172.21.15.97:3300/0 conn(0x7f65d80969d0 0x7f65d81338a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f65d6ffd640 1 -- 172.21.15.97:0/1417551686 >> v1:172.21.15.97:6789/0 conn(0x7f65d809dfb0 legacy=0x7f65d8096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f65d6ffd640 1 -- 172.21.15.97:0/1417551686 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d8098e10 con 0x7f65d8097690 2024-09-13T18:39:18.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f0f1d73a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1809d750 0x7f0f1813b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f1dd180c640 1 -- 172.21.15.97:0/3293956910 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dcc1300a0 msgr2=0x7f1dcc134750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f1dd180c640 1 --2- 172.21.15.97:0/3293956910 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dcc1300a0 0x7f1dcc134750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f1dd180c640 1 -- 172.21.15.97:0/3293956910 >> v1:172.21.15.97:6789/0 conn(0x7f1dcc0a32b0 legacy=0x7f1dcc12f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f1dd180c640 1 -- 172.21.15.97:0/3293956910 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc12d770 con 0x7f1dcc134c90 2024-09-13T18:39:18.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f0f1d73a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1809d750 0x7f0f1813b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35792/0 (socket says 172.21.15.97:35792) 2024-09-13T18:39:18.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f0f1d73a640 1 -- 172.21.15.97:0/200317387 learned_addr learned my addr 172.21.15.97:0/200317387 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.735+0000 7f4c5e234640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c5812bf70 0x7f4c5812c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f4c56ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4c580969d0 0x7f4c580974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f4c56ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4c580969d0 0x7f4c580974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37590/0 (socket says 172.21.15.97:37590) 2024-09-13T18:39:18.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f4c56ffd640 1 -- 172.21.15.97:0/1475378700 learned_addr learned my addr 172.21.15.97:0/1475378700 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f4c577fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c5809dfb0 0x7f4c58096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f4c5e234640 1 -- 172.21.15.97:0/1475378700 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5809e380 con 0x7f4c580969d0 2024-09-13T18:39:18.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f0f17fff640 1 --2- 172.21.15.97:0/200317387 >> v2:172.21.15.97:3300/0 conn(0x7f0f1809d340 0x7f0f18138b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f0f1d73a640 1 -- 172.21.15.97:0/200317387 >> v2:172.21.15.97:3300/0 conn(0x7f0f1809d340 msgr2=0x7f0f18138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f0f1d73a640 1 --2- 172.21.15.97:0/200317387 >> v2:172.21.15.97:3300/0 conn(0x7f0f1809d340 0x7f0f18138b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f0f1d73a640 1 -- 172.21.15.97:0/200317387 >> v1:172.21.15.97:6789/0 conn(0x7f0f18098240 legacy=0x7f0f1809cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f4c57fff640 1 --2- 172.21.15.97:0/1475378700 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c5812bf70 0x7f4c5812c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f4c5e234640 1 -- 172.21.15.97:0/1475378700 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5806a190 con 0x7f4c5812bf70 2024-09-13T18:39:18.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f4c5e234640 1 -- 172.21.15.97:0/1475378700 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58098870 con 0x7f4c5809dfb0 2024-09-13T18:39:18.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f0f1d73a640 1 -- 172.21.15.97:0/200317387 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f18098900 con 0x7f0f1809d750 2024-09-13T18:39:18.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f0f17fff640 1 --2- 172.21.15.97:0/200317387 >> v2:172.21.15.97:3300/0 conn(0x7f0f1809d340 0x7f0f18138b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:18.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.736+0000 7f65d6ffd640 1 --2- 172.21.15.97:0/1417551686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65d8097690 0x7f65d8131350 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009910 tx=0x7f65cc0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=106d24dd996a5307 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f4c56ffd640 1 -- 172.21.15.97:0/1475378700 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c5809dfb0 msgr2=0x7f4c58096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f65d67fc640 1 -- 172.21.15.97:0/1417551686 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc02ac90 con 0x7f65d8097690 2024-09-13T18:39:18.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f4c56ffd640 1 --2- 172.21.15.97:0/1475378700 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c5809dfb0 0x7f4c58096f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f65d67fc640 1 -- 172.21.15.97:0/1417551686 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc02adf0 con 0x7f65d8097690 2024-09-13T18:39:18.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f65d67fc640 1 -- 172.21.15.97:0/1417551686 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc032670 con 0x7f65d8097690 2024-09-13T18:39:18.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f1dd180c640 1 --2- 172.21.15.97:0/3293956910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dcc134c90 0x7f1dcc137070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009ec0 tx=0x7f1dc4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb4bc958ebf492a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f4c56ffd640 1 -- 172.21.15.97:0/1475378700 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c5812bf70 msgr2=0x7f4c5812c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f4c56ffd640 1 --2- 172.21.15.97:0/1475378700 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c5812bf70 0x7f4c5812c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f4c56ffd640 1 -- 172.21.15.97:0/1475378700 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c58098e10 con 0x7f4c580969d0 2024-09-13T18:39:18.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f4c577fe640 1 --2- 172.21.15.97:0/1475378700 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c5809dfb0 0x7f4c58096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:18.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f1dc3fff640 1 -- 172.21.15.97:0/3293956910 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4007550 con 0x7f1dcc134c90 2024-09-13T18:39:18.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f1dc3fff640 1 -- 172.21.15.97:0/3293956910 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc402d050 con 0x7f1dcc134c90 2024-09-13T18:39:18.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f1dc3fff640 1 -- 172.21.15.97:0/3293956910 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4007920 con 0x7f1dcc134c90 2024-09-13T18:39:18.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f4c57fff640 1 --2- 172.21.15.97:0/1475378700 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c5812bf70 0x7f4c5812c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:18.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f0f1d73a640 1 --2- 172.21.15.97:0/200317387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1809d750 0x7f0f1813b050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009f50 tx=0x7f0f10009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9056fdc5bd03cb30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f0f177fe640 1 -- 172.21.15.97:0/200317387 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10031400 con 0x7f0f1809d750 2024-09-13T18:39:18.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f0f177fe640 1 -- 172.21.15.97:0/200317387 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1002d050 con 0x7f0f1809d750 2024-09-13T18:39:18.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f0f177fe640 1 -- 172.21.15.97:0/200317387 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10031790 con 0x7f0f1809d750 2024-09-13T18:39:18.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f65de0c0640 1 -- 172.21.15.97:0/1417551686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65d8097690 msgr2=0x7f65d8131350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.737+0000 7f65de0c0640 1 --2- 172.21.15.97:0/1417551686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65d8097690 0x7f65d8131350 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009910 tx=0x7f65cc0091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f65de0c0640 1 -- 172.21.15.97:0/1417551686 shutdown_connections 2024-09-13T18:39:18.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f4c56ffd640 1 --2- 172.21.15.97:0/1475378700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c580969d0 0x7f4c580974c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c009910 tx=0x7f4c4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f86226a00bec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f65de0c0640 1 --2- 172.21.15.97:0/1417551686 >> v2:172.21.15.97:3300/0 conn(0x7f65d80969d0 0x7f65d81338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f65de0c0640 1 --2- 172.21.15.97:0/1417551686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65d8097690 0x7f65d8131350 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f65de0c0640 1 -- 172.21.15.97:0/1417551686 >> 172.21.15.97:0/1417551686 conn(0x7f65d809b200 msgr2=0x7f65d809b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f65de0c0640 1 -- 172.21.15.97:0/1417551686 shutdown_connections 2024-09-13T18:39:18.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f65de0c0640 1 -- 172.21.15.97:0/1417551686 wait complete. 2024-09-13T18:39:18.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f1dd326f640 1 -- 172.21.15.97:0/3293956910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dcc134c90 msgr2=0x7f1dcc137070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f1dd326f640 1 --2- 172.21.15.97:0/3293956910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dcc134c90 0x7f1dcc137070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009ec0 tx=0x7f1dc4009780 comp rx=0 tx=0).stop 2024-09-13T18:39:18.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f1dd326f640 1 -- 172.21.15.97:0/3293956910 shutdown_connections 2024-09-13T18:39:18.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f1dd326f640 1 --2- 172.21.15.97:0/3293956910 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dcc134c90 0x7f1dcc137070 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f1dd326f640 1 --2- 172.21.15.97:0/3293956910 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dcc1300a0 0x7f1dcc134750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f1dd326f640 1 -- 172.21.15.97:0/3293956910 >> 172.21.15.97:0/3293956910 conn(0x7f1dcc06eef0 msgr2=0x7f1dcc0a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f4c567fc640 1 -- 172.21.15.97:0/1475378700 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c02ad20 con 0x7f4c580969d0 2024-09-13T18:39:18.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f1dd326f640 1 -- 172.21.15.97:0/3293956910 shutdown_connections 2024-09-13T18:39:18.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f4c567fc640 1 -- 172.21.15.97:0/1475378700 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c02ae80 con 0x7f4c580969d0 2024-09-13T18:39:18.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f4c567fc640 1 -- 172.21.15.97:0/1475378700 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c032670 con 0x7f4c580969d0 2024-09-13T18:39:18.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f1dd326f640 1 -- 172.21.15.97:0/3293956910 wait complete. 2024-09-13T18:39:18.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f0f1f19d640 1 -- 172.21.15.97:0/200317387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1809d750 msgr2=0x7f0f1813b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f0f1f19d640 1 --2- 172.21.15.97:0/200317387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1809d750 0x7f0f1813b050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009f50 tx=0x7f0f10009840 comp rx=0 tx=0).stop 2024-09-13T18:39:18.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f0f1f19d640 1 -- 172.21.15.97:0/200317387 shutdown_connections 2024-09-13T18:39:18.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f0f1f19d640 1 --2- 172.21.15.97:0/200317387 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1809d750 0x7f0f1813b050 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f0f1f19d640 1 --2- 172.21.15.97:0/200317387 >> v2:172.21.15.97:3300/0 conn(0x7f0f1809d340 0x7f0f18138b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.738+0000 7f0f1f19d640 1 -- 172.21.15.97:0/200317387 >> 172.21.15.97:0/200317387 conn(0x7f0f1809b200 msgr2=0x7f0f1809b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f0f1f19d640 1 -- 172.21.15.97:0/200317387 shutdown_connections 2024-09-13T18:39:18.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f0f1f19d640 1 -- 172.21.15.97:0/200317387 wait complete. 2024-09-13T18:39:18.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65de0c0640 1 Processor -- start 2024-09-13T18:39:18.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65de0c0640 1 -- start start 2024-09-13T18:39:18.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f4c5e234640 1 -- 172.21.15.97:0/1475378700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c580969d0 msgr2=0x7f4c580974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f4c5e234640 1 --2- 172.21.15.97:0/1475378700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c580969d0 0x7f4c580974c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c009910 tx=0x7f4c4c0091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f1dd326f640 1 Processor -- start 2024-09-13T18:39:18.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f1dd326f640 1 -- start start 2024-09-13T18:39:18.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f4c5e234640 1 -- 172.21.15.97:0/1475378700 shutdown_connections 2024-09-13T18:39:18.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f4c5e234640 1 --2- 172.21.15.97:0/1475378700 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c5812bf70 0x7f4c5812c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f4c5e234640 1 --2- 172.21.15.97:0/1475378700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c580969d0 0x7f4c580974c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f4c5e234640 1 --2- 172.21.15.97:0/1475378700 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c5809dfb0 0x7f4c58096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f4c5e234640 1 -- 172.21.15.97:0/1475378700 >> 172.21.15.97:0/1475378700 conn(0x7f4c5809b200 msgr2=0x7f4c5809b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f4c5e234640 1 -- 172.21.15.97:0/1475378700 shutdown_connections 2024-09-13T18:39:18.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f4c5e234640 1 -- 172.21.15.97:0/1475378700 wait complete. 2024-09-13T18:39:18.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65de0c0640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65d80969d0 0x7f65d81197e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65de0c0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65d8097690 0x7f65d8116f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65de0c0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65d809dfb0 0x7f65d81174c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65de0c0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d8118b30 con 0x7f65d809dfb0 2024-09-13T18:39:18.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65de0c0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d8133530 con 0x7f65d8097690 2024-09-13T18:39:18.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65de0c0640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65d812c880 con 0x7f65d80969d0 2024-09-13T18:39:18.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65d6ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65d8097690 0x7f65d8116f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65d77fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65d80969d0 0x7f65d81197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65d6ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65d8097690 0x7f65d8116f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35804/0 (socket says 172.21.15.97:35804) 2024-09-13T18:39:18.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65d6ffd640 1 -- 172.21.15.97:0/201998196 learned_addr learned my addr 172.21.15.97:0/201998196 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65d77fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65d80969d0 0x7f65d81197e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48012/0 (socket says 172.21.15.97:48012) 2024-09-13T18:39:18.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.739+0000 7f65d7fff640 1 --2- 172.21.15.97:0/201998196 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65d809dfb0 0x7f65d81174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f1dd326f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dcc0a32b0 0x7f1dcc11ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f65d7fff640 1 -- 172.21.15.97:0/201998196 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65d80969d0 msgr2=0x7f65d81197e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f65d7fff640 1 --2- 172.21.15.97:0/201998196 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65d80969d0 0x7f65d81197e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f65d7fff640 1 -- 172.21.15.97:0/201998196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65d8097690 msgr2=0x7f65d8116f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f65d7fff640 1 --2- 172.21.15.97:0/201998196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65d8097690 0x7f65d8116f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f1dd326f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dcc1300a0 0x7f1dcc09a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f65d7fff640 1 -- 172.21.15.97:0/201998196 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc009450 con 0x7f65d809dfb0 2024-09-13T18:39:18.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f65d6ffd640 1 --2- 172.21.15.97:0/201998196 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65d8097690 0x7f65d8116f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:18.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f1dd100b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dcc0a32b0 0x7f1dcc11ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f0f1f19d640 1 Processor -- start 2024-09-13T18:39:18.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f0f1f19d640 1 -- start start 2024-09-13T18:39:18.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f65d7fff640 1 --2- 172.21.15.97:0/201998196 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65d809dfb0 0x7f65d81174c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f65d000ce50 tx=0x7f65d00077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f1dd326f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc134c90 0x7f1dcc09aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f1dd080a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dcc1300a0 0x7f1dcc09a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f1dd080a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dcc1300a0 0x7f1dcc09a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35810/0 (socket says 172.21.15.97:35810) 2024-09-13T18:39:18.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f1dd080a640 1 -- 172.21.15.97:0/4172617078 learned_addr learned my addr 172.21.15.97:0/4172617078 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f65bf7fe640 1 -- 172.21.15.97:0/201998196 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d0016430 con 0x7f65d809dfb0 2024-09-13T18:39:18.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f65bf7fe640 1 -- 172.21.15.97:0/201998196 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d0016590 con 0x7f65d809dfb0 2024-09-13T18:39:18.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f65bf7fe640 1 -- 172.21.15.97:0/201998196 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d0016930 con 0x7f65d809dfb0 2024-09-13T18:39:18.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f65de0c0640 1 -- 172.21.15.97:0/201998196 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d809d990 con 0x7f65d809dfb0 2024-09-13T18:39:18.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1f19d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f18098240 0x7f0f18136140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1f19d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1809d340 0x7f0f18136680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1f19d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f1809d750 0x7f0f18136bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1f19d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18138160 con 0x7f0f18098240 2024-09-13T18:39:18.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1f19d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18139cb0 con 0x7f0f1809d340 2024-09-13T18:39:18.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1f19d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18137c20 con 0x7f0f1809d750 2024-09-13T18:39:18.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc09c610 con 0x7f1dcc134c90 2024-09-13T18:39:18.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc09c0d0 con 0x7f1dcc1300a0 2024-09-13T18:39:18.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc119860 con 0x7f1dcc0a32b0 2024-09-13T18:39:18.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f1dd180c640 1 --2- 172.21.15.97:0/4172617078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc134c90 0x7f1dcc09aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f65de0c0640 1 -- 172.21.15.97:0/201998196 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d809d0d0 con 0x7f65d809dfb0 2024-09-13T18:39:18.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1d73a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f1809d750 0x7f0f18136bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1d73a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f1809d750 0x7f0f18136bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48018/0 (socket says 172.21.15.97:48018) 2024-09-13T18:39:18.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1d73a640 1 -- 172.21.15.97:0/4128608129 learned_addr learned my addr 172.21.15.97:0/4128608129 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.740+0000 7f1dd100b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dcc0a32b0 0x7f1dcc11ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48016/0 (socket says 172.21.15.97:48016) 2024-09-13T18:39:18.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f1dd180c640 1 -- 172.21.15.97:0/4172617078 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dcc0a32b0 msgr2=0x7f1dcc11ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f1dd180c640 1 --2- 172.21.15.97:0/4172617078 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dcc0a32b0 0x7f1dcc11ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f1dd180c640 1 -- 172.21.15.97:0/4172617078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dcc1300a0 msgr2=0x7f1dcc09a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f1dd180c640 1 --2- 172.21.15.97:0/4172617078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dcc1300a0 0x7f1dcc09a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f1dd180c640 1 -- 172.21.15.97:0/4172617078 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc4009a20 con 0x7f1dcc134c90 2024-09-13T18:39:18.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f1dd080a640 1 --2- 172.21.15.97:0/4172617078 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dcc1300a0 0x7f1dcc09a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:18.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f1dd180c640 1 --2- 172.21.15.97:0/4172617078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc134c90 0x7f1dcc09aae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0a3810 tx=0x7f1dc4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1cf39640 1 --2- 172.21.15.97:0/4128608129 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f18098240 0x7f0f18136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f17fff640 1 --2- 172.21.15.97:0/4128608129 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1809d340 0x7f0f18136680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1cf39640 1 -- 172.21.15.97:0/4128608129 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f1809d750 msgr2=0x7f0f18136bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1cf39640 1 --2- 172.21.15.97:0/4128608129 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f1809d750 0x7f0f18136bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1cf39640 1 -- 172.21.15.97:0/4128608129 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1809d340 msgr2=0x7f0f18136680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1cf39640 1 --2- 172.21.15.97:0/4128608129 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1809d340 0x7f0f18136680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f1cf39640 1 -- 172.21.15.97:0/4128608129 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f10009ae0 con 0x7f0f18098240 2024-09-13T18:39:18.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f0f17fff640 1 --2- 172.21.15.97:0/4128608129 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f1809d340 0x7f0f18136680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:18.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.741+0000 7f1dc17fa640 1 -- 172.21.15.97:0/4172617078 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4031a70 con 0x7f1dcc134c90 2024-09-13T18:39:18.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.742+0000 7f1dc17fa640 1 -- 172.21.15.97:0/4172617078 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc4040070 con 0x7f1dcc134c90 2024-09-13T18:39:18.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.742+0000 7f1dc17fa640 1 -- 172.21.15.97:0/4172617078 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4031de0 con 0x7f1dcc134c90 2024-09-13T18:39:18.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.742+0000 7f0f1cf39640 1 --2- 172.21.15.97:0/4128608129 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f18098240 0x7f0f18136140 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00c490 tx=0x7f0f0c007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.742+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc11a2c0 con 0x7f1dcc134c90 2024-09-13T18:39:18.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.742+0000 7f4c5e234640 1 Processor -- start 2024-09-13T18:39:18.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.742+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc09b7e0 con 0x7f1dcc134c90 2024-09-13T18:39:18.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.742+0000 7f0f14ff9640 1 -- 172.21.15.97:0/4128608129 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c016070 con 0x7f0f18098240 2024-09-13T18:39:18.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.742+0000 7f65de0c0640 1 -- 172.21.15.97:0/201998196 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65d8064000 con 0x7f65d809dfb0 2024-09-13T18:39:18.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.742+0000 7f4c5e234640 1 -- start start 2024-09-13T18:39:18.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.742+0000 7f0f14ff9640 1 -- 172.21.15.97:0/4128608129 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0c007020 con 0x7f0f18098240 2024-09-13T18:39:18.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.742+0000 7f65bf7fe640 1 -- 172.21.15.97:0/201998196 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f65d0003020 con 0x7f65d809dfb0 2024-09-13T18:39:18.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.742+0000 7f65bf7fe640 1 -- 172.21.15.97:0/201998196 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f65d0012070 con 0x7f65d809dfb0 2024-09-13T18:39:18.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f4c5e234640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c580969d0 0x7f4c5811e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f65bf7fe640 1 -- 172.21.15.97:0/201998196 --> v1:172.21.15.97:6800/35060 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65c403e1f0 con 0x7f65c403a4f0 2024-09-13T18:39:18.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.742+0000 7f0f14ff9640 1 -- 172.21.15.97:0/4128608129 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c016070 con 0x7f0f18098240 2024-09-13T18:39:18.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f0f1f19d640 1 -- 172.21.15.97:0/4128608129 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f18139590 con 0x7f0f18098240 2024-09-13T18:39:18.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f4c5e234640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c5809dfb0 0x7f4c5811a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f0f1f19d640 1 -- 172.21.15.97:0/4128608129 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1813a360 con 0x7f0f18098240 2024-09-13T18:39:18.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f65bf7fe640 1 -- 172.21.15.97:0/201998196 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65d00153d0 con 0x7f65d809dfb0 2024-09-13T18:39:18.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f4c577fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c580969d0 0x7f4c5811e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f4c577fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c580969d0 0x7f4c5811e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37622/0 (socket says 172.21.15.97:37622) 2024-09-13T18:39:18.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1dcc064000 con 0x7f1dcc134c90 2024-09-13T18:39:18.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f4c56ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c5809dfb0 0x7f4c5811a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f4c56ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c5809dfb0 0x7f4c5811a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48034/0 (socket says 172.21.15.97:48034) 2024-09-13T18:39:18.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f4c577fe640 1 -- 172.21.15.97:0/2298286651 learned_addr learned my addr 172.21.15.97:0/2298286651 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f1dc17fa640 1 -- 172.21.15.97:0/4172617078 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f1dc4042030 con 0x7f1dcc134c90 2024-09-13T18:39:18.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f4c5e234640 1 --2- 172.21.15.97:0/2298286651 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c5812bf70 0x7f4c5811aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58097e10 con 0x7f4c580969d0 2024-09-13T18:39:18.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f4c57fff640 1 --2- 172.21.15.97:0/2298286651 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c5812bf70 0x7f4c5811aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f1dc17fa640 1 -- 172.21.15.97:0/4172617078 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f1dc40638a0 con 0x7f1dcc134c90 2024-09-13T18:39:18.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5811bdd0 con 0x7f4c5812bf70 2024-09-13T18:39:18.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.743+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5811e3d0 con 0x7f4c5809dfb0 2024-09-13T18:39:18.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f1dc17fa640 1 -- 172.21.15.97:0/4172617078 --> v1:172.21.15.97:6812/35062 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1db003db20 con 0x7f1db0039e60 2024-09-13T18:39:18.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f0f14ff9640 1 -- 172.21.15.97:0/4128608129 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f0f0c007420 con 0x7f0f18098240 2024-09-13T18:39:18.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f1dc17fa640 1 -- 172.21.15.97:0/4172617078 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dc4039e10 con 0x7f1dcc134c90 2024-09-13T18:39:18.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f0f1f19d640 1 -- 172.21.15.97:0/4128608129 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f181399c0 con 0x7f0f18098240 2024-09-13T18:39:18.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f0f14ff9640 1 -- 172.21.15.97:0/4128608129 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f0f0c040f50 con 0x7f0f18098240 2024-09-13T18:39:18.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f0f14ff9640 1 -- 172.21.15.97:0/4128608129 --> v1:172.21.15.97:6808/35061 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0efc03dab0 con 0x7f0efc039df0 2024-09-13T18:39:18.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f0f14ff9640 1 -- 172.21.15.97:0/4128608129 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f0c006970 con 0x7f0f18098240 2024-09-13T18:39:18.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f65bf7fe640 1 -- 172.21.15.97:0/201998196 <== osd.3 v1:172.21.15.97:6800/35060 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f65c403e1f0 con 0x7f65c403a4f0 2024-09-13T18:39:18.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f4c57fff640 1 -- 172.21.15.97:0/2298286651 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c5809dfb0 msgr2=0x7f4c5811a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f4c57fff640 1 --2- 172.21.15.97:0/2298286651 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c5809dfb0 0x7f4c5811a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f4c57fff640 1 -- 172.21.15.97:0/2298286651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c580969d0 msgr2=0x7f4c5811e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f4c57fff640 1 --2- 172.21.15.97:0/2298286651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c580969d0 0x7f4c5811e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f4c57fff640 1 -- 172.21.15.97:0/2298286651 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c48009390 con 0x7f4c5812bf70 2024-09-13T18:39:18.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f4c577fe640 1 --2- 172.21.15.97:0/2298286651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c580969d0 0x7f4c5811e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:18.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.744+0000 7f4c56ffd640 1 --2- 172.21.15.97:0/2298286651 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c5809dfb0 0x7f4c5811a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:18.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.745+0000 7f1dc17fa640 1 -- 172.21.15.97:0/4172617078 <== osd.0 v1:172.21.15.97:6812/35062 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f1db003db20 con 0x7f1db0039e60 2024-09-13T18:39:18.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.745+0000 7f4c57fff640 1 --2- 172.21.15.97:0/2298286651 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c5812bf70 0x7f4c5811aea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009fa0 tx=0x7f4c50009990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.745+0000 7f4c3f7fe640 1 -- 172.21.15.97:0/2298286651 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5000de50 con 0x7f4c5812bf70 2024-09-13T18:39:18.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.745+0000 7f4c3f7fe640 1 -- 172.21.15.97:0/2298286651 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5000f040 con 0x7f4c5812bf70 2024-09-13T18:39:18.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.745+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4c009450 con 0x7f4c5812bf70 2024-09-13T18:39:18.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.745+0000 7f4c3f7fe640 1 -- 172.21.15.97:0/2298286651 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50015690 con 0x7f4c5812bf70 2024-09-13T18:39:18.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.745+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5811de30 con 0x7f4c5812bf70 2024-09-13T18:39:18.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.745+0000 7f0f14ff9640 1 -- 172.21.15.97:0/4128608129 <== osd.1 v1:172.21.15.97:6808/35061 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f0efc03dab0 con 0x7f0efc039df0 2024-09-13T18:39:18.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.746+0000 7f4c3f7fe640 1 -- 172.21.15.97:0/2298286651 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f4c5001e3b0 con 0x7f4c5812bf70 2024-09-13T18:39:18.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.746+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c58064000 con 0x7f4c5812bf70 2024-09-13T18:39:18.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.746+0000 7f4c3f7fe640 1 -- 172.21.15.97:0/2298286651 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f4c50042630 con 0x7f4c5812bf70 2024-09-13T18:39:18.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.746+0000 7f4c3f7fe640 1 -- 172.21.15.97:0/2298286651 --> v1:172.21.15.97:6804/35063 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c4403db20 con 0x7f4c44039e60 2024-09-13T18:39:18.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.746+0000 7f4c3f7fe640 1 -- 172.21.15.97:0/2298286651 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c5001ee10 con 0x7f4c5812bf70 2024-09-13T18:39:18.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.747+0000 7f4c3f7fe640 1 -- 172.21.15.97:0/2298286651 <== osd.2 v1:172.21.15.97:6804/35063 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f4c4403db20 con 0x7f4c44039e60 2024-09-13T18:39:18.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.771+0000 7f65de0c0640 1 -- 172.21.15.97:0/201998196 --> v1:172.21.15.97:6800/35060 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f65d8117a00 con 0x7f65c403a4f0 2024-09-13T18:39:18.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.772+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 --> v1:172.21.15.97:6812/35062 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1dcc09b260 con 0x7f1db0039e60 2024-09-13T18:39:18.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.772+0000 7f65bf7fe640 1 -- 172.21.15.97:0/201998196 <== osd.3 v1:172.21.15.97:6800/35060 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1129848789) 0x7f65d8117a00 con 0x7f65c403a4f0 2024-09-13T18:39:18.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.772+0000 7f1dc17fa640 1 -- 172.21.15.97:0/4172617078 <== osd.0 v1:172.21.15.97:6812/35062 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1129848789) 0x7f1dcc09b260 con 0x7f1db0039e60 2024-09-13T18:39:18.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.772+0000 7f65de0c0640 1 -- 172.21.15.97:0/201998196 >> v1:172.21.15.97:6800/35060 conn(0x7f65c403a4f0 legacy=0x7f65c403c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.772+0000 7f65de0c0640 1 -- 172.21.15.97:0/201998196 >> v1:172.21.15.97:6816/34603 conn(0x7f65c4031190 legacy=0x7f65c4033640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.772+0000 7f65de0c0640 1 -- 172.21.15.97:0/201998196 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65d809dfb0 msgr2=0x7f65d81174c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.772+0000 7f65de0c0640 1 --2- 172.21.15.97:0/201998196 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65d809dfb0 0x7f65d81174c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f65d000ce50 tx=0x7f65d00077b0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.772+0000 7f65d7fff640 1 -- 172.21.15.97:0/201998196 reap_dead start 2024-09-13T18:39:18.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.772+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 >> v1:172.21.15.97:6812/35062 conn(0x7f1db0039e60 legacy=0x7f1db003c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f65de0c0640 1 -- 172.21.15.97:0/201998196 shutdown_connections 2024-09-13T18:39:18.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 >> v1:172.21.15.97:6816/34603 conn(0x7f1db00311b0 legacy=0x7f1db0033660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f65de0c0640 1 -- 172.21.15.97:0/201998196 >> 172.21.15.97:0/201998196 conn(0x7f65d809b200 msgr2=0x7f65d806d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f65de0c0640 1 -- 172.21.15.97:0/201998196 shutdown_connections 2024-09-13T18:39:18.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc134c90 msgr2=0x7f1dcc09aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f65de0c0640 1 -- 172.21.15.97:0/201998196 wait complete. 2024-09-13T18:39:18.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f1dd326f640 1 --2- 172.21.15.97:0/4172617078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dcc134c90 0x7f1dcc09aae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0a3810 tx=0x7f1dc4037000 comp rx=0 tx=0).stop 2024-09-13T18:39:18.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f1dd180c640 1 -- 172.21.15.97:0/4172617078 reap_dead start 2024-09-13T18:39:18.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f0f1f19d640 1 -- 172.21.15.97:0/4128608129 --> v1:172.21.15.97:6808/35061 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f18139960 con 0x7f0efc039df0 2024-09-13T18:39:18.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 shutdown_connections 2024-09-13T18:39:18.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 >> 172.21.15.97:0/4172617078 conn(0x7f1dcc06eef0 msgr2=0x7f1dcc0a2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 shutdown_connections 2024-09-13T18:39:18.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f0f14ff9640 1 -- 172.21.15.97:0/4128608129 <== osd.1 v1:172.21.15.97:6808/35061 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f0f18139960 con 0x7f0efc039df0 2024-09-13T18:39:18.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f1dd326f640 1 -- 172.21.15.97:0/4172617078 wait complete. 2024-09-13T18:39:18.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.773+0000 7f0f1f19d640 1 -- 172.21.15.97:0/4128608129 >> v1:172.21.15.97:6808/35061 conn(0x7f0efc039df0 legacy=0x7f0efc03c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.774+0000 7f0f1f19d640 1 -- 172.21.15.97:0/4128608129 >> v1:172.21.15.97:6816/34603 conn(0x7f0efc0311c0 legacy=0x7f0efc033670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.774+0000 7f0f1f19d640 1 -- 172.21.15.97:0/4128608129 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f18098240 msgr2=0x7f0f18136140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.774+0000 7f0f1f19d640 1 --2- 172.21.15.97:0/4128608129 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f18098240 0x7f0f18136140 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00c490 tx=0x7f0f0c007e30 comp rx=0 tx=0).stop 2024-09-13T18:39:18.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.774+0000 7f0f1d73a640 1 -- 172.21.15.97:0/4128608129 reap_dead start 2024-09-13T18:39:18.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.774+0000 7f0f1f19d640 1 -- 172.21.15.97:0/4128608129 shutdown_connections 2024-09-13T18:39:18.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.774+0000 7f0f1f19d640 1 -- 172.21.15.97:0/4128608129 >> 172.21.15.97:0/4128608129 conn(0x7f0f1809b200 msgr2=0x7f0f181319c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.774+0000 7f0f1f19d640 1 -- 172.21.15.97:0/4128608129 shutdown_connections 2024-09-13T18:39:18.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.774+0000 7f0f1f19d640 1 -- 172.21.15.97:0/4128608129 wait complete. 2024-09-13T18:39:18.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.774+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 --> v1:172.21.15.97:6804/35063 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4c5809a060 con 0x7f4c44039e60 2024-09-13T18:39:18.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.774+0000 7f4c3f7fe640 1 -- 172.21.15.97:0/2298286651 <== osd.2 v1:172.21.15.97:6804/35063 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2972949718) 0x7f4c5809a060 con 0x7f4c44039e60 2024-09-13T18:39:18.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.775+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 >> v1:172.21.15.97:6804/35063 conn(0x7f4c44039e60 legacy=0x7f4c4403c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.775+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 >> v1:172.21.15.97:6816/34603 conn(0x7f4c440311b0 legacy=0x7f4c44033660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.775+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c5812bf70 msgr2=0x7f4c5811aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.775+0000 7f4c5e234640 1 --2- 172.21.15.97:0/2298286651 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c5812bf70 0x7f4c5811aea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009fa0 tx=0x7f4c50009990 comp rx=0 tx=0).stop 2024-09-13T18:39:18.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.775+0000 7f4c57fff640 1 -- 172.21.15.97:0/2298286651 reap_dead start 2024-09-13T18:39:18.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.775+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 shutdown_connections 2024-09-13T18:39:18.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.775+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 >> 172.21.15.97:0/2298286651 conn(0x7f4c5809b200 msgr2=0x7f4c5806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.776+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 shutdown_connections 2024-09-13T18:39:18.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.776+0000 7f4c5e234640 1 -- 172.21.15.97:0/2298286651 wait complete. 2024-09-13T18:39:18.796 INFO:teuthology.orchestra.run.smithi097.stdout:38654705670 2024-09-13T18:39:18.797 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:39:18.797 INFO:teuthology.orchestra.run.smithi097.stdout:38654705670 2024-09-13T18:39:18.798 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:39:18.798 INFO:teuthology.orchestra.run.smithi097.stdout:38654705669 2024-09-13T18:39:18.799 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:39:18.799 INFO:teuthology.orchestra.run.smithi097.stdout:38654705671 2024-09-13T18:39:18.800 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:39:18.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.933+0000 7fc5348d4640 1 Processor -- start 2024-09-13T18:39:18.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.933+0000 7f8ecc2ef640 1 Processor -- start 2024-09-13T18:39:18.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.933+0000 7f96e7a0f640 1 Processor -- start 2024-09-13T18:39:18.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.933+0000 7fc5348d4640 1 -- start start 2024-09-13T18:39:18.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.933+0000 7f8ecc2ef640 1 -- start start 2024-09-13T18:39:18.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.933+0000 7f4bea0e8640 1 Processor -- start 2024-09-13T18:39:18.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.933+0000 7f4bea0e8640 1 -- start start 2024-09-13T18:39:18.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.933+0000 7f96e7a0f640 1 -- start start 2024-09-13T18:39:18.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4bea0e8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4be40a32b0 0x7f4be412f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4bea0e8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4be412fed0 0x7f4be4068970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4bea0e8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4be4068eb0 0x7f4be4069350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4bea0e8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be4096b70 con 0x7f4be4068eb0 2024-09-13T18:39:18.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4bea0e8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be40a3680 con 0x7f4be412fed0 2024-09-13T18:39:18.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4bea0e8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4be4097460 con 0x7f4be40a32b0 2024-09-13T18:39:18.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7fc5348d4640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc530096f80 0x7fc530097350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7fc5348d4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc53012c0c0 0x7fc53012c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f8ecc2ef640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ec406de90 0x7f8ec409c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f8ecc2ef640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8ec409ce60 0x7f8ec412f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f8ecc2ef640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec409e4b0 con 0x7f8ec409d230 2024-09-13T18:39:18.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7fc52e59c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc530096f80 0x7fc530097350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7fc52e59c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc530096f80 0x7fc530097350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48066/0 (socket says 172.21.15.97:48066) 2024-09-13T18:39:18.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7fc52e59c640 1 -- 172.21.15.97:0/1135991595 learned_addr learned my addr 172.21.15.97:0/1135991595 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7fc52dd9b640 1 --2- 172.21.15.97:0/1135991595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc53012c0c0 0x7fc53012c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4be3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4be4068eb0 0x7f4be4069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7fc5348d4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc530098870 con 0x7fc53012c9d0 2024-09-13T18:39:18.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7fc5348d4640 1 -- 172.21.15.97:0/1135991595 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53009cc90 con 0x7fc53012c0c0 2024-09-13T18:39:18.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7fc5348d4640 1 -- 172.21.15.97:0/1135991595 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc530098e80 con 0x7fc530096f80 2024-09-13T18:39:18.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e7a0f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e009cea0 0x7f96e009d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e7a0f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f96e009d7b0 0x7f96e012d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e7a0f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e012d6b0 0x7f96e012db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e7a0f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e009ca00 con 0x7f96e009d7b0 2024-09-13T18:39:18.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e7a0f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e009cca0 con 0x7f96e009cea0 2024-09-13T18:39:18.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e7a0f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96e006a350 con 0x7f96e012d6b0 2024-09-13T18:39:18.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4be2ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4be412fed0 0x7f4be4068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4be3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4be4068eb0 0x7f4be4069350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37626/0 (socket says 172.21.15.97:37626) 2024-09-13T18:39:18.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4be3fff640 1 -- 172.21.15.97:0/443660257 learned_addr learned my addr 172.21.15.97:0/443660257 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e57ab640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e009cea0 0x7f96e009d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e4faa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f96e009d7b0 0x7f96e012d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e57ab640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e009cea0 0x7f96e009d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35834/0 (socket says 172.21.15.97:35834) 2024-09-13T18:39:18.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e57ab640 1 -- 172.21.15.97:0/3941208095 learned_addr learned my addr 172.21.15.97:0/3941208095 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4be37fe640 1 --2- 172.21.15.97:0/443660257 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4be40a32b0 0x7f4be412f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f8ecc2ef640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec406e260 con 0x7f8ec406de90 2024-09-13T18:39:18.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e5fac640 1 --2- 172.21.15.97:0/3941208095 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e012d6b0 0x7f96e012db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f8ecc2ef640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec406e9d0 con 0x7f8ec409ce60 2024-09-13T18:39:18.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f8eca08b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ec406de90 0x7f8ec409c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f8ec988a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8ec409ce60 0x7f8ec412f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e4faa640 1 -- 172.21.15.97:0/3941208095 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e012d6b0 msgr2=0x7f96e012db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e4faa640 1 --2- 172.21.15.97:0/3941208095 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e012d6b0 0x7f96e012db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e4faa640 1 -- 172.21.15.97:0/3941208095 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e009cea0 msgr2=0x7f96e009d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e4faa640 1 --2- 172.21.15.97:0/3941208095 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e009cea0 0x7f96e009d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e4faa640 1 -- 172.21.15.97:0/3941208095 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e006e930 con 0x7f96e009d7b0 2024-09-13T18:39:18.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f96e5fac640 1 --2- 172.21.15.97:0/3941208095 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e012d6b0 0x7f96e012db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:18.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f8eca08b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ec406de90 0x7f8ec409c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35836/0 (socket says 172.21.15.97:35836) 2024-09-13T18:39:18.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f8eca08b640 1 -- 172.21.15.97:0/3360142832 learned_addr learned my addr 172.21.15.97:0/3360142832 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4be3fff640 1 -- 172.21.15.97:0/443660257 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4be40a32b0 msgr2=0x7f4be412f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4be3fff640 1 --2- 172.21.15.97:0/443660257 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4be40a32b0 0x7f4be412f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4be3fff640 1 -- 172.21.15.97:0/443660257 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4be412fed0 msgr2=0x7f4be4068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4be3fff640 1 --2- 172.21.15.97:0/443660257 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4be412fed0 0x7f4be4068970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7f4be3fff640 1 -- 172.21.15.97:0/443660257 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be41302c0 con 0x7f4be4068eb0 2024-09-13T18:39:18.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.935+0000 7f8eca08b640 1 -- 172.21.15.97:0/3360142832 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8ec409ce60 msgr2=0x7f8ec412f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.935+0000 7f8eca08b640 1 --2- 172.21.15.97:0/3360142832 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8ec409ce60 0x7f8ec412f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.935+0000 7f8eca08b640 1 -- 172.21.15.97:0/3360142832 >> v1:172.21.15.97:6789/0 conn(0x7f8ec409d230 legacy=0x7f8ec412f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.935+0000 7f8eca08b640 1 -- 172.21.15.97:0/3360142832 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec406ebd0 con 0x7f8ec406de90 2024-09-13T18:39:18.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7fc52e59c640 1 -- 172.21.15.97:0/1135991595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc53012c0c0 msgr2=0x7fc53012c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:18.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7fc52e59c640 1 --2- 172.21.15.97:0/1135991595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc53012c0c0 0x7fc53012c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.934+0000 7fc52e59c640 1 -- 172.21.15.97:0/1135991595 >> v1:172.21.15.97:6789/0 conn(0x7fc53012c9d0 legacy=0x7fc530133420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.935+0000 7fc52e59c640 1 -- 172.21.15.97:0/1135991595 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc530096d80 con 0x7fc530096f80 2024-09-13T18:39:18.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.935+0000 7f96e4faa640 1 --2- 172.21.15.97:0/3941208095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e009d7b0 0x7f96e012d170 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009850 tx=0x7f96d00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45f08eb650c2ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7f4be3fff640 1 --2- 172.21.15.97:0/443660257 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4be4068eb0 0x7f4be4069350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009f20 tx=0x7f4bdc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4413cfe9d1536dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7fc52e59c640 1 --2- 172.21.15.97:0/1135991595 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc530096f80 0x7fc530097350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc520009940 tx=0x7fc5200091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b35db801ce42fbc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7f96d7fff640 1 -- 172.21.15.97:0/3941208095 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0033510 con 0x7f96e009d7b0 2024-09-13T18:39:18.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7f96d7fff640 1 -- 172.21.15.97:0/3941208095 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0031050 con 0x7f96e009d7b0 2024-09-13T18:39:18.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7f96d7fff640 1 -- 172.21.15.97:0/3941208095 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00338e0 con 0x7f96e009d7b0 2024-09-13T18:39:18.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7f8eca08b640 1 --2- 172.21.15.97:0/3360142832 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ec406de90 0x7f8ec409c920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009970 tx=0x7f8ec00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7055dec069fa2bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7fc52d59a640 1 -- 172.21.15.97:0/1135991595 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52002ae20 con 0x7fc530096f80 2024-09-13T18:39:18.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7f8ec9089640 1 -- 172.21.15.97:0/3360142832 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec002ab70 con 0x7f8ec406de90 2024-09-13T18:39:18.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7f8ec9089640 1 -- 172.21.15.97:0/3360142832 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec002acd0 con 0x7f8ec406de90 2024-09-13T18:39:18.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7f4be27fc640 1 -- 172.21.15.97:0/443660257 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc031400 con 0x7f4be4068eb0 2024-09-13T18:39:18.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7f4be27fc640 1 -- 172.21.15.97:0/443660257 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc02d050 con 0x7f4be4068eb0 2024-09-13T18:39:18.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7f4be27fc640 1 -- 172.21.15.97:0/443660257 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc0317d0 con 0x7f4be4068eb0 2024-09-13T18:39:18.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7fc52d59a640 1 -- 172.21.15.97:0/1135991595 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc520032440 con 0x7fc530096f80 2024-09-13T18:39:18.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.936+0000 7fc52d59a640 1 -- 172.21.15.97:0/1135991595 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200327e0 con 0x7fc530096f80 2024-09-13T18:39:18.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f96e7a0f640 1 -- 172.21.15.97:0/3941208095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e009d7b0 msgr2=0x7f96e012d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f96e7a0f640 1 --2- 172.21.15.97:0/3941208095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e009d7b0 0x7f96e012d170 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009850 tx=0x7f96d00090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7fc5348d4640 1 -- 172.21.15.97:0/1135991595 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc530096f80 msgr2=0x7fc530097350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7fc5348d4640 1 --2- 172.21.15.97:0/1135991595 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc530096f80 0x7fc530097350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc520009940 tx=0x7fc5200091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f8ec9089640 1 -- 172.21.15.97:0/3360142832 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0032670 con 0x7f8ec406de90 2024-09-13T18:39:18.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7fc5348d4640 1 -- 172.21.15.97:0/1135991595 shutdown_connections 2024-09-13T18:39:18.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f4bea0e8640 1 -- 172.21.15.97:0/443660257 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4be4068eb0 msgr2=0x7f4be4069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f4bea0e8640 1 --2- 172.21.15.97:0/443660257 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4be4068eb0 0x7f4be4069350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009f20 tx=0x7f4bdc009840 comp rx=0 tx=0).stop 2024-09-13T18:39:18.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f96e7a0f640 1 -- 172.21.15.97:0/3941208095 shutdown_connections 2024-09-13T18:39:18.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f96e7a0f640 1 --2- 172.21.15.97:0/3941208095 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e012d6b0 0x7f96e012db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f4bea0e8640 1 -- 172.21.15.97:0/443660257 shutdown_connections 2024-09-13T18:39:18.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f4bea0e8640 1 --2- 172.21.15.97:0/443660257 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4be4068eb0 0x7f4be4069350 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f4bea0e8640 1 --2- 172.21.15.97:0/443660257 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4be412fed0 0x7f4be4068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f4bea0e8640 1 --2- 172.21.15.97:0/443660257 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4be40a32b0 0x7f4be412f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f4bea0e8640 1 -- 172.21.15.97:0/443660257 >> 172.21.15.97:0/443660257 conn(0x7f4be406eef0 msgr2=0x7f4be40a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f96e7a0f640 1 --2- 172.21.15.97:0/3941208095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e009d7b0 0x7f96e012d170 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f96e7a0f640 1 --2- 172.21.15.97:0/3941208095 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e009cea0 0x7f96e009d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f96e7a0f640 1 -- 172.21.15.97:0/3941208095 >> 172.21.15.97:0/3941208095 conn(0x7f96e009b200 msgr2=0x7f96e009b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7fc5348d4640 1 --2- 172.21.15.97:0/1135991595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc53012c0c0 0x7fc53012c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7fc5348d4640 1 --2- 172.21.15.97:0/1135991595 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc530096f80 0x7fc530097350 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7fc5348d4640 1 -- 172.21.15.97:0/1135991595 >> 172.21.15.97:0/1135991595 conn(0x7fc53009b200 msgr2=0x7fc53009b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3360142832 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ec406de90 msgr2=0x7f8ec409c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f8ecc2ef640 1 --2- 172.21.15.97:0/3360142832 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ec406de90 0x7f8ec409c920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009970 tx=0x7f8ec00091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f4bea0e8640 1 -- 172.21.15.97:0/443660257 shutdown_connections 2024-09-13T18:39:18.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f4bea0e8640 1 -- 172.21.15.97:0/443660257 wait complete. 2024-09-13T18:39:18.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7fc5348d4640 1 -- 172.21.15.97:0/1135991595 shutdown_connections 2024-09-13T18:39:18.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f96e7a0f640 1 -- 172.21.15.97:0/3941208095 shutdown_connections 2024-09-13T18:39:18.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f96e7a0f640 1 -- 172.21.15.97:0/3941208095 wait complete. 2024-09-13T18:39:18.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7fc5348d4640 1 -- 172.21.15.97:0/1135991595 wait complete. 2024-09-13T18:39:18.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3360142832 shutdown_connections 2024-09-13T18:39:18.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f8ecc2ef640 1 --2- 172.21.15.97:0/3360142832 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8ec409ce60 0x7f8ec412f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f8ecc2ef640 1 --2- 172.21.15.97:0/3360142832 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ec406de90 0x7f8ec409c920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3360142832 >> 172.21.15.97:0/3360142832 conn(0x7f8ec409b200 msgr2=0x7f8ec409b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:18.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3360142832 shutdown_connections 2024-09-13T18:39:18.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.937+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3360142832 wait complete. 2024-09-13T18:39:18.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7f96e7a0f640 1 Processor -- start 2024-09-13T18:39:18.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7f96e7a0f640 1 -- start start 2024-09-13T18:39:18.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7fc5348d4640 1 Processor -- start 2024-09-13T18:39:18.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7fc5348d4640 1 -- start start 2024-09-13T18:39:18.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7f8ecc2ef640 1 Processor -- start 2024-09-13T18:39:18.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7f8ecc2ef640 1 -- start start 2024-09-13T18:39:18.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7f4bea0e8640 1 Processor -- start 2024-09-13T18:39:18.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7fc5348d4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc530096f80 0x7fc530119e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7fc5348d4640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc53012c0c0 0x7fc53011a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7f4bea0e8640 1 -- start start 2024-09-13T18:39:18.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7fc5348d4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc53012c9d0 0x7fc53011a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7fc5348d4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53011bb50 con 0x7fc53012c9d0 2024-09-13T18:39:18.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7fc5348d4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53005e310 con 0x7fc530096f80 2024-09-13T18:39:18.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7fc5348d4640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc530097be0 con 0x7fc53012c0c0 2024-09-13T18:39:18.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7f96e7a0f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e009cea0 0x7f96e011c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7f96e7a0f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e009d7b0 0x7f96e0118ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7f96e7a0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e012d6b0 0x7f96e01191e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7f96e7a0f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0096a90 con 0x7f96e012d6b0 2024-09-13T18:39:18.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7f96e7a0f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0069a80 con 0x7f96e009cea0 2024-09-13T18:39:18.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.938+0000 7f96e7a0f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96e011b800 con 0x7f96e009d7b0 2024-09-13T18:39:18.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7fc52dd9b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc53012c0c0 0x7fc53011a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7fc52dd9b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc53012c0c0 0x7fc53011a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48098/0 (socket says 172.21.15.97:48098) 2024-09-13T18:39:18.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7fc52dd9b640 1 -- 172.21.15.97:0/848727154 learned_addr learned my addr 172.21.15.97:0/848727154 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f96e5fac640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e012d6b0 0x7f96e01191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f96e5fac640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e012d6b0 0x7f96e01191e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37666/0 (socket says 172.21.15.97:37666) 2024-09-13T18:39:18.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f96e5fac640 1 -- 172.21.15.97:0/415177660 learned_addr learned my addr 172.21.15.97:0/415177660 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7fc52e59c640 1 --2- 172.21.15.97:0/848727154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc530096f80 0x7fc530119e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f96e4faa640 1 --2- 172.21.15.97:0/415177660 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e009d7b0 0x7f96e0118ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7fc52ed9d640 1 --2- 172.21.15.97:0/848727154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc53012c9d0 0x7fc53011a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7fc52e59c640 1 -- 172.21.15.97:0/848727154 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc53012c0c0 msgr2=0x7fc53011a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7fc52e59c640 1 --2- 172.21.15.97:0/848727154 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc53012c0c0 0x7fc53011a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7fc52e59c640 1 -- 172.21.15.97:0/848727154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc53012c9d0 msgr2=0x7fc53011a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7fc52e59c640 1 --2- 172.21.15.97:0/848727154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc53012c9d0 0x7fc53011a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7fc52e59c640 1 -- 172.21.15.97:0/848727154 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc520009450 con 0x7fc530096f80 2024-09-13T18:39:18.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f96e4faa640 1 -- 172.21.15.97:0/415177660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e009cea0 msgr2=0x7f96e011c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f96e4faa640 1 --2- 172.21.15.97:0/415177660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e009cea0 0x7f96e011c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f96e4faa640 1 -- 172.21.15.97:0/415177660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e012d6b0 msgr2=0x7f96e01191e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f96e4faa640 1 --2- 172.21.15.97:0/415177660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e012d6b0 0x7f96e01191e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f96e4faa640 1 -- 172.21.15.97:0/415177660 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d0009390 con 0x7f96e009d7b0 2024-09-13T18:39:18.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f4bea0e8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4be4068eb0 0x7f4be411f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7fc52dd9b640 1 --2- 172.21.15.97:0/848727154 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc53012c0c0 0x7fc53011a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:18.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f96e5fac640 1 --2- 172.21.15.97:0/415177660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e012d6b0 0x7f96e01191e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:18.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f4bea0e8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4be40a32b0 0x7f4be412c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f4bea0e8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4be412fed0 0x7f4be412c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f4bea0e8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be412dc60 con 0x7f4be412fed0 2024-09-13T18:39:18.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f4bea0e8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be409e710 con 0x7f4be40a32b0 2024-09-13T18:39:18.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f4bea0e8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4be411efd0 con 0x7f4be4068eb0 2024-09-13T18:39:18.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7f96e4faa640 1 --2- 172.21.15.97:0/415177660 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e009d7b0 0x7f96e0118ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f96d0035000 tx=0x7f96d0039000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.939+0000 7fc52e59c640 1 --2- 172.21.15.97:0/848727154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc530096f80 0x7fc530119e00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc520031000 tx=0x7fc520032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f4be37fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4be4068eb0 0x7f4be411f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f4be37fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4be4068eb0 0x7f4be411f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48112/0 (socket says 172.21.15.97:48112) 2024-09-13T18:39:18.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f4be2ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4be40a32b0 0x7f4be412c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f4be37fe640 1 -- 172.21.15.97:0/1985145925 learned_addr learned my addr 172.21.15.97:0/1985145925 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8ecc2ef640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ec406de90 0x7f8ec412c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8ecc2ef640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8ec409ce60 0x7f8ec41195f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8ecc2ef640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ec409d230 0x7f8ec4119b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:18.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8ecc2ef640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec411b630 con 0x7f8ec409d230 2024-09-13T18:39:18.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8ecc2ef640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec411b120 con 0x7f8ec406de90 2024-09-13T18:39:18.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f96d57fa640 1 -- 172.21.15.97:0/415177660 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0035890 con 0x7f96e009d7b0 2024-09-13T18:39:18.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f4be2ffd640 1 -- 172.21.15.97:0/1985145925 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4be4068eb0 msgr2=0x7f4be411f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f4be2ffd640 1 --2- 172.21.15.97:0/1985145925 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4be4068eb0 0x7f4be411f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f4be2ffd640 1 -- 172.21.15.97:0/1985145925 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4be412fed0 msgr2=0x7f4be412c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f96d57fa640 1 -- 172.21.15.97:0/415177660 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0043070 con 0x7f96e009d7b0 2024-09-13T18:39:18.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f96e7a0f640 1 -- 172.21.15.97:0/415177660 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e0119fc0 con 0x7f96e009d7b0 2024-09-13T18:39:18.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8ecc2ef640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec411ca90 con 0x7f8ec409ce60 2024-09-13T18:39:18.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8eca88c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ec409d230 0x7f8ec4119b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8eca88c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ec409d230 0x7f8ec4119b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37682/0 (socket says 172.21.15.97:37682) 2024-09-13T18:39:18.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8eca88c640 1 -- 172.21.15.97:0/3408636938 learned_addr learned my addr 172.21.15.97:0/3408636938 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:18.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8eca08b640 1 --2- 172.21.15.97:0/3408636938 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ec406de90 0x7f8ec412c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8eca88c640 1 -- 172.21.15.97:0/3408636938 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8ec409ce60 msgr2=0x7f8ec41195f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8eca88c640 1 --2- 172.21.15.97:0/3408636938 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8ec409ce60 0x7f8ec41195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8eca88c640 1 -- 172.21.15.97:0/3408636938 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ec406de90 msgr2=0x7f8ec412c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:18.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8eca88c640 1 --2- 172.21.15.97:0/3408636938 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ec406de90 0x7f8ec412c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8eca88c640 1 -- 172.21.15.97:0/3408636938 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0009450 con 0x7f8ec409d230 2024-09-13T18:39:18.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f4be3fff640 1 --2- 172.21.15.97:0/1985145925 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4be412fed0 0x7f4be412c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:18.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7fc51e7fc640 1 -- 172.21.15.97:0/848727154 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520031de0 con 0x7fc530096f80 2024-09-13T18:39:18.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7fc51e7fc640 1 -- 172.21.15.97:0/848727154 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52003e450 con 0x7fc530096f80 2024-09-13T18:39:18.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7fc51e7fc640 1 -- 172.21.15.97:0/848727154 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52003e810 con 0x7fc530096f80 2024-09-13T18:39:18.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7fc5348d4640 1 -- 172.21.15.97:0/848727154 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53011d870 con 0x7fc530096f80 2024-09-13T18:39:18.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7fc5348d4640 1 -- 172.21.15.97:0/848727154 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53011cfe0 con 0x7fc530096f80 2024-09-13T18:39:18.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f4be2ffd640 1 --2- 172.21.15.97:0/1985145925 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4be412fed0 0x7f4be412c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:18.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f4be2ffd640 1 -- 172.21.15.97:0/1985145925 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc009ae0 con 0x7f4be40a32b0 2024-09-13T18:39:18.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f4be37fe640 1 --2- 172.21.15.97:0/1985145925 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4be4068eb0 0x7f4be411f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:18.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f4be3fff640 1 --2- 172.21.15.97:0/1985145925 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4be412fed0 0x7f4be412c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:18.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f8eca88c640 1 --2- 172.21.15.97:0/3408636938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ec409d230 0x7f8ec4119b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00cb90 tx=0x7f8ebc0017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.941+0000 7f4be2ffd640 1 --2- 172.21.15.97:0/1985145925 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4be40a32b0 0x7f4be412c140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800e930 tx=0x7f4bd80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:18.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f96d57fa640 1 -- 172.21.15.97:0/415177660 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0035c00 con 0x7f96e009d7b0 2024-09-13T18:39:18.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.940+0000 7f96e7a0f640 1 -- 172.21.15.97:0/415177660 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e0119720 con 0x7f96e009d7b0 2024-09-13T18:39:18.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.941+0000 7f8eba7fc640 1 -- 172.21.15.97:0/3408636938 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00a920 con 0x7f8ec409d230 2024-09-13T18:39:18.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.941+0000 7f8eba7fc640 1 -- 172.21.15.97:0/3408636938 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc00aa80 con 0x7f8ec409d230 2024-09-13T18:39:18.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.941+0000 7f8eba7fc640 1 -- 172.21.15.97:0/3408636938 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00ae40 con 0x7f8ec409d230 2024-09-13T18:39:18.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.941+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3408636938 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec411cd50 con 0x7f8ec409d230 2024-09-13T18:39:18.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.941+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3408636938 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec411d890 con 0x7f8ec409d230 2024-09-13T18:39:18.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.942+0000 7f4bcb7fe640 1 -- 172.21.15.97:0/1985145925 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8009560 con 0x7f4be40a32b0 2024-09-13T18:39:18.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.942+0000 7f4bcb7fe640 1 -- 172.21.15.97:0/1985145925 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd800c940 con 0x7f4be40a32b0 2024-09-13T18:39:18.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.942+0000 7fc5348d4640 1 -- 172.21.15.97:0/848727154 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc530064000 con 0x7fc530096f80 2024-09-13T18:39:18.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.942+0000 7f4bea0e8640 1 -- 172.21.15.97:0/1985145925 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be411ea30 con 0x7f4be40a32b0 2024-09-13T18:39:18.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.942+0000 7f96d57fa640 1 -- 172.21.15.97:0/415177660 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f96d004a480 con 0x7f96e009d7b0 2024-09-13T18:39:18.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.942+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3408636938 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec4064000 con 0x7f8ec409d230 2024-09-13T18:39:18.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.942+0000 7f8eba7fc640 1 -- 172.21.15.97:0/3408636938 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f8ebc012630 con 0x7f8ec409d230 2024-09-13T18:39:18.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.942+0000 7f8eba7fc640 1 -- 172.21.15.97:0/3408636938 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f8ebc042320 con 0x7f8ec409d230 2024-09-13T18:39:18.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.942+0000 7f96e7a0f640 1 -- 172.21.15.97:0/415177660 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e0064000 con 0x7f96e009d7b0 2024-09-13T18:39:18.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.942+0000 7f96d57fa640 1 -- 172.21.15.97:0/415177660 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f96d0045070 con 0x7f96e009d7b0 2024-09-13T18:39:18.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.942+0000 7f4bea0e8640 1 -- 172.21.15.97:0/1985145925 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be412cbc0 con 0x7f4be40a32b0 2024-09-13T18:39:18.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.942+0000 7fc51e7fc640 1 -- 172.21.15.97:0/848727154 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fc52003ec40 con 0x7fc530096f80 2024-09-13T18:39:18.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.942+0000 7fc51e7fc640 1 -- 172.21.15.97:0/848727154 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7fc520062600 con 0x7fc530096f80 2024-09-13T18:39:18.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.943+0000 7f4bcb7fe640 1 -- 172.21.15.97:0/1985145925 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd800ccc0 con 0x7f4be40a32b0 2024-09-13T18:39:18.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.943+0000 7f4bea0e8640 1 -- 172.21.15.97:0/1985145925 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc4005210 con 0x7f4be40a32b0 2024-09-13T18:39:18.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.943+0000 7f4bcb7fe640 1 -- 172.21.15.97:0/1985145925 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f4bd8013680 con 0x7f4be40a32b0 2024-09-13T18:39:18.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.944+0000 7f4bcb7fe640 1 -- 172.21.15.97:0/1985145925 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f4bd80422f0 con 0x7f4be40a32b0 2024-09-13T18:39:18.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.947+0000 7f96d57fa640 1 -- 172.21.15.97:0/415177660 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f96d0049e30 con 0x7f96e009d7b0 2024-09-13T18:39:18.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.947+0000 7fc51e7fc640 1 -- 172.21.15.97:0/848727154 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fc52003a300 con 0x7fc530096f80 2024-09-13T18:39:18.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.947+0000 7f8eba7fc640 1 -- 172.21.15.97:0/3408636938 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f8ebc010d50 con 0x7f8ec409d230 2024-09-13T18:39:18.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:18.952+0000 7f4bcb7fe640 1 -- 172.21.15.97:0/1985145925 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f4bd8013cb0 con 0x7f4be40a32b0 2024-09-13T18:39:19.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.107+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3408636938 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ec40987b0 con 0x7f8ec409d230 2024-09-13T18:39:19.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.107+0000 7f8eba7fc640 1 -- 172.21.15.97:0/3408636938 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ebc010750 con 0x7f8ec409d230 2024-09-13T18:39:19.110 INFO:teuthology.orchestra.run.smithi097.stdout:38654705669 2024-09-13T18:39:19.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.110+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3408636938 >> v1:172.21.15.97:6816/34603 conn(0x7f8ea80311b0 legacy=0x7f8ea8033660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:19.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.110+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3408636938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ec409d230 msgr2=0x7f8ec4119b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:19.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.110+0000 7f8ecc2ef640 1 --2- 172.21.15.97:0/3408636938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ec409d230 0x7f8ec4119b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00cb90 tx=0x7f8ebc0017f0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.110+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3408636938 shutdown_connections 2024-09-13T18:39:19.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.110+0000 7f8ecc2ef640 1 --2- 172.21.15.97:0/3408636938 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ec409d230 0x7f8ec4119b30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.110+0000 7f8ecc2ef640 1 --2- 172.21.15.97:0/3408636938 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8ec409ce60 0x7f8ec41195f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.110+0000 7f8ecc2ef640 1 --2- 172.21.15.97:0/3408636938 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8ec406de90 0x7f8ec412c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.110+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3408636938 >> 172.21.15.97:0/3408636938 conn(0x7f8ec409b200 msgr2=0x7f8ec4130480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:19.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.110+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3408636938 shutdown_connections 2024-09-13T18:39:19.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.110+0000 7f8ecc2ef640 1 -- 172.21.15.97:0/3408636938 wait complete. 2024-09-13T18:39:19.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.117+0000 7f4bea0e8640 1 -- 172.21.15.97:0/1985145925 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4bc40054c0 con 0x7f4be40a32b0 2024-09-13T18:39:19.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.118+0000 7f4bcb7fe640 1 -- 172.21.15.97:0/1985145925 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4bd8021070 con 0x7f4be40a32b0 2024-09-13T18:39:19.121 INFO:teuthology.orchestra.run.smithi097.stdout:38654705668 2024-09-13T18:39:19.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.121+0000 7f4bea0e8640 1 -- 172.21.15.97:0/1985145925 >> v1:172.21.15.97:6816/34603 conn(0x7f4bd00311b0 legacy=0x7f4bd0033660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:19.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.121+0000 7f4bea0e8640 1 -- 172.21.15.97:0/1985145925 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4be40a32b0 msgr2=0x7f4be412c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:19.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.121+0000 7f4bea0e8640 1 --2- 172.21.15.97:0/1985145925 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4be40a32b0 0x7f4be412c140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800e930 tx=0x7f4bd80090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.121+0000 7f4bea0e8640 1 -- 172.21.15.97:0/1985145925 shutdown_connections 2024-09-13T18:39:19.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.121+0000 7f4bea0e8640 1 --2- 172.21.15.97:0/1985145925 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4be412fed0 0x7f4be412c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.121+0000 7f4bea0e8640 1 --2- 172.21.15.97:0/1985145925 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4be40a32b0 0x7f4be412c140 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.121+0000 7f4bea0e8640 1 --2- 172.21.15.97:0/1985145925 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4be4068eb0 0x7f4be411f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.121+0000 7f4bea0e8640 1 -- 172.21.15.97:0/1985145925 >> 172.21.15.97:0/1985145925 conn(0x7f4be406eef0 msgr2=0x7f4be40a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:19.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.121+0000 7f4bea0e8640 1 -- 172.21.15.97:0/1985145925 shutdown_connections 2024-09-13T18:39:19.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.121+0000 7f4bea0e8640 1 -- 172.21.15.97:0/1985145925 wait complete. 2024-09-13T18:39:19.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2024-09-13T18:39:19.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-09-13T18:39:19.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.135+0000 7fc5348d4640 1 -- 172.21.15.97:0/848727154 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc53009baf0 con 0x7fc530096f80 2024-09-13T18:39:19.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.136+0000 7fc51e7fc640 1 -- 172.21.15.97:0/848727154 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc520043090 con 0x7fc530096f80 2024-09-13T18:39:19.138 INFO:teuthology.orchestra.run.smithi097.stdout:38654705670 2024-09-13T18:39:19.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.138+0000 7fc5348d4640 1 -- 172.21.15.97:0/848727154 >> v1:172.21.15.97:6816/34603 conn(0x7fc5100355f0 legacy=0x7fc510037aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:19.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.138+0000 7fc5348d4640 1 -- 172.21.15.97:0/848727154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc530096f80 msgr2=0x7fc530119e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:19.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.138+0000 7fc5348d4640 1 --2- 172.21.15.97:0/848727154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc530096f80 0x7fc530119e00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc520031000 tx=0x7fc520032000 comp rx=0 tx=0).stop 2024-09-13T18:39:19.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.138+0000 7fc5348d4640 1 -- 172.21.15.97:0/848727154 shutdown_connections 2024-09-13T18:39:19.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.138+0000 7fc5348d4640 1 --2- 172.21.15.97:0/848727154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc53012c9d0 0x7fc53011a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.138+0000 7fc5348d4640 1 --2- 172.21.15.97:0/848727154 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc53012c0c0 0x7fc53011a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.138+0000 7fc5348d4640 1 --2- 172.21.15.97:0/848727154 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc530096f80 0x7fc530119e00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.138+0000 7fc5348d4640 1 -- 172.21.15.97:0/848727154 >> 172.21.15.97:0/848727154 conn(0x7fc53009b200 msgr2=0x7fc53006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:19.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.138+0000 7fc5348d4640 1 -- 172.21.15.97:0/848727154 shutdown_connections 2024-09-13T18:39:19.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.138+0000 7fc5348d4640 1 -- 172.21.15.97:0/848727154 wait complete. 2024-09-13T18:39:19.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.143+0000 7f96e7a0f640 1 -- 172.21.15.97:0/415177660 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f96e006e500 con 0x7f96e009d7b0 2024-09-13T18:39:19.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.143+0000 7f96d57fa640 1 -- 172.21.15.97:0/415177660 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f96d0049850 con 0x7f96e009d7b0 2024-09-13T18:39:19.146 INFO:teuthology.orchestra.run.smithi097.stdout:38654705669 2024-09-13T18:39:19.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.145+0000 7f96e7a0f640 1 -- 172.21.15.97:0/415177660 >> v1:172.21.15.97:6816/34603 conn(0x7f96c40311b0 legacy=0x7f96c4033660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:19.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.145+0000 7f96e7a0f640 1 -- 172.21.15.97:0/415177660 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e009d7b0 msgr2=0x7f96e0118ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:19.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.145+0000 7f96e7a0f640 1 --2- 172.21.15.97:0/415177660 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e009d7b0 0x7f96e0118ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f96d0035000 tx=0x7f96d0039000 comp rx=0 tx=0).stop 2024-09-13T18:39:19.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.145+0000 7f96e7a0f640 1 -- 172.21.15.97:0/415177660 shutdown_connections 2024-09-13T18:39:19.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.145+0000 7f96e7a0f640 1 --2- 172.21.15.97:0/415177660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96e012d6b0 0x7f96e01191e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.145+0000 7f96e7a0f640 1 --2- 172.21.15.97:0/415177660 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f96e009d7b0 0x7f96e0118ca0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.145+0000 7f96e7a0f640 1 --2- 172.21.15.97:0/415177660 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f96e009cea0 0x7f96e011c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:19.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.145+0000 7f96e7a0f640 1 -- 172.21.15.97:0/415177660 >> 172.21.15.97:0/415177660 conn(0x7f96e009b200 msgr2=0x7f96e0099ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:19.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.146+0000 7f96e7a0f640 1 -- 172.21.15.97:0/415177660 shutdown_connections 2024-09-13T18:39:19.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:19.146+0000 7f96e7a0f640 1 -- 172.21.15.97:0/415177660 wait complete. 2024-09-13T18:39:19.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.2 2024-09-13T18:39:19.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.3 2024-09-13T18:39:19.631 INFO:tasks.ceph.mds.a.smithi097.stderr:2024-09-13T18:39:19.628+0000 7f0f8e3f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:39:20.126 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:39:20.138 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:39:20.152 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:39:20.159 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:39:20.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.236+0000 7fd80479d640 1 Processor -- start 2024-09-13T18:39:20.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.236+0000 7fd80479d640 1 -- start start 2024-09-13T18:39:20.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd80479d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7fc0a1320 0x7fd7fc12f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd80479d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7fc12fad0 0x7fd7fc12fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd80479d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd7fc09e740 0x7fd7fc09ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd80479d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc0a16f0 con 0x7fd7fc09e740 2024-09-13T18:39:20.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd80479d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc06a030 con 0x7fd7fc0a1320 2024-09-13T18:39:20.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd80479d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc09fc10 con 0x7fd7fc12fad0 2024-09-13T18:39:20.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd802539640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7fc0a1320 0x7fd7fc12f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd802539640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7fc0a1320 0x7fd7fc12f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35866/0 (socket says 172.21.15.97:35866) 2024-09-13T18:39:20.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd802539640 1 -- 172.21.15.97:0/2209916256 learned_addr learned my addr 172.21.15.97:0/2209916256 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:20.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd802d3a640 1 --2- 172.21.15.97:0/2209916256 >> v2:172.21.15.97:3300/0 conn(0x7fd7fc09e740 0x7fd7fc09ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd801d38640 1 --2- 172.21.15.97:0/2209916256 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7fc12fad0 0x7fd7fc12fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd802539640 1 -- 172.21.15.97:0/2209916256 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7fc12fad0 msgr2=0x7fd7fc12fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:20.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd802539640 1 --2- 172.21.15.97:0/2209916256 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7fc12fad0 0x7fd7fc12fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd802539640 1 -- 172.21.15.97:0/2209916256 >> v2:172.21.15.97:3300/0 conn(0x7fd7fc09e740 msgr2=0x7fd7fc09ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:20.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd802539640 1 --2- 172.21.15.97:0/2209916256 >> v2:172.21.15.97:3300/0 conn(0x7fd7fc09e740 0x7fd7fc09ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd802539640 1 -- 172.21.15.97:0/2209916256 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc068eb0 con 0x7fd7fc0a1320 2024-09-13T18:39:20.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.237+0000 7fd802d3a640 1 --2- 172.21.15.97:0/2209916256 >> v2:172.21.15.97:3300/0 conn(0x7fd7fc09e740 0x7fd7fc09ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:20.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.238+0000 7fd802539640 1 --2- 172.21.15.97:0/2209916256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7fc0a1320 0x7fd7fc12f590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009910 tx=0x7fd7f80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0837ad24ddf0131 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:20.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.238+0000 7fd801537640 1 -- 172.21.15.97:0/2209916256 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f802adb0 con 0x7fd7fc0a1320 2024-09-13T18:39:20.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.238+0000 7fd801537640 1 -- 172.21.15.97:0/2209916256 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f8032440 con 0x7fd7fc0a1320 2024-09-13T18:39:20.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.238+0000 7fd801537640 1 -- 172.21.15.97:0/2209916256 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8032820 con 0x7fd7fc0a1320 2024-09-13T18:39:20.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.239+0000 7fd80479d640 1 -- 172.21.15.97:0/2209916256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7fc0a1320 msgr2=0x7fd7fc12f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.239+0000 7fd80479d640 1 --2- 172.21.15.97:0/2209916256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7fc0a1320 0x7fd7fc12f590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009910 tx=0x7fd7f80091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.239+0000 7fd80479d640 1 -- 172.21.15.97:0/2209916256 shutdown_connections 2024-09-13T18:39:20.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.239+0000 7fd80479d640 1 --2- 172.21.15.97:0/2209916256 >> v2:172.21.15.97:3300/0 conn(0x7fd7fc09e740 0x7fd7fc09ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.239+0000 7fd80479d640 1 --2- 172.21.15.97:0/2209916256 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7fc12fad0 0x7fd7fc12fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.239+0000 7fd80479d640 1 --2- 172.21.15.97:0/2209916256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7fc0a1320 0x7fd7fc12f590 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.239+0000 7fd80479d640 1 -- 172.21.15.97:0/2209916256 >> 172.21.15.97:0/2209916256 conn(0x7fd7fc0a0840 msgr2=0x7fd7fc0a0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:20.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.239+0000 7fd80479d640 1 -- 172.21.15.97:0/2209916256 shutdown_connections 2024-09-13T18:39:20.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.239+0000 7fd80479d640 1 -- 172.21.15.97:0/2209916256 wait complete. 2024-09-13T18:39:20.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.240+0000 7fd80479d640 1 Processor -- start 2024-09-13T18:39:20.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.240+0000 7fd80479d640 1 -- start start 2024-09-13T18:39:20.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd80479d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7fc09e740 0x7fd7fc118c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd80479d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7fc0a1320 0x7fd7fc1191b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd80479d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7fc12fad0 0x7fd7fc13e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd80479d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc068890 con 0x7fd7fc0a1320 2024-09-13T18:39:20.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd80479d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc11b8b0 con 0x7fd7fc09e740 2024-09-13T18:39:20.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd80479d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc1189d0 con 0x7fd7fc12fad0 2024-09-13T18:39:20.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd802d3a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7fc12fad0 0x7fd7fc13e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd801d38640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7fc0a1320 0x7fd7fc1191b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd802d3a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7fc12fad0 0x7fd7fc13e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48134/0 (socket says 172.21.15.97:48134) 2024-09-13T18:39:20.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd802d3a640 1 -- 172.21.15.97:0/2277292643 learned_addr learned my addr 172.21.15.97:0/2277292643 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:20.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd802539640 1 --2- 172.21.15.97:0/2277292643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7fc09e740 0x7fd7fc118c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd802d3a640 1 -- 172.21.15.97:0/2277292643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7fc09e740 msgr2=0x7fd7fc118c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd802d3a640 1 --2- 172.21.15.97:0/2277292643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7fc09e740 0x7fd7fc118c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd802d3a640 1 -- 172.21.15.97:0/2277292643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7fc0a1320 msgr2=0x7fd7fc1191b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd802d3a640 1 --2- 172.21.15.97:0/2277292643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7fc0a1320 0x7fd7fc1191b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd802d3a640 1 -- 172.21.15.97:0/2277292643 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f4009a20 con 0x7fd7fc12fad0 2024-09-13T18:39:20.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd801d38640 1 --2- 172.21.15.97:0/2277292643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7fc0a1320 0x7fd7fc1191b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:20.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd802539640 1 --2- 172.21.15.97:0/2277292643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7fc09e740 0x7fd7fc118c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:20.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.241+0000 7fd802d3a640 1 --2- 172.21.15.97:0/2277292643 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7fc12fad0 0x7fd7fc13e960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4009f20 tx=0x7fd7f400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:20.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.242+0000 7fd7f27fc640 1 -- 172.21.15.97:0/2277292643 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4009c80 con 0x7fd7fc12fad0 2024-09-13T18:39:20.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.242+0000 7fd7f27fc640 1 -- 172.21.15.97:0/2277292643 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f400f040 con 0x7fd7fc12fad0 2024-09-13T18:39:20.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.242+0000 7fd80479d640 1 -- 172.21.15.97:0/2277292643 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f8009450 con 0x7fd7fc12fad0 2024-09-13T18:39:20.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.243+0000 7fd7f27fc640 1 -- 172.21.15.97:0/2277292643 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f40146d0 con 0x7fd7fc12fad0 2024-09-13T18:39:20.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.243+0000 7fd80479d640 1 -- 172.21.15.97:0/2277292643 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc119f40 con 0x7fd7fc12fad0 2024-09-13T18:39:20.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.243+0000 7fd7f27fc640 1 -- 172.21.15.97:0/2277292643 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fd7f4003020 con 0x7fd7fc12fad0 2024-09-13T18:39:20.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.243+0000 7fd7f27fc640 1 -- 172.21.15.97:0/2277292643 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7fd7f40434b0 con 0x7fd7fc12fad0 2024-09-13T18:39:20.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.244+0000 7fd80479d640 1 -- 172.21.15.97:0/2277292643 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7fc11b9f0 con 0x7fd7fc12fad0 2024-09-13T18:39:20.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.252+0000 7fd7f27fc640 1 -- 172.21.15.97:0/2277292643 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fd7f4018020 con 0x7fd7fc12fad0 2024-09-13T18:39:20.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.273+0000 7fcfcc71d640 1 Processor -- start 2024-09-13T18:39:20.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.273+0000 7fcfcc71d640 1 -- start start 2024-09-13T18:39:20.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.273+0000 7f0cf6b9d640 1 Processor -- start 2024-09-13T18:39:20.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.273+0000 7f0cf6b9d640 1 -- start start 2024-09-13T18:39:20.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7f0cf6b9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0cf00986c0 0x7f0cf012a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7fcfcc71d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfc41300a0 0x7fcfc4134750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7fcfcc71d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcfc4134c90 0x7fcfc4137070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7f0cf6b9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0cf0068880 0x7f0cf01336f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7f0cf6b9d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf0096d30 con 0x7f0cf012af00 2024-09-13T18:39:20.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7f0cf6b9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf00971f0 con 0x7f0cf0068880 2024-09-13T18:39:20.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7fcfcc71d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc40a3680 con 0x7fcfc40a32b0 2024-09-13T18:39:20.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7f0cf6b9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf0098a90 con 0x7f0cf00986c0 2024-09-13T18:39:20.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7fcfcc71d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc4097460 con 0x7fcfc4134c90 2024-09-13T18:39:20.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7fcfca4b9640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fcfc40a32b0 0x7fcfc412f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47854/0 (socket says 172.21.15.97:47854) 2024-09-13T18:39:20.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7fcfca4b9640 1 -- 172.21.15.97:0/3688323750 learned_addr learned my addr 172.21.15.97:0/3688323750 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:20.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7f0cf513a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0cf0068880 0x7f0cf01336f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3688323750 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc412d770 con 0x7fcfc41300a0 2024-09-13T18:39:20.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7fcfc9cb8640 1 --2- 172.21.15.97:0/3688323750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfc41300a0 0x7fcfc4134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7f0ceffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f0cf012af00 0x7f0cf01292b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47862/0 (socket says 172.21.15.97:47862) 2024-09-13T18:39:20.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7f0ceffff640 1 -- 172.21.15.97:0/3717666264 learned_addr learned my addr 172.21.15.97:0/3717666264 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:20.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7fcfcacba640 1 --2- 172.21.15.97:0/3688323750 >> v2:172.21.15.97:3300/0 conn(0x7fcfc4134c90 0x7fcfc4137070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7fcfc94b7640 1 -- 172.21.15.97:0/3688323750 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032084832 0 0) 0x7fcfc40a3680 con 0x7fcfc40a32b0 2024-09-13T18:39:20.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7fcfc94b7640 1 -- 172.21.15.97:0/3688323750 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfb00034e0 con 0x7fcfc40a32b0 2024-09-13T18:39:20.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.274+0000 7f0cf4939640 1 --2- 172.21.15.97:0/3717666264 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0cf00986c0 0x7f0cf012a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.275+0000 7f0cef7fe640 1 -- 172.21.15.97:0/3717666264 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134383746 0 0) 0x7f0cf0096d30 con 0x7f0cf012af00 2024-09-13T18:39:20.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.275+0000 7f0cef7fe640 1 -- 172.21.15.97:0/3717666264 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ce00034e0 con 0x7f0cf012af00 2024-09-13T18:39:20.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.275+0000 7f0cf513a640 1 -- 172.21.15.97:0/3717666264 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0cf00986c0 msgr2=0x7f0cf012a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:20.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.275+0000 7f0cf513a640 1 --2- 172.21.15.97:0/3717666264 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0cf00986c0 0x7f0cf012a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.275+0000 7f0cf513a640 1 -- 172.21.15.97:0/3717666264 >> v1:172.21.15.97:6789/0 conn(0x7f0cf012af00 legacy=0x7f0cf01292b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.275+0000 7fcfc9cb8640 1 -- 172.21.15.97:0/3688323750 >> v2:172.21.15.97:3300/0 conn(0x7fcfc4134c90 msgr2=0x7fcfc4137070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:20.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.275+0000 7fcfc9cb8640 1 --2- 172.21.15.97:0/3688323750 >> v2:172.21.15.97:3300/0 conn(0x7fcfc4134c90 0x7fcfc4137070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.275+0000 7fcfc9cb8640 1 -- 172.21.15.97:0/3688323750 >> v1:172.21.15.97:6789/0 conn(0x7fcfc40a32b0 legacy=0x7fcfc412f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.275+0000 7fcfc9cb8640 1 -- 172.21.15.97:0/3688323750 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc409dc40 con 0x7fcfc41300a0 2024-09-13T18:39:20.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.275+0000 7f0cf513a640 1 -- 172.21.15.97:0/3717666264 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf0098d80 con 0x7f0cf0068880 2024-09-13T18:39:20.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.275+0000 7f0cf4939640 1 --2- 172.21.15.97:0/3717666264 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0cf00986c0 0x7f0cf012a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:20.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.276+0000 7f0cf513a640 1 --2- 172.21.15.97:0/3717666264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0cf0068880 0x7f0cf01336f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009e90 tx=0x7f0ce8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=106602b3f0df3681 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:20.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.276+0000 7fcfc9cb8640 1 --2- 172.21.15.97:0/3688323750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfc41300a0 0x7fcfc4134750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009850 tx=0x7fcfb40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53a5928b67db1b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:20.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.276+0000 7f0cef7fe640 1 -- 172.21.15.97:0/3717666264 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8031400 con 0x7f0cf0068880 2024-09-13T18:39:20.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.276+0000 7f0cef7fe640 1 -- 172.21.15.97:0/3717666264 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce802d050 con 0x7f0cf0068880 2024-09-13T18:39:20.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.276+0000 7f0cef7fe640 1 -- 172.21.15.97:0/3717666264 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce80317b0 con 0x7f0cf0068880 2024-09-13T18:39:20.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.276+0000 7fcfc94b7640 1 -- 172.21.15.97:0/3688323750 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb402ad00 con 0x7fcfc41300a0 2024-09-13T18:39:20.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.276+0000 7fcfc94b7640 1 -- 172.21.15.97:0/3688323750 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb402ae60 con 0x7fcfc41300a0 2024-09-13T18:39:20.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.276+0000 7fcfc94b7640 1 -- 172.21.15.97:0/3688323750 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4032670 con 0x7fcfc41300a0 2024-09-13T18:39:20.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.276+0000 7f3a1635d640 1 Processor -- start 2024-09-13T18:39:20.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.276+0000 7f3a1635d640 1 -- start start 2024-09-13T18:39:20.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f3a1635d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a100a13b0 0x7f3a1012f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/3717666264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0cf0068880 msgr2=0x7f0cf01336f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f3a1635d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a1012fbb0 0x7f3a1009b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f0cf6b9d640 1 --2- 172.21.15.97:0/3717666264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0cf0068880 0x7f0cf01336f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009e90 tx=0x7f0ce8009780 comp rx=0 tx=0).stop 2024-09-13T18:39:20.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3688323750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfc41300a0 msgr2=0x7fcfc4134750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7fcfcc71d640 1 --2- 172.21.15.97:0/3688323750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfc41300a0 0x7fcfc4134750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009850 tx=0x7fcfb40090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f3a0f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a1012fbb0 0x7f3a1009b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f3a0f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a1012fbb0 0x7f3a1009b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35900/0 (socket says 172.21.15.97:35900) 2024-09-13T18:39:20.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f3a0f7fe640 1 -- 172.21.15.97:0/1827145611 learned_addr learned my addr 172.21.15.97:0/1827145611 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:20.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f3a1635d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a10068220 con 0x7f3a1012ff80 2024-09-13T18:39:20.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f3a1635d640 1 -- 172.21.15.97:0/1827145611 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a100a1780 con 0x7f3a1012fbb0 2024-09-13T18:39:20.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f3a1635d640 1 -- 172.21.15.97:0/1827145611 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a10069090 con 0x7f3a100a13b0 2024-09-13T18:39:20.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f3a0ffff640 1 --2- 172.21.15.97:0/1827145611 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a100a13b0 0x7f3a1012f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/3717666264 shutdown_connections 2024-09-13T18:39:20.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f0cf6b9d640 1 --2- 172.21.15.97:0/3717666264 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0cf0068880 0x7f0cf01336f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f0cf6b9d640 1 --2- 172.21.15.97:0/3717666264 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0cf00986c0 0x7f0cf012a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/3717666264 >> 172.21.15.97:0/3717666264 conn(0x7f0cf009b200 msgr2=0x7f0cf009b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:20.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/3717666264 shutdown_connections 2024-09-13T18:39:20.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f3a0f7fe640 1 -- 172.21.15.97:0/1827145611 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a100a13b0 msgr2=0x7f3a1012f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:20.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f3a0f7fe640 1 --2- 172.21.15.97:0/1827145611 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a100a13b0 0x7f3a1012f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f3a0f7fe640 1 -- 172.21.15.97:0/1827145611 >> v1:172.21.15.97:6789/0 conn(0x7f3a1012ff80 legacy=0x7f3a1009b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:20.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f3a0f7fe640 1 -- 172.21.15.97:0/1827145611 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10068dd0 con 0x7f3a1012fbb0 2024-09-13T18:39:20.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/3717666264 wait complete. 2024-09-13T18:39:20.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3688323750 shutdown_connections 2024-09-13T18:39:20.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7fcfcc71d640 1 --2- 172.21.15.97:0/3688323750 >> v2:172.21.15.97:3300/0 conn(0x7fcfc4134c90 0x7fcfc4137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7fcfcc71d640 1 --2- 172.21.15.97:0/3688323750 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfc41300a0 0x7fcfc4134750 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.277+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3688323750 >> 172.21.15.97:0/3688323750 conn(0x7fcfc406eef0 msgr2=0x7fcfc40a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:20.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.278+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3688323750 shutdown_connections 2024-09-13T18:39:20.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.278+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3688323750 wait complete. 2024-09-13T18:39:20.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.278+0000 7f3a0f7fe640 1 --2- 172.21.15.97:0/1827145611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a1012fbb0 0x7f3a1009b2a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009940 tx=0x7f3a040091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a743ceee0c80538f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:20.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.278+0000 7f3a0effd640 1 -- 172.21.15.97:0/1827145611 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0402ad00 con 0x7f3a1012fbb0 2024-09-13T18:39:20.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.278+0000 7f3a0effd640 1 -- 172.21.15.97:0/1827145611 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0402ae60 con 0x7f3a1012fbb0 2024-09-13T18:39:20.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.278+0000 7f3a0effd640 1 -- 172.21.15.97:0/1827145611 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04032670 con 0x7f3a1012fbb0 2024-09-13T18:39:20.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.278+0000 7fcfcc71d640 1 Processor -- start 2024-09-13T18:39:20.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfcc71d640 1 -- start start 2024-09-13T18:39:20.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f0cf6b9d640 1 Processor -- start 2024-09-13T18:39:20.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f0cf6b9d640 1 -- start start 2024-09-13T18:39:20.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfcc71d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfc40a32b0 0x7fcfc409a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfcc71d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfc41300a0 0x7fcfc409acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfcc71d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcfc4134c90 0x7fcfc409b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f3a1635d640 1 -- 172.21.15.97:0/1827145611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a1012fbb0 msgr2=0x7f3a1009b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f3a1635d640 1 --2- 172.21.15.97:0/1827145611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a1012fbb0 0x7f3a1009b2a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a04009940 tx=0x7f3a040091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfcc71d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc411a9b0 con 0x7fcfc41300a0 2024-09-13T18:39:20.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f3a1635d640 1 -- 172.21.15.97:0/1827145611 shutdown_connections 2024-09-13T18:39:20.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f3a1635d640 1 --2- 172.21.15.97:0/1827145611 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a1012fbb0 0x7f3a1009b2a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f3a1635d640 1 --2- 172.21.15.97:0/1827145611 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a100a13b0 0x7f3a1012f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f3a1635d640 1 -- 172.21.15.97:0/1827145611 >> 172.21.15.97:0/1827145611 conn(0x7f3a10067be0 msgr2=0x7f3a100a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:20.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f0cf6b9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0cf0068880 0x7f0cf0123c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f0cf6b9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0cf00986c0 0x7f0cf0127060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfcc71d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc409bbe0 con 0x7fcfc40a32b0 2024-09-13T18:39:20.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfcc71d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40a0230 con 0x7fcfc4134c90 2024-09-13T18:39:20.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f0cf6b9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0cf012af00 0x7f0cf01275a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfca4b9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfc40a32b0 0x7fcfc409a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfc9cb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfc41300a0 0x7fcfc409acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfca4b9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfc40a32b0 0x7fcfc409a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35916/0 (socket says 172.21.15.97:35916) 2024-09-13T18:39:20.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfca4b9640 1 -- 172.21.15.97:0/3030269770 learned_addr learned my addr 172.21.15.97:0/3030269770 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:20.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfcacba640 1 --2- 172.21.15.97:0/3030269770 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcfc4134c90 0x7fcfc409b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f0cf6b9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf0124960 con 0x7f0cf00986c0 2024-09-13T18:39:20.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f3a1635d640 1 -- 172.21.15.97:0/1827145611 shutdown_connections 2024-09-13T18:39:20.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f0cf6b9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf00975e0 con 0x7f0cf012af00 2024-09-13T18:39:20.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f0cf6b9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf0125ee0 con 0x7f0cf0068880 2024-09-13T18:39:20.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f0cf4939640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0cf0068880 0x7f0cf0123c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f0cf4939640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0cf0068880 0x7f0cf0123c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48166/0 (socket says 172.21.15.97:48166) 2024-09-13T18:39:20.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7f0cf4939640 1 -- 172.21.15.97:0/2482623363 learned_addr learned my addr 172.21.15.97:0/2482623363 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:20.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7f0cf513a640 1 --2- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0cf012af00 0x7f0cf01275a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7f0ceffff640 1 --2- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0cf00986c0 0x7f0cf0127060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfc9cb8640 1 -- 172.21.15.97:0/3030269770 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcfc4134c90 msgr2=0x7fcfc409b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfc9cb8640 1 --2- 172.21.15.97:0/3030269770 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcfc4134c90 0x7fcfc409b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfc9cb8640 1 -- 172.21.15.97:0/3030269770 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfc40a32b0 msgr2=0x7fcfc409a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.279+0000 7fcfc9cb8640 1 --2- 172.21.15.97:0/3030269770 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfc40a32b0 0x7fcfc409a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7fcfc9cb8640 1 -- 172.21.15.97:0/3030269770 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4009390 con 0x7fcfc41300a0 2024-09-13T18:39:20.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7fcfca4b9640 1 --2- 172.21.15.97:0/3030269770 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfc40a32b0 0x7fcfc409a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:20.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7f3a1635d640 1 -- 172.21.15.97:0/1827145611 wait complete. 2024-09-13T18:39:20.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7fcfc9cb8640 1 --2- 172.21.15.97:0/3030269770 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfc41300a0 0x7fcfc409acb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4031000 tx=0x7fcfb4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:20.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7f0ceffff640 1 -- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0cf0068880 msgr2=0x7f0cf0123c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7f0ceffff640 1 --2- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0cf0068880 0x7f0cf0123c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7f0ceffff640 1 -- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0cf012af00 msgr2=0x7f0cf01275a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7f0ceffff640 1 --2- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0cf012af00 0x7f0cf01275a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7f0ceffff640 1 -- 172.21.15.97:0/2482623363 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce8009a20 con 0x7f0cf00986c0 2024-09-13T18:39:20.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7f0cf513a640 1 --2- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0cf012af00 0x7f0cf01275a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:20.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7fcfba7fc640 1 -- 172.21.15.97:0/3030269770 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4032e20 con 0x7fcfc41300a0 2024-09-13T18:39:20.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7fcfba7fc640 1 -- 172.21.15.97:0/3030269770 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb4031850 con 0x7fcfc41300a0 2024-09-13T18:39:20.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7fcfba7fc640 1 -- 172.21.15.97:0/3030269770 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4031c10 con 0x7fcfc41300a0 2024-09-13T18:39:20.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3030269770 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc409e710 con 0x7fcfc41300a0 2024-09-13T18:39:20.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.280+0000 7f0ceffff640 1 --2- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0cf00986c0 0x7f0cf0127060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0068780 tx=0x7f0cdc007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:20.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.281+0000 7f0cf4939640 1 --2- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0cf0068880 0x7f0cf0123c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:20.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.281+0000 7f0cecff9640 1 -- 172.21.15.97:0/2482623363 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc005aa0 con 0x7f0cf00986c0 2024-09-13T18:39:20.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.281+0000 7f0cecff9640 1 -- 172.21.15.97:0/2482623363 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc005c00 con 0x7f0cf00986c0 2024-09-13T18:39:20.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.281+0000 7f0cecff9640 1 -- 172.21.15.97:0/2482623363 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0070d0 con 0x7f0cf00986c0 2024-09-13T18:39:20.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.281+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/2482623363 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf0124d60 con 0x7f0cf00986c0 2024-09-13T18:39:20.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.281+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/2482623363 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf01261a0 con 0x7f0cf00986c0 2024-09-13T18:39:20.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.281+0000 7f3a1635d640 1 Processor -- start 2024-09-13T18:39:20.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.281+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3030269770 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc409c2b0 con 0x7fcfc41300a0 2024-09-13T18:39:20.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7f3a1635d640 1 -- start start 2024-09-13T18:39:20.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7fcfba7fc640 1 -- 172.21.15.97:0/3030269770 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fcfb4039040 con 0x7fcfc41300a0 2024-09-13T18:39:20.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7f0cecff9640 1 -- 172.21.15.97:0/2482623363 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f0cdc007500 con 0x7f0cf00986c0 2024-09-13T18:39:20.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/2482623363 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf0064000 con 0x7f0cf00986c0 2024-09-13T18:39:20.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7fcfba7fc640 1 -- 172.21.15.97:0/3030269770 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7fcfb4041030 con 0x7fcfc41300a0 2024-09-13T18:39:20.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7f0cecff9640 1 -- 172.21.15.97:0/2482623363 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f0cdc0414e0 con 0x7f0cf00986c0 2024-09-13T18:39:20.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.283+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3030269770 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc411a5c0 con 0x7fcfc41300a0 2024-09-13T18:39:20.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7f3a1635d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a100a13b0 0x7f3a1013ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7f3a1635d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a1012fbb0 0x7f3a1013efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7f3a1635d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a1012ff80 0x7f3a1013f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7f3a1635d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1011c740 con 0x7f3a1012fbb0 2024-09-13T18:39:20.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7f3a1635d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1011de30 con 0x7f3a1012ff80 2024-09-13T18:39:20.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7f3a1635d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1012f0d0 con 0x7f3a100a13b0 2024-09-13T18:39:20.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7f3a0f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a1012fbb0 0x7f3a1013efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7f3a0f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a1012fbb0 0x7f3a1013efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37730/0 (socket says 172.21.15.97:37730) 2024-09-13T18:39:20.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.282+0000 7f3a0f7fe640 1 -- 172.21.15.97:0/3062092104 learned_addr learned my addr 172.21.15.97:0/3062092104 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:20.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.283+0000 7f3a148fa640 1 --2- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a1012ff80 0x7f3a1013f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.283+0000 7f3a0ffff640 1 --2- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a100a13b0 0x7f3a1013ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.283+0000 7f3a0f7fe640 1 -- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a100a13b0 msgr2=0x7f3a1013ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.283+0000 7f3a0f7fe640 1 --2- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a100a13b0 0x7f3a1013ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.283+0000 7f3a0f7fe640 1 -- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a1012ff80 msgr2=0x7f3a1013f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.283+0000 7f3a0f7fe640 1 --2- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a1012ff80 0x7f3a1013f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.283+0000 7f3a0f7fe640 1 -- 172.21.15.97:0/3062092104 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a04009450 con 0x7f3a1012fbb0 2024-09-13T18:39:20.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.283+0000 7f3a148fa640 1 --2- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a1012ff80 0x7f3a1013f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:20.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.283+0000 7f3a0ffff640 1 --2- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a100a13b0 0x7f3a1013ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:20.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.284+0000 7f3a0f7fe640 1 --2- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a1012fbb0 0x7f3a1013efb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3a0402a670 tx=0x7f3a04032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:20.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.287+0000 7f0cecff9640 1 -- 172.21.15.97:0/2482623363 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f0cdc017020 con 0x7f0cf00986c0 2024-09-13T18:39:20.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.291+0000 7f39f7fff640 1 -- 172.21.15.97:0/3062092104 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04031630 con 0x7f3a1012fbb0 2024-09-13T18:39:20.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.291+0000 7f39f7fff640 1 -- 172.21.15.97:0/3062092104 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a04031790 con 0x7f3a1012fbb0 2024-09-13T18:39:20.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.291+0000 7f3a1635d640 1 -- 172.21.15.97:0/3062092104 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1011c980 con 0x7f3a1012fbb0 2024-09-13T18:39:20.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.291+0000 7f39f7fff640 1 -- 172.21.15.97:0/3062092104 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04031b30 con 0x7f3a1012fbb0 2024-09-13T18:39:20.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.292+0000 7f3a1635d640 1 -- 172.21.15.97:0/3062092104 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1011e860 con 0x7f3a1012fbb0 2024-09-13T18:39:20.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.291+0000 7fcfba7fc640 1 -- 172.21.15.97:0/3030269770 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fcfb4067060 con 0x7fcfc41300a0 2024-09-13T18:39:20.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.293+0000 7f39f7fff640 1 -- 172.21.15.97:0/3062092104 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f3a04039040 con 0x7f3a1012fbb0 2024-09-13T18:39:20.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.293+0000 7f39f7fff640 1 -- 172.21.15.97:0/3062092104 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f3a04062390 con 0x7f3a1012fbb0 2024-09-13T18:39:20.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.293+0000 7f3a1635d640 1 -- 172.21.15.97:0/3062092104 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a10064600 con 0x7f3a1012fbb0 2024-09-13T18:39:20.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.297+0000 7f39f7fff640 1 -- 172.21.15.97:0/3062092104 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f3a04049080 con 0x7f3a1012fbb0 2024-09-13T18:39:20.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.416+0000 7fd80479d640 1 -- 172.21.15.97:0/2277292643 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd7fc064000 con 0x7fd7fc12fad0 2024-09-13T18:39:20.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.416+0000 7fd7f27fc640 1 -- 172.21.15.97:0/2277292643 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd7f40112c0 con 0x7fd7fc12fad0 2024-09-13T18:39:20.420 INFO:teuthology.orchestra.run.smithi097.stdout:38654705670 2024-09-13T18:39:20.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.418+0000 7fd80479d640 1 -- 172.21.15.97:0/2277292643 >> v1:172.21.15.97:6816/34603 conn(0x7fd7e0031160 legacy=0x7fd7e0033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.418+0000 7fd80479d640 1 -- 172.21.15.97:0/2277292643 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7fc12fad0 msgr2=0x7fd7fc13e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.418+0000 7fd80479d640 1 --2- 172.21.15.97:0/2277292643 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7fc12fad0 0x7fd7fc13e960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4009f20 tx=0x7fd7f400b040 comp rx=0 tx=0).stop 2024-09-13T18:39:20.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.418+0000 7fd80479d640 1 -- 172.21.15.97:0/2277292643 shutdown_connections 2024-09-13T18:39:20.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.418+0000 7fd80479d640 1 --2- 172.21.15.97:0/2277292643 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7fc12fad0 0x7fd7fc13e960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.418+0000 7fd80479d640 1 --2- 172.21.15.97:0/2277292643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7fc0a1320 0x7fd7fc1191b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.418+0000 7fd80479d640 1 --2- 172.21.15.97:0/2277292643 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7fc09e740 0x7fd7fc118c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.418+0000 7fd80479d640 1 -- 172.21.15.97:0/2277292643 >> 172.21.15.97:0/2277292643 conn(0x7fd7fc0a0840 msgr2=0x7fd7fc132520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:20.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.418+0000 7fd80479d640 1 -- 172.21.15.97:0/2277292643 shutdown_connections 2024-09-13T18:39:20.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.418+0000 7fd80479d640 1 -- 172.21.15.97:0/2277292643 wait complete. 2024-09-13T18:39:20.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-09-13T18:39:20.433 DEBUG:teuthology.parallel:result is None 2024-09-13T18:39:20.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.449+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/2482623363 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0cf0067670 con 0x7f0cf00986c0 2024-09-13T18:39:20.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.449+0000 7f0cecff9640 1 -- 172.21.15.97:0/2482623363 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0cdc00e4c0 con 0x7f0cf00986c0 2024-09-13T18:39:20.453 INFO:teuthology.orchestra.run.smithi097.stdout:38654705669 2024-09-13T18:39:20.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.451+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/2482623363 >> v1:172.21.15.97:6816/34603 conn(0x7f0cd4031160 legacy=0x7f0cd4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.451+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0cf00986c0 msgr2=0x7f0cf0127060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.451+0000 7f0cf6b9d640 1 --2- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0cf00986c0 0x7f0cf0127060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0068780 tx=0x7f0cdc007cc0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.451+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/2482623363 shutdown_connections 2024-09-13T18:39:20.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.451+0000 7f0cf6b9d640 1 --2- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0cf012af00 0x7f0cf01275a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.451+0000 7f0cf6b9d640 1 --2- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0cf00986c0 0x7f0cf0127060 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.451+0000 7f0cf6b9d640 1 --2- 172.21.15.97:0/2482623363 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0cf0068880 0x7f0cf0123c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.451+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/2482623363 >> 172.21.15.97:0/2482623363 conn(0x7f0cf009b200 msgr2=0x7f0cf0099a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:20.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.451+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/2482623363 shutdown_connections 2024-09-13T18:39:20.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.451+0000 7f0cf6b9d640 1 -- 172.21.15.97:0/2482623363 wait complete. 2024-09-13T18:39:20.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-09-13T18:39:20.465 DEBUG:teuthology.parallel:result is None 2024-09-13T18:39:20.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.474+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3030269770 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcfc411af70 con 0x7fcfc41300a0 2024-09-13T18:39:20.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.475+0000 7fcfba7fc640 1 -- 172.21.15.97:0/3030269770 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfb4039520 con 0x7fcfc41300a0 2024-09-13T18:39:20.478 INFO:teuthology.orchestra.run.smithi097.stdout:38654705670 2024-09-13T18:39:20.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.476+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3030269770 >> v1:172.21.15.97:6816/34603 conn(0x7fcfa80311b0 legacy=0x7fcfa8033660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.477+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3030269770 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfc41300a0 msgr2=0x7fcfc409acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.477+0000 7fcfcc71d640 1 --2- 172.21.15.97:0/3030269770 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfc41300a0 0x7fcfc409acb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4031000 tx=0x7fcfb4032000 comp rx=0 tx=0).stop 2024-09-13T18:39:20.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.477+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3030269770 shutdown_connections 2024-09-13T18:39:20.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.477+0000 7fcfcc71d640 1 --2- 172.21.15.97:0/3030269770 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcfc4134c90 0x7fcfc409b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.477+0000 7fcfcc71d640 1 --2- 172.21.15.97:0/3030269770 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfc41300a0 0x7fcfc409acb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.477+0000 7fcfcc71d640 1 --2- 172.21.15.97:0/3030269770 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcfc40a32b0 0x7fcfc409a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.477+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3030269770 >> 172.21.15.97:0/3030269770 conn(0x7fcfc406eef0 msgr2=0x7fcfc40a2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:20.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.477+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3030269770 shutdown_connections 2024-09-13T18:39:20.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.477+0000 7fcfcc71d640 1 -- 172.21.15.97:0/3030269770 wait complete. 2024-09-13T18:39:20.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.480+0000 7f3a1635d640 1 -- 172.21.15.97:0/3062092104 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a1005e0b0 con 0x7f3a1012fbb0 2024-09-13T18:39:20.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.480+0000 7f39f7fff640 1 -- 172.21.15.97:0/3062092104 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a0403f030 con 0x7f3a1012fbb0 2024-09-13T18:39:20.484 INFO:teuthology.orchestra.run.smithi097.stdout:38654705671 2024-09-13T18:39:20.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.482+0000 7f3a1635d640 1 -- 172.21.15.97:0/3062092104 >> v1:172.21.15.97:6816/34603 conn(0x7f39fc031160 legacy=0x7f39fc033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.482+0000 7f3a1635d640 1 -- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a1012fbb0 msgr2=0x7f3a1013efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.482+0000 7f3a1635d640 1 --2- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a1012fbb0 0x7f3a1013efb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3a0402a670 tx=0x7f3a04032000 comp rx=0 tx=0).stop 2024-09-13T18:39:20.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.482+0000 7f3a1635d640 1 -- 172.21.15.97:0/3062092104 shutdown_connections 2024-09-13T18:39:20.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.482+0000 7f3a1635d640 1 --2- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a1012ff80 0x7f3a1013f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.482+0000 7f3a1635d640 1 --2- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a1012fbb0 0x7f3a1013efb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.482+0000 7f3a1635d640 1 --2- 172.21.15.97:0/3062092104 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a100a13b0 0x7f3a1013ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.482+0000 7f3a1635d640 1 -- 172.21.15.97:0/3062092104 >> 172.21.15.97:0/3062092104 conn(0x7f3a10067be0 msgr2=0x7f3a10130480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:20.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.482+0000 7f3a1635d640 1 -- 172.21.15.97:0/3062092104 shutdown_connections 2024-09-13T18:39:20.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.482+0000 7f3a1635d640 1 -- 172.21.15.97:0/3062092104 wait complete. 2024-09-13T18:39:20.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2024-09-13T18:39:20.491 DEBUG:teuthology.parallel:result is None 2024-09-13T18:39:20.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-09-13T18:39:20.497 DEBUG:teuthology.parallel:result is None 2024-09-13T18:39:20.497 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:39:20.497 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:39:20.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.628+0000 7f437689f640 1 Processor -- start 2024-09-13T18:39:20.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.628+0000 7f437689f640 1 -- start start 2024-09-13T18:39:20.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f437689f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4370069b00 0x7f437009edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f437689f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f437009f330 0x7f437009f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f437689f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f437012f4a0 0x7f437012f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f437689f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4370069ed0 con 0x7f437009f330 2024-09-13T18:39:20.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f437689f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4370069650 con 0x7f4370069b00 2024-09-13T18:39:20.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f437689f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f437009ff80 con 0x7f437012f4a0 2024-09-13T18:39:20.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f4374e3c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f437012f4a0 0x7f437012f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f436f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f437009f330 0x7f437009f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f4374e3c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f437012f4a0 0x7f437012f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48170/0 (socket says 172.21.15.97:48170) 2024-09-13T18:39:20.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f436ffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4370069b00 0x7f437009edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f4374e3c640 1 -- 172.21.15.97:0/4087271205 learned_addr learned my addr 172.21.15.97:0/4087271205 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:20.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f436ffff640 1 -- 172.21.15.97:0/4087271205 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f437012f4a0 msgr2=0x7f437012f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:20.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f436ffff640 1 --2- 172.21.15.97:0/4087271205 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f437012f4a0 0x7f437012f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f436ffff640 1 -- 172.21.15.97:0/4087271205 >> v2:172.21.15.97:3300/0 conn(0x7f437009f330 msgr2=0x7f437009f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:20.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f436ffff640 1 --2- 172.21.15.97:0/4087271205 >> v2:172.21.15.97:3300/0 conn(0x7f437009f330 0x7f437009f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f436ffff640 1 -- 172.21.15.97:0/4087271205 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437006f090 con 0x7f4370069b00 2024-09-13T18:39:20.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.629+0000 7f436f7fe640 1 --2- 172.21.15.97:0/4087271205 >> v2:172.21.15.97:3300/0 conn(0x7f437009f330 0x7f437009f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:20.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.630+0000 7f436ffff640 1 --2- 172.21.15.97:0/4087271205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4370069b00 0x7f437009edf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4360009880 tx=0x7f43600090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44f068be73190fe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:20.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.630+0000 7f436effd640 1 -- 172.21.15.97:0/4087271205 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436002ac40 con 0x7f4370069b00 2024-09-13T18:39:20.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.630+0000 7f436effd640 1 -- 172.21.15.97:0/4087271205 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436002ada0 con 0x7f4370069b00 2024-09-13T18:39:20.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.630+0000 7f436effd640 1 -- 172.21.15.97:0/4087271205 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360032670 con 0x7f4370069b00 2024-09-13T18:39:20.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.630+0000 7f437689f640 1 -- 172.21.15.97:0/4087271205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4370069b00 msgr2=0x7f437009edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.630+0000 7f437689f640 1 --2- 172.21.15.97:0/4087271205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4370069b00 0x7f437009edf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4360009880 tx=0x7f43600090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.630+0000 7f437689f640 1 -- 172.21.15.97:0/4087271205 shutdown_connections 2024-09-13T18:39:20.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.630+0000 7f437689f640 1 --2- 172.21.15.97:0/4087271205 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f437012f4a0 0x7f437012f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.630+0000 7f437689f640 1 --2- 172.21.15.97:0/4087271205 >> v2:172.21.15.97:3300/0 conn(0x7f437009f330 0x7f437009f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.630+0000 7f437689f640 1 --2- 172.21.15.97:0/4087271205 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4370069b00 0x7f437009edf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.631+0000 7f437689f640 1 -- 172.21.15.97:0/4087271205 >> 172.21.15.97:0/4087271205 conn(0x7f4370067bb0 msgr2=0x7f43700a0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:20.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.631+0000 7f437689f640 1 -- 172.21.15.97:0/4087271205 shutdown_connections 2024-09-13T18:39:20.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.631+0000 7f437689f640 1 -- 172.21.15.97:0/4087271205 wait complete. 2024-09-13T18:39:20.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.631+0000 7f437689f640 1 Processor -- start 2024-09-13T18:39:20.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.631+0000 7f437689f640 1 -- start start 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f437689f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4370069b00 0x7f437011bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f437689f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f437009f330 0x7f437011c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f437689f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f437012f4a0 0x7f437011c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f437689f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437011db80 con 0x7f437009f330 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f437689f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437011e5c0 con 0x7f4370069b00 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f437689f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f437011d640 con 0x7f437012f4a0 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f436ffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4370069b00 0x7f437011bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f436ffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4370069b00 0x7f437011bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35958/0 (socket says 172.21.15.97:35958) 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f436ffff640 1 -- 172.21.15.97:0/386590175 learned_addr learned my addr 172.21.15.97:0/386590175 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f436f7fe640 1 --2- 172.21.15.97:0/386590175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f437009f330 0x7f437011c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f4374e3c640 1 --2- 172.21.15.97:0/386590175 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f437012f4a0 0x7f437011c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f436ffff640 1 -- 172.21.15.97:0/386590175 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f437012f4a0 msgr2=0x7f437011c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f436ffff640 1 --2- 172.21.15.97:0/386590175 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f437012f4a0 0x7f437011c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f436ffff640 1 -- 172.21.15.97:0/386590175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f437009f330 msgr2=0x7f437011c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f436ffff640 1 --2- 172.21.15.97:0/386590175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f437009f330 0x7f437011c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f436ffff640 1 -- 172.21.15.97:0/386590175 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4364009390 con 0x7f4370069b00 2024-09-13T18:39:20.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f436f7fe640 1 --2- 172.21.15.97:0/386590175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f437009f330 0x7f437011c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:20.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.632+0000 7f436ffff640 1 --2- 172.21.15.97:0/386590175 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4370069b00 0x7f437011bc50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4360009360 tx=0x7f4360032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:20.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.633+0000 7f4357fff640 1 -- 172.21.15.97:0/386590175 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436003d720 con 0x7f4370069b00 2024-09-13T18:39:20.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.633+0000 7f4357fff640 1 -- 172.21.15.97:0/386590175 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436003d880 con 0x7f4370069b00 2024-09-13T18:39:20.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.633+0000 7f437689f640 1 -- 172.21.15.97:0/386590175 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4360009390 con 0x7f4370069b00 2024-09-13T18:39:20.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.633+0000 7f4357fff640 1 -- 172.21.15.97:0/386590175 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436003dc40 con 0x7f4370069b00 2024-09-13T18:39:20.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.633+0000 7f437689f640 1 -- 172.21.15.97:0/386590175 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437011ddc0 con 0x7f4370069b00 2024-09-13T18:39:20.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.633+0000 7f4357fff640 1 -- 172.21.15.97:0/386590175 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f4360039040 con 0x7f4370069b00 2024-09-13T18:39:20.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.634+0000 7f4357fff640 1 -- 172.21.15.97:0/386590175 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f4360061cb0 con 0x7f4370069b00 2024-09-13T18:39:20.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.634+0000 7f437689f640 1 -- 172.21.15.97:0/386590175 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f437011f1d0 con 0x7f4370069b00 2024-09-13T18:39:20.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.638+0000 7f4357fff640 1 -- 172.21.15.97:0/386590175 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f4360037080 con 0x7f4370069b00 2024-09-13T18:39:20.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.785+0000 7f437689f640 1 -- 172.21.15.97:0/386590175 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4370064000 con 0x7f435c031160 2024-09-13T18:39:20.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.791+0000 7f4357fff640 1 -- 172.21.15.97:0/386590175 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271449 (unknown 2965378022 0 4122702339) 0x7f4370064000 con 0x7f435c031160 2024-09-13T18:39:20.798 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:20.799 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:39:20.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.795+0000 7f437689f640 1 -- 172.21.15.97:0/386590175 >> v1:172.21.15.97:6816/34603 conn(0x7f435c031160 legacy=0x7f435c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.795+0000 7f437689f640 1 -- 172.21.15.97:0/386590175 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4370069b00 msgr2=0x7f437011bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.795+0000 7f437689f640 1 --2- 172.21.15.97:0/386590175 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4370069b00 0x7f437011bc50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4360009360 tx=0x7f4360032000 comp rx=0 tx=0).stop 2024-09-13T18:39:20.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.795+0000 7f437689f640 1 -- 172.21.15.97:0/386590175 shutdown_connections 2024-09-13T18:39:20.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.795+0000 7f437689f640 1 --2- 172.21.15.97:0/386590175 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f437012f4a0 0x7f437011c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.795+0000 7f437689f640 1 --2- 172.21.15.97:0/386590175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f437009f330 0x7f437011c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.795+0000 7f437689f640 1 --2- 172.21.15.97:0/386590175 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4370069b00 0x7f437011bc50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.795+0000 7f437689f640 1 -- 172.21.15.97:0/386590175 >> 172.21.15.97:0/386590175 conn(0x7f4370067bb0 msgr2=0x7f437006e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:20.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.795+0000 7f437689f640 1 -- 172.21.15.97:0/386590175 shutdown_connections 2024-09-13T18:39:20.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.795+0000 7f437689f640 1 -- 172.21.15.97:0/386590175 wait complete. 2024-09-13T18:39:20.808 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-13T18:39:19.349750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592725,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":125,"num_write_kb":1121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1191360,"kb_used_data":1904,"kb_used_omap":6,"kb_used_meta":1189369,"kb_avail":376296000,"statfs":{"total":386547056640,"available":385327104000,"internally_reserved":0,"allocated":1949696,"data_stored":1408590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1217914208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001095"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600365+0000","last_change":"2024-09-13T18:39:14.592723+0000","last_active":"2024-09-13T18:39:14.600365+0000","last_peered":"2024-09-13T18:39:14.600365+0000","last_clean":"2024-09-13T18:39:14.600365+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:39:14.600365+0000","last_undegraded":"2024-09-13T18:39:14.600365+0000","last_fullsized":"2024-09-13T18:39:14.600365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:09.304808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.587573+0000","last_change":"2024-09-13T18:39:14.581266+0000","last_active":"2024-09-13T18:39:14.587573+0000","last_peered":"2024-09-13T18:39:14.587573+0000","last_clean":"2024-09-13T18:39:14.587573+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:39:14.587573+0000","last_undegraded":"2024-09-13T18:39:14.587573+0000","last_fullsized":"2024-09-13T18:39:14.587573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594566+0000","last_change":"2024-09-13T18:39:14.586254+0000","last_active":"2024-09-13T18:39:14.594566+0000","last_peered":"2024-09-13T18:39:14.594566+0000","last_clean":"2024-09-13T18:39:14.594566+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:39:14.594566+0000","last_undegraded":"2024-09-13T18:39:14.594566+0000","last_fullsized":"2024-09-13T18:39:14.594566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594551+0000","last_change":"2024-09-13T18:39:14.583960+0000","last_active":"2024-09-13T18:39:14.594551+0000","last_peered":"2024-09-13T18:39:14.594551+0000","last_clean":"2024-09-13T18:39:14.594551+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:39:14.594551+0000","last_undegraded":"2024-09-13T18:39:14.594551+0000","last_fullsized":"2024-09-13T18:39:14.594551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.589815+0000","last_change":"2024-09-13T18:39:14.577865+0000","last_active":"2024-09-13T18:39:14.589815+0000","last_peered":"2024-09-13T18:39:14.589815+0000","last_clean":"2024-09-13T18:39:14.589815+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:39:14.589815+0000","last_undegraded":"2024-09-13T18:39:14.589815+0000","last_fullsized":"2024-09-13T18:39:14.589815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595808+0000","last_change":"2024-09-13T18:39:14.590785+0000","last_active":"2024-09-13T18:39:14.595808+0000","last_peered":"2024-09-13T18:39:14.595808+0000","last_clean":"2024-09-13T18:39:14.595808+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:39:14.595808+0000","last_undegraded":"2024-09-13T18:39:14.595808+0000","last_fullsized":"2024-09-13T18:39:14.595808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:24.453184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596969+0000","last_change":"2024-09-13T18:39:14.590893+0000","last_active":"2024-09-13T18:39:14.596969+0000","last_peered":"2024-09-13T18:39:14.596969+0000","last_clean":"2024-09-13T18:39:14.596969+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:39:14.596969+0000","last_undegraded":"2024-09-13T18:39:14.596969+0000","last_fullsized":"2024-09-13T18:39:14.596969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:57.986187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601078+0000","last_change":"2024-09-13T18:39:14.595160+0000","last_active":"2024-09-13T18:39:14.601078+0000","last_peered":"2024-09-13T18:39:14.601078+0000","last_clean":"2024-09-13T18:39:14.601078+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:39:14.601078+0000","last_undegraded":"2024-09-13T18:39:14.601078+0000","last_fullsized":"2024-09-13T18:39:14.601078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595272+0000","last_change":"2024-09-13T18:39:14.586790+0000","last_active":"2024-09-13T18:39:14.595272+0000","last_peered":"2024-09-13T18:39:14.595272+0000","last_clean":"2024-09-13T18:39:14.595272+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:39:14.595272+0000","last_undegraded":"2024-09-13T18:39:14.595272+0000","last_fullsized":"2024-09-13T18:39:14.595272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:49.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601065+0000","last_change":"2024-09-13T18:39:14.591231+0000","last_active":"2024-09-13T18:39:14.601065+0000","last_peered":"2024-09-13T18:39:14.601065+0000","last_clean":"2024-09-13T18:39:14.601065+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:39:14.601065+0000","last_undegraded":"2024-09-13T18:39:14.601065+0000","last_fullsized":"2024-09-13T18:39:14.601065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600581+0000","last_change":"2024-09-13T18:39:14.589017+0000","last_active":"2024-09-13T18:39:14.600581+0000","last_peered":"2024-09-13T18:39:14.600581+0000","last_clean":"2024-09-13T18:39:14.600581+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:39:14.600581+0000","last_undegraded":"2024-09-13T18:39:14.600581+0000","last_fullsized":"2024-09-13T18:39:14.600581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600392+0000","last_change":"2024-09-13T18:39:14.592629+0000","last_active":"2024-09-13T18:39:14.600392+0000","last_peered":"2024-09-13T18:39:14.600392+0000","last_clean":"2024-09-13T18:39:14.600392+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:39:14.600392+0000","last_undegraded":"2024-09-13T18:39:14.600392+0000","last_fullsized":"2024-09-13T18:39:14.600392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602649+0000","last_change":"2024-09-13T18:39:14.597709+0000","last_active":"2024-09-13T18:39:14.602649+0000","last_peered":"2024-09-13T18:39:14.602649+0000","last_clean":"2024-09-13T18:39:14.602649+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:39:14.602649+0000","last_undegraded":"2024-09-13T18:39:14.602649+0000","last_fullsized":"2024-09-13T18:39:14.602649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.367739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.580120+0000","last_change":"2024-09-13T18:39:14.572267+0000","last_active":"2024-09-13T18:39:14.580120+0000","last_peered":"2024-09-13T18:39:14.580120+0000","last_clean":"2024-09-13T18:39:14.580120+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:39:14.580120+0000","last_undegraded":"2024-09-13T18:39:14.580120+0000","last_fullsized":"2024-09-13T18:39:14.580120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595134+0000","last_change":"2024-09-13T18:39:14.583318+0000","last_active":"2024-09-13T18:39:14.595134+0000","last_peered":"2024-09-13T18:39:14.595134+0000","last_clean":"2024-09-13T18:39:14.595134+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:39:14.595134+0000","last_undegraded":"2024-09-13T18:39:14.595134+0000","last_fullsized":"2024-09-13T18:39:14.595134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596097+0000","last_change":"2024-09-13T18:39:14.592378+0000","last_active":"2024-09-13T18:39:14.596097+0000","last_peered":"2024-09-13T18:39:14.596097+0000","last_clean":"2024-09-13T18:39:14.596097+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:39:14.596097+0000","last_undegraded":"2024-09-13T18:39:14.596097+0000","last_fullsized":"2024-09-13T18:39:14.596097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:02.414361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596564+0000","last_change":"2024-09-13T18:39:14.586945+0000","last_active":"2024-09-13T18:39:14.596564+0000","last_peered":"2024-09-13T18:39:14.596564+0000","last_clean":"2024-09-13T18:39:14.596564+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:39:14.596564+0000","last_undegraded":"2024-09-13T18:39:14.596564+0000","last_fullsized":"2024-09-13T18:39:14.596564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:57.889039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596311+0000","last_change":"2024-09-13T18:39:14.587172+0000","last_active":"2024-09-13T18:39:14.596311+0000","last_peered":"2024-09-13T18:39:14.596311+0000","last_clean":"2024-09-13T18:39:14.596311+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:39:14.596311+0000","last_undegraded":"2024-09-13T18:39:14.596311+0000","last_fullsized":"2024-09-13T18:39:14.596311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600634+0000","last_change":"2024-09-13T18:39:14.594291+0000","last_active":"2024-09-13T18:39:14.600634+0000","last_peered":"2024-09-13T18:39:14.600634+0000","last_clean":"2024-09-13T18:39:14.600634+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:39:14.600634+0000","last_undegraded":"2024-09-13T18:39:14.600634+0000","last_fullsized":"2024-09-13T18:39:14.600634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:29.208875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600015+0000","last_change":"2024-09-13T18:39:14.585973+0000","last_active":"2024-09-13T18:39:14.600015+0000","last_peered":"2024-09-13T18:39:14.600015+0000","last_clean":"2024-09-13T18:39:14.600015+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:39:14.600015+0000","last_undegraded":"2024-09-13T18:39:14.600015+0000","last_fullsized":"2024-09-13T18:39:14.600015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:48.875040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601035+0000","last_change":"2024-09-13T18:39:14.595451+0000","last_active":"2024-09-13T18:39:14.601035+0000","last_peered":"2024-09-13T18:39:14.601035+0000","last_clean":"2024-09-13T18:39:14.601035+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:39:14.601035+0000","last_undegraded":"2024-09-13T18:39:14.601035+0000","last_fullsized":"2024-09-13T18:39:14.601035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:45.368802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594643+0000","last_change":"2024-09-13T18:39:14.583590+0000","last_active":"2024-09-13T18:39:14.594643+0000","last_peered":"2024-09-13T18:39:14.594643+0000","last_clean":"2024-09-13T18:39:14.594643+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:39:14.594643+0000","last_undegraded":"2024-09-13T18:39:14.594643+0000","last_fullsized":"2024-09-13T18:39:14.594643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596929+0000","last_change":"2024-09-13T18:39:14.590724+0000","last_active":"2024-09-13T18:39:14.596929+0000","last_peered":"2024-09-13T18:39:14.596929+0000","last_clean":"2024-09-13T18:39:14.596929+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:39:14.596929+0000","last_undegraded":"2024-09-13T18:39:14.596929+0000","last_fullsized":"2024-09-13T18:39:14.596929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:09.353955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.581250+0000","last_change":"2024-09-13T18:39:14.577642+0000","last_active":"2024-09-13T18:39:14.581250+0000","last_peered":"2024-09-13T18:39:14.581250+0000","last_clean":"2024-09-13T18:39:14.581250+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:39:14.581250+0000","last_undegraded":"2024-09-13T18:39:14.581250+0000","last_fullsized":"2024-09-13T18:39:14.581250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601088+0000","last_change":"2024-09-13T18:39:14.592432+0000","last_active":"2024-09-13T18:39:14.601088+0000","last_peered":"2024-09-13T18:39:14.601088+0000","last_clean":"2024-09-13T18:39:14.601088+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:39:14.601088+0000","last_undegraded":"2024-09-13T18:39:14.601088+0000","last_fullsized":"2024-09-13T18:39:14.601088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:43.945214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.577721+0000","last_change":"2024-09-13T18:39:14.571893+0000","last_active":"2024-09-13T18:39:14.577721+0000","last_peered":"2024-09-13T18:39:14.577721+0000","last_clean":"2024-09-13T18:39:14.577721+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:39:14.577721+0000","last_undegraded":"2024-09-13T18:39:14.577721+0000","last_fullsized":"2024-09-13T18:39:14.577721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596328+0000","last_change":"2024-09-13T18:39:14.594222+0000","last_active":"2024-09-13T18:39:14.596328+0000","last_peered":"2024-09-13T18:39:14.596328+0000","last_clean":"2024-09-13T18:39:14.596328+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:39:14.596328+0000","last_undegraded":"2024-09-13T18:39:14.596328+0000","last_fullsized":"2024-09-13T18:39:14.596328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:20.265556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.580499+0000","last_change":"2024-09-13T18:39:14.576203+0000","last_active":"2024-09-13T18:39:14.580499+0000","last_peered":"2024-09-13T18:39:14.580499+0000","last_clean":"2024-09-13T18:39:14.580499+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:39:14.580499+0000","last_undegraded":"2024-09-13T18:39:14.580499+0000","last_fullsized":"2024-09-13T18:39:14.580499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593337+0000","last_change":"2024-09-13T18:39:14.586374+0000","last_active":"2024-09-13T18:39:14.593337+0000","last_peered":"2024-09-13T18:39:14.593337+0000","last_clean":"2024-09-13T18:39:14.593337+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:39:14.593337+0000","last_undegraded":"2024-09-13T18:39:14.593337+0000","last_fullsized":"2024-09-13T18:39:14.593337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:03.191196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.589263+0000","last_change":"2024-09-13T18:39:14.577392+0000","last_active":"2024-09-13T18:39:14.589263+0000","last_peered":"2024-09-13T18:39:14.589263+0000","last_clean":"2024-09-13T18:39:14.589263+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:39:14.589263+0000","last_undegraded":"2024-09-13T18:39:14.589263+0000","last_fullsized":"2024-09-13T18:39:14.589263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:26.709807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.584973+0000","last_change":"2024-09-13T18:39:14.580898+0000","last_active":"2024-09-13T18:39:14.584973+0000","last_peered":"2024-09-13T18:39:14.584973+0000","last_clean":"2024-09-13T18:39:14.584973+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:39:14.584973+0000","last_undegraded":"2024-09-13T18:39:14.584973+0000","last_fullsized":"2024-09-13T18:39:14.584973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:23.630337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.579587+0000","last_change":"2024-09-13T18:39:14.574811+0000","last_active":"2024-09-13T18:39:14.579587+0000","last_peered":"2024-09-13T18:39:14.579587+0000","last_clean":"2024-09-13T18:39:14.579587+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:39:14.579587+0000","last_undegraded":"2024-09-13T18:39:14.579587+0000","last_fullsized":"2024-09-13T18:39:14.579587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.582621+0000","last_change":"2024-09-13T18:39:14.579494+0000","last_active":"2024-09-13T18:39:14.582621+0000","last_peered":"2024-09-13T18:39:14.582621+0000","last_clean":"2024-09-13T18:39:14.582621+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:39:14.582621+0000","last_undegraded":"2024-09-13T18:39:14.582621+0000","last_fullsized":"2024-09-13T18:39:14.582621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:19.432936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.598948+0000","last_change":"2024-09-13T18:39:13.575179+0000","last_active":"2024-09-13T18:39:14.598948+0000","last_peered":"2024-09-13T18:39:14.598948+0000","last_clean":"2024-09-13T18:39:14.598948+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:39:14.598948+0000","last_undegraded":"2024-09-13T18:39:14.598948+0000","last_fullsized":"2024-09-13T18:39:14.598948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:25.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596311+0000","last_change":"2024-09-13T18:39:14.594066+0000","last_active":"2024-09-13T18:39:14.596311+0000","last_peered":"2024-09-13T18:39:14.596311+0000","last_clean":"2024-09-13T18:39:14.596311+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:39:14.596311+0000","last_undegraded":"2024-09-13T18:39:14.596311+0000","last_fullsized":"2024-09-13T18:39:14.596311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:14.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.565149+0000","last_change":"2024-09-13T18:39:13.570778+0000","last_active":"2024-09-13T18:39:14.565149+0000","last_peered":"2024-09-13T18:39:14.565149+0000","last_clean":"2024-09-13T18:39:14.565149+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:39:14.565149+0000","last_undegraded":"2024-09-13T18:39:14.565149+0000","last_fullsized":"2024-09-13T18:39:14.565149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596329+0000","last_change":"2024-09-13T18:39:14.587863+0000","last_active":"2024-09-13T18:39:14.596329+0000","last_peered":"2024-09-13T18:39:14.596329+0000","last_clean":"2024-09-13T18:39:14.596329+0000","last_became_active":"2024-09-13T18:39:14.587626+0000","last_became_peered":"2024-09-13T18:39:14.587626+0000","last_unstale":"2024-09-13T18:39:14.596329+0000","last_undegraded":"2024-09-13T18:39:14.596329+0000","last_fullsized":"2024-09-13T18:39:14.596329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.566954+0000","last_change":"2024-09-13T18:39:13.575436+0000","last_active":"2024-09-13T18:39:14.566954+0000","last_peered":"2024-09-13T18:39:14.566954+0000","last_clean":"2024-09-13T18:39:14.566954+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:39:14.566954+0000","last_undegraded":"2024-09-13T18:39:14.566954+0000","last_fullsized":"2024-09-13T18:39:14.566954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:34.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588763+0000","last_change":"2024-09-13T18:39:14.584791+0000","last_active":"2024-09-13T18:39:14.588763+0000","last_peered":"2024-09-13T18:39:14.588763+0000","last_clean":"2024-09-13T18:39:14.588763+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:39:14.588763+0000","last_undegraded":"2024-09-13T18:39:14.588763+0000","last_fullsized":"2024-09-13T18:39:14.588763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:08.799126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601033+0000","last_change":"2024-09-13T18:39:13.578940+0000","last_active":"2024-09-13T18:39:14.601033+0000","last_peered":"2024-09-13T18:39:14.601033+0000","last_clean":"2024-09-13T18:39:14.601033+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:39:14.601033+0000","last_undegraded":"2024-09-13T18:39:14.601033+0000","last_fullsized":"2024-09-13T18:39:14.601033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:34.109209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.585065+0000","last_change":"2024-09-13T18:39:13.583184+0000","last_active":"2024-09-13T18:39:14.585065+0000","last_peered":"2024-09-13T18:39:14.585065+0000","last_clean":"2024-09-13T18:39:14.585065+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:39:14.585065+0000","last_undegraded":"2024-09-13T18:39:14.585065+0000","last_fullsized":"2024-09-13T18:39:14.585065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588808+0000","last_change":"2024-09-13T18:39:14.582349+0000","last_active":"2024-09-13T18:39:14.588808+0000","last_peered":"2024-09-13T18:39:14.588808+0000","last_clean":"2024-09-13T18:39:14.588808+0000","last_became_active":"2024-09-13T18:39:14.581643+0000","last_became_peered":"2024-09-13T18:39:14.581643+0000","last_unstale":"2024-09-13T18:39:14.588808+0000","last_undegraded":"2024-09-13T18:39:14.588808+0000","last_fullsized":"2024-09-13T18:39:14.588808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:34.221522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588626+0000","last_change":"2024-09-13T18:39:13.571043+0000","last_active":"2024-09-13T18:39:14.588626+0000","last_peered":"2024-09-13T18:39:14.588626+0000","last_clean":"2024-09-13T18:39:14.588626+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:39:14.588626+0000","last_undegraded":"2024-09-13T18:39:14.588626+0000","last_fullsized":"2024-09-13T18:39:14.588626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.757855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.580443+0000","last_change":"2024-09-13T18:39:14.577177+0000","last_active":"2024-09-13T18:39:14.580443+0000","last_peered":"2024-09-13T18:39:14.580443+0000","last_clean":"2024-09-13T18:39:14.580443+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:39:14.580443+0000","last_undegraded":"2024-09-13T18:39:14.580443+0000","last_fullsized":"2024-09-13T18:39:14.580443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601502+0000","last_change":"2024-09-13T18:39:13.581627+0000","last_active":"2024-09-13T18:39:14.601502+0000","last_peered":"2024-09-13T18:39:14.601502+0000","last_clean":"2024-09-13T18:39:14.601502+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:39:14.601502+0000","last_undegraded":"2024-09-13T18:39:14.601502+0000","last_fullsized":"2024-09-13T18:39:14.601502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:48.023626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602556+0000","last_change":"2024-09-13T18:39:14.596602+0000","last_active":"2024-09-13T18:39:14.602556+0000","last_peered":"2024-09-13T18:39:14.602556+0000","last_clean":"2024-09-13T18:39:14.602556+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:39:14.602556+0000","last_undegraded":"2024-09-13T18:39:14.602556+0000","last_fullsized":"2024-09-13T18:39:14.602556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:35.414913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.570529+0000","last_change":"2024-09-13T18:39:13.570169+0000","last_active":"2024-09-13T18:39:14.570529+0000","last_peered":"2024-09-13T18:39:14.570529+0000","last_clean":"2024-09-13T18:39:14.570529+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:39:14.570529+0000","last_undegraded":"2024-09-13T18:39:14.570529+0000","last_fullsized":"2024-09-13T18:39:14.570529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594596+0000","last_change":"2024-09-13T18:39:14.584580+0000","last_active":"2024-09-13T18:39:14.594596+0000","last_peered":"2024-09-13T18:39:14.594596+0000","last_clean":"2024-09-13T18:39:14.594596+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:39:14.594596+0000","last_undegraded":"2024-09-13T18:39:14.594596+0000","last_fullsized":"2024-09-13T18:39:14.594596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.598820+0000","last_change":"2024-09-13T18:39:13.575713+0000","last_active":"2024-09-13T18:39:14.598820+0000","last_peered":"2024-09-13T18:39:14.598820+0000","last_clean":"2024-09-13T18:39:14.598820+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:39:14.598820+0000","last_undegraded":"2024-09-13T18:39:14.598820+0000","last_fullsized":"2024-09-13T18:39:14.598820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:59.985917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.589332+0000","last_change":"2024-09-13T18:39:14.577151+0000","last_active":"2024-09-13T18:39:14.589332+0000","last_peered":"2024-09-13T18:39:14.589332+0000","last_clean":"2024-09-13T18:39:14.589332+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:39:14.589332+0000","last_undegraded":"2024-09-13T18:39:14.589332+0000","last_fullsized":"2024-09-13T18:39:14.589332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.559598+0000","last_change":"2024-09-13T18:39:13.581445+0000","last_active":"2024-09-13T18:39:14.559598+0000","last_peered":"2024-09-13T18:39:14.559598+0000","last_clean":"2024-09-13T18:39:14.559598+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:39:14.559598+0000","last_undegraded":"2024-09-13T18:39:14.559598+0000","last_fullsized":"2024-09-13T18:39:14.559598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:39.003339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593363+0000","last_change":"2024-09-13T18:39:14.584122+0000","last_active":"2024-09-13T18:39:14.593363+0000","last_peered":"2024-09-13T18:39:14.593363+0000","last_clean":"2024-09-13T18:39:14.593363+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:39:14.593363+0000","last_undegraded":"2024-09-13T18:39:14.593363+0000","last_fullsized":"2024-09-13T18:39:14.593363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:30.405734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.563524+0000","last_change":"2024-09-13T18:39:13.575316+0000","last_active":"2024-09-13T18:39:14.563524+0000","last_peered":"2024-09-13T18:39:14.563524+0000","last_clean":"2024-09-13T18:39:14.563524+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:39:14.563524+0000","last_undegraded":"2024-09-13T18:39:14.563524+0000","last_fullsized":"2024-09-13T18:39:14.563524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:06.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600699+0000","last_change":"2024-09-13T18:39:14.593058+0000","last_active":"2024-09-13T18:39:14.600699+0000","last_peered":"2024-09-13T18:39:14.600699+0000","last_clean":"2024-09-13T18:39:14.600699+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:39:14.600699+0000","last_undegraded":"2024-09-13T18:39:14.600699+0000","last_fullsized":"2024-09-13T18:39:14.600699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:24.454698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.560704+0000","last_change":"2024-09-13T18:39:13.581217+0000","last_active":"2024-09-13T18:39:14.560704+0000","last_peered":"2024-09-13T18:39:14.560704+0000","last_clean":"2024-09-13T18:39:14.560704+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:39:14.560704+0000","last_undegraded":"2024-09-13T18:39:14.560704+0000","last_fullsized":"2024-09-13T18:39:14.560704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:27.361025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601513+0000","last_change":"2024-09-13T18:39:14.596597+0000","last_active":"2024-09-13T18:39:14.601513+0000","last_peered":"2024-09-13T18:39:14.601513+0000","last_clean":"2024-09-13T18:39:14.601513+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:39:14.601513+0000","last_undegraded":"2024-09-13T18:39:14.601513+0000","last_fullsized":"2024-09-13T18:39:14.601513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:47.680908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.565720+0000","last_change":"2024-09-13T18:39:03.413753+0000","last_active":"2024-09-13T18:39:14.565720+0000","last_peered":"2024-09-13T18:39:14.565720+0000","last_clean":"2024-09-13T18:39:14.565720+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:39:14.565720+0000","last_undegraded":"2024-09-13T18:39:14.565720+0000","last_fullsized":"2024-09-13T18:39:14.565720+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.425159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:05.703287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954507+0000","last_change":"2024-09-13T18:39:09.531787+0000","last_active":"2024-09-13T18:39:14.954507+0000","last_peered":"2024-09-13T18:39:14.954507+0000","last_clean":"2024-09-13T18:39:14.954507+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:39:14.954507+0000","last_undegraded":"2024-09-13T18:39:14.954507+0000","last_fullsized":"2024-09-13T18:39:14.954507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:21.652872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.560046+0000","last_change":"2024-09-13T18:39:13.575940+0000","last_active":"2024-09-13T18:39:14.560046+0000","last_peered":"2024-09-13T18:39:14.560046+0000","last_clean":"2024-09-13T18:39:14.560046+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:39:14.560046+0000","last_undegraded":"2024-09-13T18:39:14.560046+0000","last_fullsized":"2024-09-13T18:39:14.560046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:23.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593382+0000","last_change":"2024-09-13T18:39:14.584292+0000","last_active":"2024-09-13T18:39:14.593382+0000","last_peered":"2024-09-13T18:39:14.593382+0000","last_clean":"2024-09-13T18:39:14.593382+0000","last_became_active":"2024-09-13T18:39:14.583817+0000","last_became_peered":"2024-09-13T18:39:14.583817+0000","last_unstale":"2024-09-13T18:39:14.593382+0000","last_undegraded":"2024-09-13T18:39:14.593382+0000","last_fullsized":"2024-09-13T18:39:14.593382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:19.897995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954284+0000","last_change":"2024-09-13T18:39:09.531377+0000","last_active":"2024-09-13T18:39:14.954284+0000","last_peered":"2024-09-13T18:39:14.954284+0000","last_clean":"2024-09-13T18:39:14.954284+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:39:14.954284+0000","last_undegraded":"2024-09-13T18:39:14.954284+0000","last_fullsized":"2024-09-13T18:39:14.954284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.568234+0000","last_change":"2024-09-13T18:39:13.563570+0000","last_active":"2024-09-13T18:39:14.568234+0000","last_peered":"2024-09-13T18:39:14.568234+0000","last_clean":"2024-09-13T18:39:14.568234+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:39:14.568234+0000","last_undegraded":"2024-09-13T18:39:14.568234+0000","last_fullsized":"2024-09-13T18:39:14.568234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596295+0000","last_change":"2024-09-13T18:39:14.587017+0000","last_active":"2024-09-13T18:39:14.596295+0000","last_peered":"2024-09-13T18:39:14.596295+0000","last_clean":"2024-09-13T18:39:14.596295+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:39:14.596295+0000","last_undegraded":"2024-09-13T18:39:14.596295+0000","last_fullsized":"2024-09-13T18:39:14.596295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.955787+0000","last_change":"2024-09-13T18:39:09.533004+0000","last_active":"2024-09-13T18:39:14.955787+0000","last_peered":"2024-09-13T18:39:14.955787+0000","last_clean":"2024-09-13T18:39:14.955787+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:39:14.955787+0000","last_undegraded":"2024-09-13T18:39:14.955787+0000","last_fullsized":"2024-09-13T18:39:14.955787+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:41.079838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.565570+0000","last_change":"2024-09-13T18:39:13.579066+0000","last_active":"2024-09-13T18:39:14.565570+0000","last_peered":"2024-09-13T18:39:14.565570+0000","last_clean":"2024-09-13T18:39:14.565570+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:39:14.565570+0000","last_undegraded":"2024-09-13T18:39:14.565570+0000","last_fullsized":"2024-09-13T18:39:14.565570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600806+0000","last_change":"2024-09-13T18:39:14.589734+0000","last_active":"2024-09-13T18:39:14.600806+0000","last_peered":"2024-09-13T18:39:14.600806+0000","last_clean":"2024-09-13T18:39:14.600806+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:39:14.600806+0000","last_undegraded":"2024-09-13T18:39:14.600806+0000","last_fullsized":"2024-09-13T18:39:14.600806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954495+0000","last_change":"2024-09-13T18:39:09.532311+0000","last_active":"2024-09-13T18:39:14.954495+0000","last_peered":"2024-09-13T18:39:14.954495+0000","last_clean":"2024-09-13T18:39:14.954495+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:39:14.954495+0000","last_undegraded":"2024-09-13T18:39:14.954495+0000","last_fullsized":"2024-09-13T18:39:14.954495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:53.060128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.571185+0000","last_change":"2024-09-13T18:39:13.571488+0000","last_active":"2024-09-13T18:39:14.571185+0000","last_peered":"2024-09-13T18:39:14.571185+0000","last_clean":"2024-09-13T18:39:14.571185+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:39:14.571185+0000","last_undegraded":"2024-09-13T18:39:14.571185+0000","last_fullsized":"2024-09-13T18:39:14.571185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:44.121699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.581996+0000","last_change":"2024-09-13T18:39:14.579779+0000","last_active":"2024-09-13T18:39:14.581996+0000","last_peered":"2024-09-13T18:39:14.581996+0000","last_clean":"2024-09-13T18:39:14.581996+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:39:14.581996+0000","last_undegraded":"2024-09-13T18:39:14.581996+0000","last_fullsized":"2024-09-13T18:39:14.581996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.558628+0000","last_change":"2024-09-13T18:39:13.577844+0000","last_active":"2024-09-13T18:39:14.558628+0000","last_peered":"2024-09-13T18:39:14.558628+0000","last_clean":"2024-09-13T18:39:14.558628+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:39:14.558628+0000","last_undegraded":"2024-09-13T18:39:14.558628+0000","last_fullsized":"2024-09-13T18:39:14.558628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954762+0000","last_change":"2024-09-13T18:39:09.533091+0000","last_active":"2024-09-13T18:39:14.954762+0000","last_peered":"2024-09-13T18:39:14.954762+0000","last_clean":"2024-09-13T18:39:14.954762+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:39:14.954762+0000","last_undegraded":"2024-09-13T18:39:14.954762+0000","last_fullsized":"2024-09-13T18:39:14.954762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601570+0000","last_change":"2024-09-13T18:39:14.597238+0000","last_active":"2024-09-13T18:39:14.601570+0000","last_peered":"2024-09-13T18:39:14.601570+0000","last_clean":"2024-09-13T18:39:14.601570+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:39:14.601570+0000","last_undegraded":"2024-09-13T18:39:14.601570+0000","last_fullsized":"2024-09-13T18:39:14.601570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.849783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.561344+0000","last_change":"2024-09-13T18:39:13.583071+0000","last_active":"2024-09-13T18:39:14.561344+0000","last_peered":"2024-09-13T18:39:14.561344+0000","last_clean":"2024-09-13T18:39:14.561344+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:39:14.561344+0000","last_undegraded":"2024-09-13T18:39:14.561344+0000","last_fullsized":"2024-09-13T18:39:14.561344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.956131+0000","last_change":"2024-09-13T18:39:09.532042+0000","last_active":"2024-09-13T18:39:14.956131+0000","last_peered":"2024-09-13T18:39:14.956131+0000","last_clean":"2024-09-13T18:39:14.956131+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:39:14.956131+0000","last_undegraded":"2024-09-13T18:39:14.956131+0000","last_fullsized":"2024-09-13T18:39:14.956131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:24.541036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594579+0000","last_change":"2024-09-13T18:39:14.584428+0000","last_active":"2024-09-13T18:39:14.594579+0000","last_peered":"2024-09-13T18:39:14.594579+0000","last_clean":"2024-09-13T18:39:14.594579+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:39:14.594579+0000","last_undegraded":"2024-09-13T18:39:14.594579+0000","last_fullsized":"2024-09-13T18:39:14.594579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601380+0000","last_change":"2024-09-13T18:39:13.583868+0000","last_active":"2024-09-13T18:39:14.601380+0000","last_peered":"2024-09-13T18:39:14.601380+0000","last_clean":"2024-09-13T18:39:14.601380+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:39:14.601380+0000","last_undegraded":"2024-09-13T18:39:14.601380+0000","last_fullsized":"2024-09-13T18:39:14.601380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:52.540883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.956669+0000","last_change":"2024-09-13T18:39:09.532757+0000","last_active":"2024-09-13T18:39:14.956669+0000","last_peered":"2024-09-13T18:39:14.956669+0000","last_clean":"2024-09-13T18:39:14.956669+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:39:14.956669+0000","last_undegraded":"2024-09-13T18:39:14.956669+0000","last_fullsized":"2024-09-13T18:39:14.956669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:32.617744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588824+0000","last_change":"2024-09-13T18:39:14.582490+0000","last_active":"2024-09-13T18:39:14.588824+0000","last_peered":"2024-09-13T18:39:14.588824+0000","last_clean":"2024-09-13T18:39:14.588824+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:39:14.588824+0000","last_undegraded":"2024-09-13T18:39:14.588824+0000","last_fullsized":"2024-09-13T18:39:14.588824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:44.239715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.572182+0000","last_change":"2024-09-13T18:39:13.583929+0000","last_active":"2024-09-13T18:39:14.572182+0000","last_peered":"2024-09-13T18:39:14.572182+0000","last_clean":"2024-09-13T18:39:14.572182+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:39:14.572182+0000","last_undegraded":"2024-09-13T18:39:14.572182+0000","last_fullsized":"2024-09-13T18:39:14.572182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:57.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954641+0000","last_change":"2024-09-13T18:39:09.531717+0000","last_active":"2024-09-13T18:39:14.954641+0000","last_peered":"2024-09-13T18:39:14.954641+0000","last_clean":"2024-09-13T18:39:14.954641+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:39:14.954641+0000","last_undegraded":"2024-09-13T18:39:14.954641+0000","last_fullsized":"2024-09-13T18:39:14.954641+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:33.878130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602684+0000","last_change":"2024-09-13T18:39:14.598033+0000","last_active":"2024-09-13T18:39:14.602684+0000","last_peered":"2024-09-13T18:39:14.602684+0000","last_clean":"2024-09-13T18:39:14.602684+0000","last_became_active":"2024-09-13T18:39:14.597783+0000","last_became_peered":"2024-09-13T18:39:14.597783+0000","last_unstale":"2024-09-13T18:39:14.602684+0000","last_undegraded":"2024-09-13T18:39:14.602684+0000","last_fullsized":"2024-09-13T18:39:14.602684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:32.548971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600676+0000","last_change":"2024-09-13T18:39:14.593754+0000","last_active":"2024-09-13T18:39:14.600676+0000","last_peered":"2024-09-13T18:39:14.600676+0000","last_clean":"2024-09-13T18:39:14.600676+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:39:14.600676+0000","last_undegraded":"2024-09-13T18:39:14.600676+0000","last_fullsized":"2024-09-13T18:39:14.600676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:07.651837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.604681+0000","last_change":"2024-09-13T18:39:13.575507+0000","last_active":"2024-09-13T18:39:14.604681+0000","last_peered":"2024-09-13T18:39:14.604681+0000","last_clean":"2024-09-13T18:39:14.604681+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:39:14.604681+0000","last_undegraded":"2024-09-13T18:39:14.604681+0000","last_fullsized":"2024-09-13T18:39:14.604681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:42.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601588+0000","last_change":"2024-09-13T18:39:14.598160+0000","last_active":"2024-09-13T18:39:14.601588+0000","last_peered":"2024-09-13T18:39:14.601588+0000","last_clean":"2024-09-13T18:39:14.601588+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:39:14.601588+0000","last_undegraded":"2024-09-13T18:39:14.601588+0000","last_fullsized":"2024-09-13T18:39:14.601588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.585676+0000","last_change":"2024-09-13T18:39:13.572017+0000","last_active":"2024-09-13T18:39:14.585676+0000","last_peered":"2024-09-13T18:39:14.585676+0000","last_clean":"2024-09-13T18:39:14.585676+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:39:14.585676+0000","last_undegraded":"2024-09-13T18:39:14.585676+0000","last_fullsized":"2024-09-13T18:39:14.585676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:25.536255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.561009+0000","last_change":"2024-09-13T18:39:13.571792+0000","last_active":"2024-09-13T18:39:14.561009+0000","last_peered":"2024-09-13T18:39:14.561009+0000","last_clean":"2024-09-13T18:39:14.561009+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:39:14.561009+0000","last_undegraded":"2024-09-13T18:39:14.561009+0000","last_fullsized":"2024-09-13T18:39:14.561009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596950+0000","last_change":"2024-09-13T18:39:14.590748+0000","last_active":"2024-09-13T18:39:14.596950+0000","last_peered":"2024-09-13T18:39:14.596950+0000","last_clean":"2024-09-13T18:39:14.596950+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:39:14.596950+0000","last_undegraded":"2024-09-13T18:39:14.596950+0000","last_fullsized":"2024-09-13T18:39:14.596950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:49.557245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.572729+0000","last_change":"2024-09-13T18:39:13.569863+0000","last_active":"2024-09-13T18:39:14.572729+0000","last_peered":"2024-09-13T18:39:14.572729+0000","last_clean":"2024-09-13T18:39:14.572729+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:39:14.572729+0000","last_undegraded":"2024-09-13T18:39:14.572729+0000","last_fullsized":"2024-09-13T18:39:14.572729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588790+0000","last_change":"2024-09-13T18:39:14.582205+0000","last_active":"2024-09-13T18:39:14.588790+0000","last_peered":"2024-09-13T18:39:14.588790+0000","last_clean":"2024-09-13T18:39:14.588790+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:39:14.588790+0000","last_undegraded":"2024-09-13T18:39:14.588790+0000","last_fullsized":"2024-09-13T18:39:14.588790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.186210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588744+0000","last_change":"2024-09-13T18:39:14.584622+0000","last_active":"2024-09-13T18:39:14.588744+0000","last_peered":"2024-09-13T18:39:14.588744+0000","last_clean":"2024-09-13T18:39:14.588744+0000","last_became_active":"2024-09-13T18:39:14.584061+0000","last_became_peered":"2024-09-13T18:39:14.584061+0000","last_unstale":"2024-09-13T18:39:14.588744+0000","last_undegraded":"2024-09-13T18:39:14.588744+0000","last_fullsized":"2024-09-13T18:39:14.588744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:55.751927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.560638+0000","last_change":"2024-09-13T18:39:13.573803+0000","last_active":"2024-09-13T18:39:14.560638+0000","last_peered":"2024-09-13T18:39:14.560638+0000","last_clean":"2024-09-13T18:39:14.560638+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:39:14.560638+0000","last_undegraded":"2024-09-13T18:39:14.560638+0000","last_fullsized":"2024-09-13T18:39:14.560638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:08.298094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596277+0000","last_change":"2024-09-13T18:39:14.586848+0000","last_active":"2024-09-13T18:39:14.596277+0000","last_peered":"2024-09-13T18:39:14.596277+0000","last_clean":"2024-09-13T18:39:14.596277+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:39:14.596277+0000","last_undegraded":"2024-09-13T18:39:14.596277+0000","last_fullsized":"2024-09-13T18:39:14.596277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.564950+0000","last_change":"2024-09-13T18:39:13.586123+0000","last_active":"2024-09-13T18:39:14.564950+0000","last_peered":"2024-09-13T18:39:14.564950+0000","last_clean":"2024-09-13T18:39:14.564950+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:39:14.564950+0000","last_undegraded":"2024-09-13T18:39:14.564950+0000","last_fullsized":"2024-09-13T18:39:14.564950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.582711+0000","last_change":"2024-09-13T18:39:14.579531+0000","last_active":"2024-09-13T18:39:14.582711+0000","last_peered":"2024-09-13T18:39:14.582711+0000","last_clean":"2024-09-13T18:39:14.582711+0000","last_became_active":"2024-09-13T18:39:14.579269+0000","last_became_peered":"2024-09-13T18:39:14.579269+0000","last_unstale":"2024-09-13T18:39:14.582711+0000","last_undegraded":"2024-09-13T18:39:14.582711+0000","last_fullsized":"2024-09-13T18:39:14.582711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:09.638652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595556+0000","last_change":"2024-09-13T18:39:13.575435+0000","last_active":"2024-09-13T18:39:14.595556+0000","last_peered":"2024-09-13T18:39:14.595556+0000","last_clean":"2024-09-13T18:39:14.595556+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:39:14.595556+0000","last_undegraded":"2024-09-13T18:39:14.595556+0000","last_fullsized":"2024-09-13T18:39:14.595556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.585728+0000","last_change":"2024-09-13T18:39:14.580846+0000","last_active":"2024-09-13T18:39:14.585728+0000","last_peered":"2024-09-13T18:39:14.585728+0000","last_clean":"2024-09-13T18:39:14.585728+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:39:14.585728+0000","last_undegraded":"2024-09-13T18:39:14.585728+0000","last_fullsized":"2024-09-13T18:39:14.585728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.010053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588802+0000","last_change":"2024-09-13T18:39:13.571042+0000","last_active":"2024-09-13T18:39:14.588802+0000","last_peered":"2024-09-13T18:39:14.588802+0000","last_clean":"2024-09-13T18:39:14.588802+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:39:14.588802+0000","last_undegraded":"2024-09-13T18:39:14.588802+0000","last_fullsized":"2024-09-13T18:39:14.588802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.288993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600660+0000","last_change":"2024-09-13T18:39:14.593258+0000","last_active":"2024-09-13T18:39:14.600660+0000","last_peered":"2024-09-13T18:39:14.600660+0000","last_clean":"2024-09-13T18:39:14.600660+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:39:14.600660+0000","last_undegraded":"2024-09-13T18:39:14.600660+0000","last_fullsized":"2024-09-13T18:39:14.600660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:21.972039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600247+0000","last_change":"2024-09-13T18:39:13.584903+0000","last_active":"2024-09-13T18:39:14.600247+0000","last_peered":"2024-09-13T18:39:14.600247+0000","last_clean":"2024-09-13T18:39:14.600247+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:39:14.600247+0000","last_undegraded":"2024-09-13T18:39:14.600247+0000","last_fullsized":"2024-09-13T18:39:14.600247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:46.551317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602577+0000","last_change":"2024-09-13T18:39:14.597339+0000","last_active":"2024-09-13T18:39:14.602577+0000","last_peered":"2024-09-13T18:39:14.602577+0000","last_clean":"2024-09-13T18:39:14.602577+0000","last_became_active":"2024-09-13T18:39:14.594896+0000","last_became_peered":"2024-09-13T18:39:14.594896+0000","last_unstale":"2024-09-13T18:39:14.602577+0000","last_undegraded":"2024-09-13T18:39:14.602577+0000","last_fullsized":"2024-09-13T18:39:14.602577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:00.992631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593279+0000","last_change":"2024-09-13T18:39:13.574044+0000","last_active":"2024-09-13T18:39:14.593279+0000","last_peered":"2024-09-13T18:39:14.593279+0000","last_clean":"2024-09-13T18:39:14.593279+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:39:14.593279+0000","last_undegraded":"2024-09-13T18:39:14.593279+0000","last_fullsized":"2024-09-13T18:39:14.593279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:12.168801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596996+0000","last_change":"2024-09-13T18:39:14.591381+0000","last_active":"2024-09-13T18:39:14.596996+0000","last_peered":"2024-09-13T18:39:14.596996+0000","last_clean":"2024-09-13T18:39:14.596996+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:39:14.596996+0000","last_undegraded":"2024-09-13T18:39:14.596996+0000","last_fullsized":"2024-09-13T18:39:14.596996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:17.239023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602768+0000","last_change":"2024-09-13T18:39:13.575357+0000","last_active":"2024-09-13T18:39:14.602768+0000","last_peered":"2024-09-13T18:39:14.602768+0000","last_clean":"2024-09-13T18:39:14.602768+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:39:14.602768+0000","last_undegraded":"2024-09-13T18:39:14.602768+0000","last_fullsized":"2024-09-13T18:39:14.602768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:20.965325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.587405+0000","last_change":"2024-09-13T18:39:14.580750+0000","last_active":"2024-09-13T18:39:14.587405+0000","last_peered":"2024-09-13T18:39:14.587405+0000","last_clean":"2024-09-13T18:39:14.587405+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:39:14.587405+0000","last_undegraded":"2024-09-13T18:39:14.587405+0000","last_fullsized":"2024-09-13T18:39:14.587405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:08.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.584973+0000","last_change":"2024-09-13T18:39:13.583221+0000","last_active":"2024-09-13T18:39:14.584973+0000","last_peered":"2024-09-13T18:39:14.584973+0000","last_clean":"2024-09-13T18:39:14.584973+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:39:14.584973+0000","last_undegraded":"2024-09-13T18:39:14.584973+0000","last_fullsized":"2024-09-13T18:39:14.584973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":200704,"data_stored":57550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":184320,"data_stored":57337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":782336,"data_stored":646834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":782336,"data_stored":646869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:39:20.812 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:39:20.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740ff5d640 1 Processor -- start 2024-09-13T18:39:20.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740ff5d640 1 -- start start 2024-09-13T18:39:20.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740ff5d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7408067110 0x7f740812f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740ff5d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f740812fd70 0x7f740809b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740ff5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7408130190 0x7f740809b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740ff5d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74080674e0 con 0x7f7408067110 2024-09-13T18:39:20.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740ff5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740812f600 con 0x7f7408130190 2024-09-13T18:39:20.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740ff5d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f740809d040 con 0x7f740812fd70 2024-09-13T18:39:20.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740e4fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7408130190 0x7f740809b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740dcf9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7408067110 0x7f740812f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740e4fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7408130190 0x7f740809b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35970/0 (socket says 172.21.15.97:35970) 2024-09-13T18:39:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740dcf9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7408067110 0x7f740812f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37754/0 (socket says 172.21.15.97:37754) 2024-09-13T18:39:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740e4fa640 1 -- 172.21.15.97:0/1421067422 learned_addr learned my addr 172.21.15.97:0/1421067422 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.939+0000 7f740d4f8640 1 --2- 172.21.15.97:0/1421067422 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f740812fd70 0x7f740809b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.940+0000 7f740dcf9640 1 -- 172.21.15.97:0/1421067422 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f740812fd70 msgr2=0x7f740809b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.940+0000 7f740dcf9640 1 --2- 172.21.15.97:0/1421067422 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f740812fd70 0x7f740809b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.940+0000 7f740dcf9640 1 -- 172.21.15.97:0/1421067422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7408130190 msgr2=0x7f740809b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.940+0000 7f740dcf9640 1 --2- 172.21.15.97:0/1421067422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7408130190 0x7f740809b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.940+0000 7f740dcf9640 1 -- 172.21.15.97:0/1421067422 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7408067a50 con 0x7f7408067110 2024-09-13T18:39:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.940+0000 7f740e4fa640 1 --2- 172.21.15.97:0/1421067422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7408130190 0x7f740809b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:20.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.940+0000 7f740d4f8640 1 --2- 172.21.15.97:0/1421067422 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f740812fd70 0x7f740809b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.940+0000 7f740dcf9640 1 --2- 172.21.15.97:0/1421067422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408067110 0x7f740812f830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7400009e60 tx=0x7f7400009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea45251319f932ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.940+0000 7f740ccf7640 1 -- 172.21.15.97:0/1421067422 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400007550 con 0x7f7408067110 2024-09-13T18:39:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.940+0000 7f740ccf7640 1 -- 172.21.15.97:0/1421067422 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740002d050 con 0x7f7408067110 2024-09-13T18:39:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.941+0000 7f740ccf7640 1 -- 172.21.15.97:0/1421067422 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000078e0 con 0x7f7408067110 2024-09-13T18:39:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.941+0000 7f740ff5d640 1 -- 172.21.15.97:0/1421067422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408067110 msgr2=0x7f740812f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.941+0000 7f740ff5d640 1 --2- 172.21.15.97:0/1421067422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408067110 0x7f740812f830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7400009e60 tx=0x7f7400009780 comp rx=0 tx=0).stop 2024-09-13T18:39:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.941+0000 7f740ff5d640 1 -- 172.21.15.97:0/1421067422 shutdown_connections 2024-09-13T18:39:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.941+0000 7f740ff5d640 1 --2- 172.21.15.97:0/1421067422 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7408130190 0x7f740809b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.941+0000 7f740ff5d640 1 --2- 172.21.15.97:0/1421067422 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f740812fd70 0x7f740809b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.941+0000 7f740ff5d640 1 --2- 172.21.15.97:0/1421067422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408067110 0x7f740812f830 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.941+0000 7f740ff5d640 1 -- 172.21.15.97:0/1421067422 >> 172.21.15.97:0/1421067422 conn(0x7f740805e5d0 msgr2=0x7f740809f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.941+0000 7f740ff5d640 1 -- 172.21.15.97:0/1421067422 shutdown_connections 2024-09-13T18:39:20.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.941+0000 7f740ff5d640 1 -- 172.21.15.97:0/1421067422 wait complete. 2024-09-13T18:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740ff5d640 1 Processor -- start 2024-09-13T18:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740ff5d640 1 -- start start 2024-09-13T18:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740ff5d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408067110 0x7f740813ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740ff5d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f740812fd70 0x7f740813f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740ff5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7408130190 0x7f740811a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740ff5d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740811ccd0 con 0x7f7408067110 2024-09-13T18:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740ff5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740812f360 con 0x7f7408130190 2024-09-13T18:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740ff5d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f740811e140 con 0x7f740812fd70 2024-09-13T18:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740dcf9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408067110 0x7f740813ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740d4f8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f740812fd70 0x7f740813f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740d4f8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f740812fd70 0x7f740813f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48198/0 (socket says 172.21.15.97:48198) 2024-09-13T18:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740d4f8640 1 -- 172.21.15.97:0/3758020375 learned_addr learned my addr 172.21.15.97:0/3758020375 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740dcf9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408067110 0x7f740813ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37770/0 (socket says 172.21.15.97:37770) 2024-09-13T18:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.942+0000 7f740e4fa640 1 --2- 172.21.15.97:0/3758020375 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7408130190 0x7f740811a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.943+0000 7f740dcf9640 1 -- 172.21.15.97:0/3758020375 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f740812fd70 msgr2=0x7f740813f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.943+0000 7f740dcf9640 1 --2- 172.21.15.97:0/3758020375 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f740812fd70 0x7f740813f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.943+0000 7f740dcf9640 1 -- 172.21.15.97:0/3758020375 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7408130190 msgr2=0x7f740811a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.943+0000 7f740dcf9640 1 --2- 172.21.15.97:0/3758020375 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7408130190 0x7f740811a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:20.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.943+0000 7f740dcf9640 1 -- 172.21.15.97:0/3758020375 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc009390 con 0x7f7408067110 2024-09-13T18:39:20.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.943+0000 7f740d4f8640 1 --2- 172.21.15.97:0/3758020375 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f740812fd70 0x7f740813f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:20.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.943+0000 7f740dcf9640 1 --2- 172.21.15.97:0/3758020375 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408067110 0x7f740813ecd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f74080681f0 tx=0x7f7400037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:20.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.943+0000 7f7405ffb640 1 -- 172.21.15.97:0/3758020375 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000318b0 con 0x7f7408067110 2024-09-13T18:39:20.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.943+0000 7f7405ffb640 1 -- 172.21.15.97:0/3758020375 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7400040070 con 0x7f7408067110 2024-09-13T18:39:20.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.943+0000 7f740ff5d640 1 -- 172.21.15.97:0/3758020375 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f8009450 con 0x7f7408067110 2024-09-13T18:39:20.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.943+0000 7f7405ffb640 1 -- 172.21.15.97:0/3758020375 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400031cc0 con 0x7f7408067110 2024-09-13T18:39:20.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.943+0000 7f740ff5d640 1 -- 172.21.15.97:0/3758020375 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7400009a20 con 0x7f7408067110 2024-09-13T18:39:20.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.944+0000 7f7405ffb640 1 -- 172.21.15.97:0/3758020375 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f7400042030 con 0x7f7408067110 2024-09-13T18:39:20.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.944+0000 7f7405ffb640 1 -- 172.21.15.97:0/3758020375 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f74000637c0 con 0x7f7408067110 2024-09-13T18:39:20.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.944+0000 7f740ff5d640 1 -- 172.21.15.97:0/3758020375 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7408133a80 con 0x7f7408067110 2024-09-13T18:39:20.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:20.949+0000 7f7405ffb640 1 -- 172.21.15.97:0/3758020375 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f7408133a80 con 0x7f7408067110 2024-09-13T18:39:21.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.096+0000 7f740ff5d640 1 -- 172.21.15.97:0/3758020375 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7408133a80 con 0x7f73f4031160 2024-09-13T18:39:21.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.102+0000 7f7405ffb640 1 -- 172.21.15.97:0/3758020375 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271449 (unknown 2965378022 0 4122702339) 0x7f7408133a80 con 0x7f73f4031160 2024-09-13T18:39:21.108 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:21.110 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:39:21.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.105+0000 7f740ff5d640 1 -- 172.21.15.97:0/3758020375 >> v1:172.21.15.97:6816/34603 conn(0x7f73f4031160 legacy=0x7f73f4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.105+0000 7f740ff5d640 1 -- 172.21.15.97:0/3758020375 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408067110 msgr2=0x7f740813ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.105+0000 7f740ff5d640 1 --2- 172.21.15.97:0/3758020375 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408067110 0x7f740813ecd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f74080681f0 tx=0x7f7400037000 comp rx=0 tx=0).stop 2024-09-13T18:39:21.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.105+0000 7f740ff5d640 1 -- 172.21.15.97:0/3758020375 shutdown_connections 2024-09-13T18:39:21.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.105+0000 7f740ff5d640 1 --2- 172.21.15.97:0/3758020375 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7408130190 0x7f740811a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.105+0000 7f740ff5d640 1 --2- 172.21.15.97:0/3758020375 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f740812fd70 0x7f740813f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.105+0000 7f740ff5d640 1 --2- 172.21.15.97:0/3758020375 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7408067110 0x7f740813ecd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.105+0000 7f740ff5d640 1 -- 172.21.15.97:0/3758020375 >> 172.21.15.97:0/3758020375 conn(0x7f740805e5d0 msgr2=0x7f7408097ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:21.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.106+0000 7f740ff5d640 1 -- 172.21.15.97:0/3758020375 shutdown_connections 2024-09-13T18:39:21.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.106+0000 7f740ff5d640 1 -- 172.21.15.97:0/3758020375 wait complete. 2024-09-13T18:39:21.118 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-13T18:39:19.349750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592725,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":125,"num_write_kb":1121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1191360,"kb_used_data":1904,"kb_used_omap":6,"kb_used_meta":1189369,"kb_avail":376296000,"statfs":{"total":386547056640,"available":385327104000,"internally_reserved":0,"allocated":1949696,"data_stored":1408590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1217914208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001095"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600365+0000","last_change":"2024-09-13T18:39:14.592723+0000","last_active":"2024-09-13T18:39:14.600365+0000","last_peered":"2024-09-13T18:39:14.600365+0000","last_clean":"2024-09-13T18:39:14.600365+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:39:14.600365+0000","last_undegraded":"2024-09-13T18:39:14.600365+0000","last_fullsized":"2024-09-13T18:39:14.600365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:09.304808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.587573+0000","last_change":"2024-09-13T18:39:14.581266+0000","last_active":"2024-09-13T18:39:14.587573+0000","last_peered":"2024-09-13T18:39:14.587573+0000","last_clean":"2024-09-13T18:39:14.587573+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:39:14.587573+0000","last_undegraded":"2024-09-13T18:39:14.587573+0000","last_fullsized":"2024-09-13T18:39:14.587573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594566+0000","last_change":"2024-09-13T18:39:14.586254+0000","last_active":"2024-09-13T18:39:14.594566+0000","last_peered":"2024-09-13T18:39:14.594566+0000","last_clean":"2024-09-13T18:39:14.594566+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:39:14.594566+0000","last_undegraded":"2024-09-13T18:39:14.594566+0000","last_fullsized":"2024-09-13T18:39:14.594566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594551+0000","last_change":"2024-09-13T18:39:14.583960+0000","last_active":"2024-09-13T18:39:14.594551+0000","last_peered":"2024-09-13T18:39:14.594551+0000","last_clean":"2024-09-13T18:39:14.594551+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:39:14.594551+0000","last_undegraded":"2024-09-13T18:39:14.594551+0000","last_fullsized":"2024-09-13T18:39:14.594551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.589815+0000","last_change":"2024-09-13T18:39:14.577865+0000","last_active":"2024-09-13T18:39:14.589815+0000","last_peered":"2024-09-13T18:39:14.589815+0000","last_clean":"2024-09-13T18:39:14.589815+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:39:14.589815+0000","last_undegraded":"2024-09-13T18:39:14.589815+0000","last_fullsized":"2024-09-13T18:39:14.589815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595808+0000","last_change":"2024-09-13T18:39:14.590785+0000","last_active":"2024-09-13T18:39:14.595808+0000","last_peered":"2024-09-13T18:39:14.595808+0000","last_clean":"2024-09-13T18:39:14.595808+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:39:14.595808+0000","last_undegraded":"2024-09-13T18:39:14.595808+0000","last_fullsized":"2024-09-13T18:39:14.595808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:24.453184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596969+0000","last_change":"2024-09-13T18:39:14.590893+0000","last_active":"2024-09-13T18:39:14.596969+0000","last_peered":"2024-09-13T18:39:14.596969+0000","last_clean":"2024-09-13T18:39:14.596969+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:39:14.596969+0000","last_undegraded":"2024-09-13T18:39:14.596969+0000","last_fullsized":"2024-09-13T18:39:14.596969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:57.986187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601078+0000","last_change":"2024-09-13T18:39:14.595160+0000","last_active":"2024-09-13T18:39:14.601078+0000","last_peered":"2024-09-13T18:39:14.601078+0000","last_clean":"2024-09-13T18:39:14.601078+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:39:14.601078+0000","last_undegraded":"2024-09-13T18:39:14.601078+0000","last_fullsized":"2024-09-13T18:39:14.601078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595272+0000","last_change":"2024-09-13T18:39:14.586790+0000","last_active":"2024-09-13T18:39:14.595272+0000","last_peered":"2024-09-13T18:39:14.595272+0000","last_clean":"2024-09-13T18:39:14.595272+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:39:14.595272+0000","last_undegraded":"2024-09-13T18:39:14.595272+0000","last_fullsized":"2024-09-13T18:39:14.595272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:49.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601065+0000","last_change":"2024-09-13T18:39:14.591231+0000","last_active":"2024-09-13T18:39:14.601065+0000","last_peered":"2024-09-13T18:39:14.601065+0000","last_clean":"2024-09-13T18:39:14.601065+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:39:14.601065+0000","last_undegraded":"2024-09-13T18:39:14.601065+0000","last_fullsized":"2024-09-13T18:39:14.601065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600581+0000","last_change":"2024-09-13T18:39:14.589017+0000","last_active":"2024-09-13T18:39:14.600581+0000","last_peered":"2024-09-13T18:39:14.600581+0000","last_clean":"2024-09-13T18:39:14.600581+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:39:14.600581+0000","last_undegraded":"2024-09-13T18:39:14.600581+0000","last_fullsized":"2024-09-13T18:39:14.600581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600392+0000","last_change":"2024-09-13T18:39:14.592629+0000","last_active":"2024-09-13T18:39:14.600392+0000","last_peered":"2024-09-13T18:39:14.600392+0000","last_clean":"2024-09-13T18:39:14.600392+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:39:14.600392+0000","last_undegraded":"2024-09-13T18:39:14.600392+0000","last_fullsized":"2024-09-13T18:39:14.600392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602649+0000","last_change":"2024-09-13T18:39:14.597709+0000","last_active":"2024-09-13T18:39:14.602649+0000","last_peered":"2024-09-13T18:39:14.602649+0000","last_clean":"2024-09-13T18:39:14.602649+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:39:14.602649+0000","last_undegraded":"2024-09-13T18:39:14.602649+0000","last_fullsized":"2024-09-13T18:39:14.602649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.367739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.580120+0000","last_change":"2024-09-13T18:39:14.572267+0000","last_active":"2024-09-13T18:39:14.580120+0000","last_peered":"2024-09-13T18:39:14.580120+0000","last_clean":"2024-09-13T18:39:14.580120+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:39:14.580120+0000","last_undegraded":"2024-09-13T18:39:14.580120+0000","last_fullsized":"2024-09-13T18:39:14.580120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595134+0000","last_change":"2024-09-13T18:39:14.583318+0000","last_active":"2024-09-13T18:39:14.595134+0000","last_peered":"2024-09-13T18:39:14.595134+0000","last_clean":"2024-09-13T18:39:14.595134+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:39:14.595134+0000","last_undegraded":"2024-09-13T18:39:14.595134+0000","last_fullsized":"2024-09-13T18:39:14.595134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596097+0000","last_change":"2024-09-13T18:39:14.592378+0000","last_active":"2024-09-13T18:39:14.596097+0000","last_peered":"2024-09-13T18:39:14.596097+0000","last_clean":"2024-09-13T18:39:14.596097+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:39:14.596097+0000","last_undegraded":"2024-09-13T18:39:14.596097+0000","last_fullsized":"2024-09-13T18:39:14.596097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:02.414361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596564+0000","last_change":"2024-09-13T18:39:14.586945+0000","last_active":"2024-09-13T18:39:14.596564+0000","last_peered":"2024-09-13T18:39:14.596564+0000","last_clean":"2024-09-13T18:39:14.596564+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:39:14.596564+0000","last_undegraded":"2024-09-13T18:39:14.596564+0000","last_fullsized":"2024-09-13T18:39:14.596564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:57.889039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596311+0000","last_change":"2024-09-13T18:39:14.587172+0000","last_active":"2024-09-13T18:39:14.596311+0000","last_peered":"2024-09-13T18:39:14.596311+0000","last_clean":"2024-09-13T18:39:14.596311+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:39:14.596311+0000","last_undegraded":"2024-09-13T18:39:14.596311+0000","last_fullsized":"2024-09-13T18:39:14.596311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600634+0000","last_change":"2024-09-13T18:39:14.594291+0000","last_active":"2024-09-13T18:39:14.600634+0000","last_peered":"2024-09-13T18:39:14.600634+0000","last_clean":"2024-09-13T18:39:14.600634+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:39:14.600634+0000","last_undegraded":"2024-09-13T18:39:14.600634+0000","last_fullsized":"2024-09-13T18:39:14.600634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:29.208875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600015+0000","last_change":"2024-09-13T18:39:14.585973+0000","last_active":"2024-09-13T18:39:14.600015+0000","last_peered":"2024-09-13T18:39:14.600015+0000","last_clean":"2024-09-13T18:39:14.600015+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:39:14.600015+0000","last_undegraded":"2024-09-13T18:39:14.600015+0000","last_fullsized":"2024-09-13T18:39:14.600015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:48.875040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601035+0000","last_change":"2024-09-13T18:39:14.595451+0000","last_active":"2024-09-13T18:39:14.601035+0000","last_peered":"2024-09-13T18:39:14.601035+0000","last_clean":"2024-09-13T18:39:14.601035+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:39:14.601035+0000","last_undegraded":"2024-09-13T18:39:14.601035+0000","last_fullsized":"2024-09-13T18:39:14.601035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:45.368802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594643+0000","last_change":"2024-09-13T18:39:14.583590+0000","last_active":"2024-09-13T18:39:14.594643+0000","last_peered":"2024-09-13T18:39:14.594643+0000","last_clean":"2024-09-13T18:39:14.594643+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:39:14.594643+0000","last_undegraded":"2024-09-13T18:39:14.594643+0000","last_fullsized":"2024-09-13T18:39:14.594643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596929+0000","last_change":"2024-09-13T18:39:14.590724+0000","last_active":"2024-09-13T18:39:14.596929+0000","last_peered":"2024-09-13T18:39:14.596929+0000","last_clean":"2024-09-13T18:39:14.596929+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:39:14.596929+0000","last_undegraded":"2024-09-13T18:39:14.596929+0000","last_fullsized":"2024-09-13T18:39:14.596929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:09.353955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.581250+0000","last_change":"2024-09-13T18:39:14.577642+0000","last_active":"2024-09-13T18:39:14.581250+0000","last_peered":"2024-09-13T18:39:14.581250+0000","last_clean":"2024-09-13T18:39:14.581250+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:39:14.581250+0000","last_undegraded":"2024-09-13T18:39:14.581250+0000","last_fullsized":"2024-09-13T18:39:14.581250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601088+0000","last_change":"2024-09-13T18:39:14.592432+0000","last_active":"2024-09-13T18:39:14.601088+0000","last_peered":"2024-09-13T18:39:14.601088+0000","last_clean":"2024-09-13T18:39:14.601088+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:39:14.601088+0000","last_undegraded":"2024-09-13T18:39:14.601088+0000","last_fullsized":"2024-09-13T18:39:14.601088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:43.945214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.577721+0000","last_change":"2024-09-13T18:39:14.571893+0000","last_active":"2024-09-13T18:39:14.577721+0000","last_peered":"2024-09-13T18:39:14.577721+0000","last_clean":"2024-09-13T18:39:14.577721+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:39:14.577721+0000","last_undegraded":"2024-09-13T18:39:14.577721+0000","last_fullsized":"2024-09-13T18:39:14.577721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596328+0000","last_change":"2024-09-13T18:39:14.594222+0000","last_active":"2024-09-13T18:39:14.596328+0000","last_peered":"2024-09-13T18:39:14.596328+0000","last_clean":"2024-09-13T18:39:14.596328+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:39:14.596328+0000","last_undegraded":"2024-09-13T18:39:14.596328+0000","last_fullsized":"2024-09-13T18:39:14.596328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:20.265556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.580499+0000","last_change":"2024-09-13T18:39:14.576203+0000","last_active":"2024-09-13T18:39:14.580499+0000","last_peered":"2024-09-13T18:39:14.580499+0000","last_clean":"2024-09-13T18:39:14.580499+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:39:14.580499+0000","last_undegraded":"2024-09-13T18:39:14.580499+0000","last_fullsized":"2024-09-13T18:39:14.580499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593337+0000","last_change":"2024-09-13T18:39:14.586374+0000","last_active":"2024-09-13T18:39:14.593337+0000","last_peered":"2024-09-13T18:39:14.593337+0000","last_clean":"2024-09-13T18:39:14.593337+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:39:14.593337+0000","last_undegraded":"2024-09-13T18:39:14.593337+0000","last_fullsized":"2024-09-13T18:39:14.593337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:03.191196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.589263+0000","last_change":"2024-09-13T18:39:14.577392+0000","last_active":"2024-09-13T18:39:14.589263+0000","last_peered":"2024-09-13T18:39:14.589263+0000","last_clean":"2024-09-13T18:39:14.589263+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:39:14.589263+0000","last_undegraded":"2024-09-13T18:39:14.589263+0000","last_fullsized":"2024-09-13T18:39:14.589263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:26.709807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.584973+0000","last_change":"2024-09-13T18:39:14.580898+0000","last_active":"2024-09-13T18:39:14.584973+0000","last_peered":"2024-09-13T18:39:14.584973+0000","last_clean":"2024-09-13T18:39:14.584973+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:39:14.584973+0000","last_undegraded":"2024-09-13T18:39:14.584973+0000","last_fullsized":"2024-09-13T18:39:14.584973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:23.630337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.579587+0000","last_change":"2024-09-13T18:39:14.574811+0000","last_active":"2024-09-13T18:39:14.579587+0000","last_peered":"2024-09-13T18:39:14.579587+0000","last_clean":"2024-09-13T18:39:14.579587+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:39:14.579587+0000","last_undegraded":"2024-09-13T18:39:14.579587+0000","last_fullsized":"2024-09-13T18:39:14.579587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.582621+0000","last_change":"2024-09-13T18:39:14.579494+0000","last_active":"2024-09-13T18:39:14.582621+0000","last_peered":"2024-09-13T18:39:14.582621+0000","last_clean":"2024-09-13T18:39:14.582621+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:39:14.582621+0000","last_undegraded":"2024-09-13T18:39:14.582621+0000","last_fullsized":"2024-09-13T18:39:14.582621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:19.432936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.598948+0000","last_change":"2024-09-13T18:39:13.575179+0000","last_active":"2024-09-13T18:39:14.598948+0000","last_peered":"2024-09-13T18:39:14.598948+0000","last_clean":"2024-09-13T18:39:14.598948+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:39:14.598948+0000","last_undegraded":"2024-09-13T18:39:14.598948+0000","last_fullsized":"2024-09-13T18:39:14.598948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:25.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596311+0000","last_change":"2024-09-13T18:39:14.594066+0000","last_active":"2024-09-13T18:39:14.596311+0000","last_peered":"2024-09-13T18:39:14.596311+0000","last_clean":"2024-09-13T18:39:14.596311+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:39:14.596311+0000","last_undegraded":"2024-09-13T18:39:14.596311+0000","last_fullsized":"2024-09-13T18:39:14.596311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:14.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.565149+0000","last_change":"2024-09-13T18:39:13.570778+0000","last_active":"2024-09-13T18:39:14.565149+0000","last_peered":"2024-09-13T18:39:14.565149+0000","last_clean":"2024-09-13T18:39:14.565149+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:39:14.565149+0000","last_undegraded":"2024-09-13T18:39:14.565149+0000","last_fullsized":"2024-09-13T18:39:14.565149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596329+0000","last_change":"2024-09-13T18:39:14.587863+0000","last_active":"2024-09-13T18:39:14.596329+0000","last_peered":"2024-09-13T18:39:14.596329+0000","last_clean":"2024-09-13T18:39:14.596329+0000","last_became_active":"2024-09-13T18:39:14.587626+0000","last_became_peered":"2024-09-13T18:39:14.587626+0000","last_unstale":"2024-09-13T18:39:14.596329+0000","last_undegraded":"2024-09-13T18:39:14.596329+0000","last_fullsized":"2024-09-13T18:39:14.596329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.566954+0000","last_change":"2024-09-13T18:39:13.575436+0000","last_active":"2024-09-13T18:39:14.566954+0000","last_peered":"2024-09-13T18:39:14.566954+0000","last_clean":"2024-09-13T18:39:14.566954+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:39:14.566954+0000","last_undegraded":"2024-09-13T18:39:14.566954+0000","last_fullsized":"2024-09-13T18:39:14.566954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:34.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588763+0000","last_change":"2024-09-13T18:39:14.584791+0000","last_active":"2024-09-13T18:39:14.588763+0000","last_peered":"2024-09-13T18:39:14.588763+0000","last_clean":"2024-09-13T18:39:14.588763+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:39:14.588763+0000","last_undegraded":"2024-09-13T18:39:14.588763+0000","last_fullsized":"2024-09-13T18:39:14.588763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:08.799126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601033+0000","last_change":"2024-09-13T18:39:13.578940+0000","last_active":"2024-09-13T18:39:14.601033+0000","last_peered":"2024-09-13T18:39:14.601033+0000","last_clean":"2024-09-13T18:39:14.601033+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:39:14.601033+0000","last_undegraded":"2024-09-13T18:39:14.601033+0000","last_fullsized":"2024-09-13T18:39:14.601033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:34.109209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.585065+0000","last_change":"2024-09-13T18:39:13.583184+0000","last_active":"2024-09-13T18:39:14.585065+0000","last_peered":"2024-09-13T18:39:14.585065+0000","last_clean":"2024-09-13T18:39:14.585065+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:39:14.585065+0000","last_undegraded":"2024-09-13T18:39:14.585065+0000","last_fullsized":"2024-09-13T18:39:14.585065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588808+0000","last_change":"2024-09-13T18:39:14.582349+0000","last_active":"2024-09-13T18:39:14.588808+0000","last_peered":"2024-09-13T18:39:14.588808+0000","last_clean":"2024-09-13T18:39:14.588808+0000","last_became_active":"2024-09-13T18:39:14.581643+0000","last_became_peered":"2024-09-13T18:39:14.581643+0000","last_unstale":"2024-09-13T18:39:14.588808+0000","last_undegraded":"2024-09-13T18:39:14.588808+0000","last_fullsized":"2024-09-13T18:39:14.588808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:34.221522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588626+0000","last_change":"2024-09-13T18:39:13.571043+0000","last_active":"2024-09-13T18:39:14.588626+0000","last_peered":"2024-09-13T18:39:14.588626+0000","last_clean":"2024-09-13T18:39:14.588626+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:39:14.588626+0000","last_undegraded":"2024-09-13T18:39:14.588626+0000","last_fullsized":"2024-09-13T18:39:14.588626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.757855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.580443+0000","last_change":"2024-09-13T18:39:14.577177+0000","last_active":"2024-09-13T18:39:14.580443+0000","last_peered":"2024-09-13T18:39:14.580443+0000","last_clean":"2024-09-13T18:39:14.580443+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:39:14.580443+0000","last_undegraded":"2024-09-13T18:39:14.580443+0000","last_fullsized":"2024-09-13T18:39:14.580443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601502+0000","last_change":"2024-09-13T18:39:13.581627+0000","last_active":"2024-09-13T18:39:14.601502+0000","last_peered":"2024-09-13T18:39:14.601502+0000","last_clean":"2024-09-13T18:39:14.601502+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:39:14.601502+0000","last_undegraded":"2024-09-13T18:39:14.601502+0000","last_fullsized":"2024-09-13T18:39:14.601502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:48.023626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602556+0000","last_change":"2024-09-13T18:39:14.596602+0000","last_active":"2024-09-13T18:39:14.602556+0000","last_peered":"2024-09-13T18:39:14.602556+0000","last_clean":"2024-09-13T18:39:14.602556+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:39:14.602556+0000","last_undegraded":"2024-09-13T18:39:14.602556+0000","last_fullsized":"2024-09-13T18:39:14.602556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:35.414913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.570529+0000","last_change":"2024-09-13T18:39:13.570169+0000","last_active":"2024-09-13T18:39:14.570529+0000","last_peered":"2024-09-13T18:39:14.570529+0000","last_clean":"2024-09-13T18:39:14.570529+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:39:14.570529+0000","last_undegraded":"2024-09-13T18:39:14.570529+0000","last_fullsized":"2024-09-13T18:39:14.570529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594596+0000","last_change":"2024-09-13T18:39:14.584580+0000","last_active":"2024-09-13T18:39:14.594596+0000","last_peered":"2024-09-13T18:39:14.594596+0000","last_clean":"2024-09-13T18:39:14.594596+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:39:14.594596+0000","last_undegraded":"2024-09-13T18:39:14.594596+0000","last_fullsized":"2024-09-13T18:39:14.594596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.598820+0000","last_change":"2024-09-13T18:39:13.575713+0000","last_active":"2024-09-13T18:39:14.598820+0000","last_peered":"2024-09-13T18:39:14.598820+0000","last_clean":"2024-09-13T18:39:14.598820+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:39:14.598820+0000","last_undegraded":"2024-09-13T18:39:14.598820+0000","last_fullsized":"2024-09-13T18:39:14.598820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:59.985917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.589332+0000","last_change":"2024-09-13T18:39:14.577151+0000","last_active":"2024-09-13T18:39:14.589332+0000","last_peered":"2024-09-13T18:39:14.589332+0000","last_clean":"2024-09-13T18:39:14.589332+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:39:14.589332+0000","last_undegraded":"2024-09-13T18:39:14.589332+0000","last_fullsized":"2024-09-13T18:39:14.589332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.559598+0000","last_change":"2024-09-13T18:39:13.581445+0000","last_active":"2024-09-13T18:39:14.559598+0000","last_peered":"2024-09-13T18:39:14.559598+0000","last_clean":"2024-09-13T18:39:14.559598+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:39:14.559598+0000","last_undegraded":"2024-09-13T18:39:14.559598+0000","last_fullsized":"2024-09-13T18:39:14.559598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:39.003339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593363+0000","last_change":"2024-09-13T18:39:14.584122+0000","last_active":"2024-09-13T18:39:14.593363+0000","last_peered":"2024-09-13T18:39:14.593363+0000","last_clean":"2024-09-13T18:39:14.593363+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:39:14.593363+0000","last_undegraded":"2024-09-13T18:39:14.593363+0000","last_fullsized":"2024-09-13T18:39:14.593363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:30.405734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.563524+0000","last_change":"2024-09-13T18:39:13.575316+0000","last_active":"2024-09-13T18:39:14.563524+0000","last_peered":"2024-09-13T18:39:14.563524+0000","last_clean":"2024-09-13T18:39:14.563524+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:39:14.563524+0000","last_undegraded":"2024-09-13T18:39:14.563524+0000","last_fullsized":"2024-09-13T18:39:14.563524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:06.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600699+0000","last_change":"2024-09-13T18:39:14.593058+0000","last_active":"2024-09-13T18:39:14.600699+0000","last_peered":"2024-09-13T18:39:14.600699+0000","last_clean":"2024-09-13T18:39:14.600699+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:39:14.600699+0000","last_undegraded":"2024-09-13T18:39:14.600699+0000","last_fullsized":"2024-09-13T18:39:14.600699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:24.454698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.560704+0000","last_change":"2024-09-13T18:39:13.581217+0000","last_active":"2024-09-13T18:39:14.560704+0000","last_peered":"2024-09-13T18:39:14.560704+0000","last_clean":"2024-09-13T18:39:14.560704+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:39:14.560704+0000","last_undegraded":"2024-09-13T18:39:14.560704+0000","last_fullsized":"2024-09-13T18:39:14.560704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:27.361025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601513+0000","last_change":"2024-09-13T18:39:14.596597+0000","last_active":"2024-09-13T18:39:14.601513+0000","last_peered":"2024-09-13T18:39:14.601513+0000","last_clean":"2024-09-13T18:39:14.601513+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:39:14.601513+0000","last_undegraded":"2024-09-13T18:39:14.601513+0000","last_fullsized":"2024-09-13T18:39:14.601513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:47.680908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.565720+0000","last_change":"2024-09-13T18:39:03.413753+0000","last_active":"2024-09-13T18:39:14.565720+0000","last_peered":"2024-09-13T18:39:14.565720+0000","last_clean":"2024-09-13T18:39:14.565720+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:39:14.565720+0000","last_undegraded":"2024-09-13T18:39:14.565720+0000","last_fullsized":"2024-09-13T18:39:14.565720+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.425159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:05.703287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954507+0000","last_change":"2024-09-13T18:39:09.531787+0000","last_active":"2024-09-13T18:39:14.954507+0000","last_peered":"2024-09-13T18:39:14.954507+0000","last_clean":"2024-09-13T18:39:14.954507+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:39:14.954507+0000","last_undegraded":"2024-09-13T18:39:14.954507+0000","last_fullsized":"2024-09-13T18:39:14.954507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:21.652872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.560046+0000","last_change":"2024-09-13T18:39:13.575940+0000","last_active":"2024-09-13T18:39:14.560046+0000","last_peered":"2024-09-13T18:39:14.560046+0000","last_clean":"2024-09-13T18:39:14.560046+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:39:14.560046+0000","last_undegraded":"2024-09-13T18:39:14.560046+0000","last_fullsized":"2024-09-13T18:39:14.560046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:23.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593382+0000","last_change":"2024-09-13T18:39:14.584292+0000","last_active":"2024-09-13T18:39:14.593382+0000","last_peered":"2024-09-13T18:39:14.593382+0000","last_clean":"2024-09-13T18:39:14.593382+0000","last_became_active":"2024-09-13T18:39:14.583817+0000","last_became_peered":"2024-09-13T18:39:14.583817+0000","last_unstale":"2024-09-13T18:39:14.593382+0000","last_undegraded":"2024-09-13T18:39:14.593382+0000","last_fullsized":"2024-09-13T18:39:14.593382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:19.897995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954284+0000","last_change":"2024-09-13T18:39:09.531377+0000","last_active":"2024-09-13T18:39:14.954284+0000","last_peered":"2024-09-13T18:39:14.954284+0000","last_clean":"2024-09-13T18:39:14.954284+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:39:14.954284+0000","last_undegraded":"2024-09-13T18:39:14.954284+0000","last_fullsized":"2024-09-13T18:39:14.954284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.568234+0000","last_change":"2024-09-13T18:39:13.563570+0000","last_active":"2024-09-13T18:39:14.568234+0000","last_peered":"2024-09-13T18:39:14.568234+0000","last_clean":"2024-09-13T18:39:14.568234+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:39:14.568234+0000","last_undegraded":"2024-09-13T18:39:14.568234+0000","last_fullsized":"2024-09-13T18:39:14.568234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596295+0000","last_change":"2024-09-13T18:39:14.587017+0000","last_active":"2024-09-13T18:39:14.596295+0000","last_peered":"2024-09-13T18:39:14.596295+0000","last_clean":"2024-09-13T18:39:14.596295+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:39:14.596295+0000","last_undegraded":"2024-09-13T18:39:14.596295+0000","last_fullsized":"2024-09-13T18:39:14.596295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.955787+0000","last_change":"2024-09-13T18:39:09.533004+0000","last_active":"2024-09-13T18:39:14.955787+0000","last_peered":"2024-09-13T18:39:14.955787+0000","last_clean":"2024-09-13T18:39:14.955787+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:39:14.955787+0000","last_undegraded":"2024-09-13T18:39:14.955787+0000","last_fullsized":"2024-09-13T18:39:14.955787+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:41.079838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.565570+0000","last_change":"2024-09-13T18:39:13.579066+0000","last_active":"2024-09-13T18:39:14.565570+0000","last_peered":"2024-09-13T18:39:14.565570+0000","last_clean":"2024-09-13T18:39:14.565570+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:39:14.565570+0000","last_undegraded":"2024-09-13T18:39:14.565570+0000","last_fullsized":"2024-09-13T18:39:14.565570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600806+0000","last_change":"2024-09-13T18:39:14.589734+0000","last_active":"2024-09-13T18:39:14.600806+0000","last_peered":"2024-09-13T18:39:14.600806+0000","last_clean":"2024-09-13T18:39:14.600806+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:39:14.600806+0000","last_undegraded":"2024-09-13T18:39:14.600806+0000","last_fullsized":"2024-09-13T18:39:14.600806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954495+0000","last_change":"2024-09-13T18:39:09.532311+0000","last_active":"2024-09-13T18:39:14.954495+0000","last_peered":"2024-09-13T18:39:14.954495+0000","last_clean":"2024-09-13T18:39:14.954495+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:39:14.954495+0000","last_undegraded":"2024-09-13T18:39:14.954495+0000","last_fullsized":"2024-09-13T18:39:14.954495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:53.060128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.571185+0000","last_change":"2024-09-13T18:39:13.571488+0000","last_active":"2024-09-13T18:39:14.571185+0000","last_peered":"2024-09-13T18:39:14.571185+0000","last_clean":"2024-09-13T18:39:14.571185+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:39:14.571185+0000","last_undegraded":"2024-09-13T18:39:14.571185+0000","last_fullsized":"2024-09-13T18:39:14.571185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:44.121699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.581996+0000","last_change":"2024-09-13T18:39:14.579779+0000","last_active":"2024-09-13T18:39:14.581996+0000","last_peered":"2024-09-13T18:39:14.581996+0000","last_clean":"2024-09-13T18:39:14.581996+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:39:14.581996+0000","last_undegraded":"2024-09-13T18:39:14.581996+0000","last_fullsized":"2024-09-13T18:39:14.581996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.558628+0000","last_change":"2024-09-13T18:39:13.577844+0000","last_active":"2024-09-13T18:39:14.558628+0000","last_peered":"2024-09-13T18:39:14.558628+0000","last_clean":"2024-09-13T18:39:14.558628+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:39:14.558628+0000","last_undegraded":"2024-09-13T18:39:14.558628+0000","last_fullsized":"2024-09-13T18:39:14.558628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954762+0000","last_change":"2024-09-13T18:39:09.533091+0000","last_active":"2024-09-13T18:39:14.954762+0000","last_peered":"2024-09-13T18:39:14.954762+0000","last_clean":"2024-09-13T18:39:14.954762+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:39:14.954762+0000","last_undegraded":"2024-09-13T18:39:14.954762+0000","last_fullsized":"2024-09-13T18:39:14.954762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601570+0000","last_change":"2024-09-13T18:39:14.597238+0000","last_active":"2024-09-13T18:39:14.601570+0000","last_peered":"2024-09-13T18:39:14.601570+0000","last_clean":"2024-09-13T18:39:14.601570+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:39:14.601570+0000","last_undegraded":"2024-09-13T18:39:14.601570+0000","last_fullsized":"2024-09-13T18:39:14.601570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.849783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.561344+0000","last_change":"2024-09-13T18:39:13.583071+0000","last_active":"2024-09-13T18:39:14.561344+0000","last_peered":"2024-09-13T18:39:14.561344+0000","last_clean":"2024-09-13T18:39:14.561344+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:39:14.561344+0000","last_undegraded":"2024-09-13T18:39:14.561344+0000","last_fullsized":"2024-09-13T18:39:14.561344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.956131+0000","last_change":"2024-09-13T18:39:09.532042+0000","last_active":"2024-09-13T18:39:14.956131+0000","last_peered":"2024-09-13T18:39:14.956131+0000","last_clean":"2024-09-13T18:39:14.956131+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:39:14.956131+0000","last_undegraded":"2024-09-13T18:39:14.956131+0000","last_fullsized":"2024-09-13T18:39:14.956131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:24.541036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.594579+0000","last_change":"2024-09-13T18:39:14.584428+0000","last_active":"2024-09-13T18:39:14.594579+0000","last_peered":"2024-09-13T18:39:14.594579+0000","last_clean":"2024-09-13T18:39:14.594579+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:39:14.594579+0000","last_undegraded":"2024-09-13T18:39:14.594579+0000","last_fullsized":"2024-09-13T18:39:14.594579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601380+0000","last_change":"2024-09-13T18:39:13.583868+0000","last_active":"2024-09-13T18:39:14.601380+0000","last_peered":"2024-09-13T18:39:14.601380+0000","last_clean":"2024-09-13T18:39:14.601380+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:39:14.601380+0000","last_undegraded":"2024-09-13T18:39:14.601380+0000","last_fullsized":"2024-09-13T18:39:14.601380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:52.540883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.956669+0000","last_change":"2024-09-13T18:39:09.532757+0000","last_active":"2024-09-13T18:39:14.956669+0000","last_peered":"2024-09-13T18:39:14.956669+0000","last_clean":"2024-09-13T18:39:14.956669+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:39:14.956669+0000","last_undegraded":"2024-09-13T18:39:14.956669+0000","last_fullsized":"2024-09-13T18:39:14.956669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:32.617744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588824+0000","last_change":"2024-09-13T18:39:14.582490+0000","last_active":"2024-09-13T18:39:14.588824+0000","last_peered":"2024-09-13T18:39:14.588824+0000","last_clean":"2024-09-13T18:39:14.588824+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:39:14.588824+0000","last_undegraded":"2024-09-13T18:39:14.588824+0000","last_fullsized":"2024-09-13T18:39:14.588824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:44.239715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.572182+0000","last_change":"2024-09-13T18:39:13.583929+0000","last_active":"2024-09-13T18:39:14.572182+0000","last_peered":"2024-09-13T18:39:14.572182+0000","last_clean":"2024-09-13T18:39:14.572182+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:39:14.572182+0000","last_undegraded":"2024-09-13T18:39:14.572182+0000","last_fullsized":"2024-09-13T18:39:14.572182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:57.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.954641+0000","last_change":"2024-09-13T18:39:09.531717+0000","last_active":"2024-09-13T18:39:14.954641+0000","last_peered":"2024-09-13T18:39:14.954641+0000","last_clean":"2024-09-13T18:39:14.954641+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:39:14.954641+0000","last_undegraded":"2024-09-13T18:39:14.954641+0000","last_fullsized":"2024-09-13T18:39:14.954641+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:33.878130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602684+0000","last_change":"2024-09-13T18:39:14.598033+0000","last_active":"2024-09-13T18:39:14.602684+0000","last_peered":"2024-09-13T18:39:14.602684+0000","last_clean":"2024-09-13T18:39:14.602684+0000","last_became_active":"2024-09-13T18:39:14.597783+0000","last_became_peered":"2024-09-13T18:39:14.597783+0000","last_unstale":"2024-09-13T18:39:14.602684+0000","last_undegraded":"2024-09-13T18:39:14.602684+0000","last_fullsized":"2024-09-13T18:39:14.602684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:32.548971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600676+0000","last_change":"2024-09-13T18:39:14.593754+0000","last_active":"2024-09-13T18:39:14.600676+0000","last_peered":"2024-09-13T18:39:14.600676+0000","last_clean":"2024-09-13T18:39:14.600676+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:39:14.600676+0000","last_undegraded":"2024-09-13T18:39:14.600676+0000","last_fullsized":"2024-09-13T18:39:14.600676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:07.651837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.604681+0000","last_change":"2024-09-13T18:39:13.575507+0000","last_active":"2024-09-13T18:39:14.604681+0000","last_peered":"2024-09-13T18:39:14.604681+0000","last_clean":"2024-09-13T18:39:14.604681+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:39:14.604681+0000","last_undegraded":"2024-09-13T18:39:14.604681+0000","last_fullsized":"2024-09-13T18:39:14.604681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:42.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.601588+0000","last_change":"2024-09-13T18:39:14.598160+0000","last_active":"2024-09-13T18:39:14.601588+0000","last_peered":"2024-09-13T18:39:14.601588+0000","last_clean":"2024-09-13T18:39:14.601588+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:39:14.601588+0000","last_undegraded":"2024-09-13T18:39:14.601588+0000","last_fullsized":"2024-09-13T18:39:14.601588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.585676+0000","last_change":"2024-09-13T18:39:13.572017+0000","last_active":"2024-09-13T18:39:14.585676+0000","last_peered":"2024-09-13T18:39:14.585676+0000","last_clean":"2024-09-13T18:39:14.585676+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:39:14.585676+0000","last_undegraded":"2024-09-13T18:39:14.585676+0000","last_fullsized":"2024-09-13T18:39:14.585676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:25.536255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.561009+0000","last_change":"2024-09-13T18:39:13.571792+0000","last_active":"2024-09-13T18:39:14.561009+0000","last_peered":"2024-09-13T18:39:14.561009+0000","last_clean":"2024-09-13T18:39:14.561009+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:39:14.561009+0000","last_undegraded":"2024-09-13T18:39:14.561009+0000","last_fullsized":"2024-09-13T18:39:14.561009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596950+0000","last_change":"2024-09-13T18:39:14.590748+0000","last_active":"2024-09-13T18:39:14.596950+0000","last_peered":"2024-09-13T18:39:14.596950+0000","last_clean":"2024-09-13T18:39:14.596950+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:39:14.596950+0000","last_undegraded":"2024-09-13T18:39:14.596950+0000","last_fullsized":"2024-09-13T18:39:14.596950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:49.557245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.572729+0000","last_change":"2024-09-13T18:39:13.569863+0000","last_active":"2024-09-13T18:39:14.572729+0000","last_peered":"2024-09-13T18:39:14.572729+0000","last_clean":"2024-09-13T18:39:14.572729+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:39:14.572729+0000","last_undegraded":"2024-09-13T18:39:14.572729+0000","last_fullsized":"2024-09-13T18:39:14.572729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588790+0000","last_change":"2024-09-13T18:39:14.582205+0000","last_active":"2024-09-13T18:39:14.588790+0000","last_peered":"2024-09-13T18:39:14.588790+0000","last_clean":"2024-09-13T18:39:14.588790+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:39:14.588790+0000","last_undegraded":"2024-09-13T18:39:14.588790+0000","last_fullsized":"2024-09-13T18:39:14.588790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.186210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588744+0000","last_change":"2024-09-13T18:39:14.584622+0000","last_active":"2024-09-13T18:39:14.588744+0000","last_peered":"2024-09-13T18:39:14.588744+0000","last_clean":"2024-09-13T18:39:14.588744+0000","last_became_active":"2024-09-13T18:39:14.584061+0000","last_became_peered":"2024-09-13T18:39:14.584061+0000","last_unstale":"2024-09-13T18:39:14.588744+0000","last_undegraded":"2024-09-13T18:39:14.588744+0000","last_fullsized":"2024-09-13T18:39:14.588744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:55.751927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.560638+0000","last_change":"2024-09-13T18:39:13.573803+0000","last_active":"2024-09-13T18:39:14.560638+0000","last_peered":"2024-09-13T18:39:14.560638+0000","last_clean":"2024-09-13T18:39:14.560638+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:39:14.560638+0000","last_undegraded":"2024-09-13T18:39:14.560638+0000","last_fullsized":"2024-09-13T18:39:14.560638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:08.298094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596277+0000","last_change":"2024-09-13T18:39:14.586848+0000","last_active":"2024-09-13T18:39:14.596277+0000","last_peered":"2024-09-13T18:39:14.596277+0000","last_clean":"2024-09-13T18:39:14.596277+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:39:14.596277+0000","last_undegraded":"2024-09-13T18:39:14.596277+0000","last_fullsized":"2024-09-13T18:39:14.596277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.564950+0000","last_change":"2024-09-13T18:39:13.586123+0000","last_active":"2024-09-13T18:39:14.564950+0000","last_peered":"2024-09-13T18:39:14.564950+0000","last_clean":"2024-09-13T18:39:14.564950+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:39:14.564950+0000","last_undegraded":"2024-09-13T18:39:14.564950+0000","last_fullsized":"2024-09-13T18:39:14.564950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.582711+0000","last_change":"2024-09-13T18:39:14.579531+0000","last_active":"2024-09-13T18:39:14.582711+0000","last_peered":"2024-09-13T18:39:14.582711+0000","last_clean":"2024-09-13T18:39:14.582711+0000","last_became_active":"2024-09-13T18:39:14.579269+0000","last_became_peered":"2024-09-13T18:39:14.579269+0000","last_unstale":"2024-09-13T18:39:14.582711+0000","last_undegraded":"2024-09-13T18:39:14.582711+0000","last_fullsized":"2024-09-13T18:39:14.582711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:09.638652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.595556+0000","last_change":"2024-09-13T18:39:13.575435+0000","last_active":"2024-09-13T18:39:14.595556+0000","last_peered":"2024-09-13T18:39:14.595556+0000","last_clean":"2024-09-13T18:39:14.595556+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:39:14.595556+0000","last_undegraded":"2024-09-13T18:39:14.595556+0000","last_fullsized":"2024-09-13T18:39:14.595556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.585728+0000","last_change":"2024-09-13T18:39:14.580846+0000","last_active":"2024-09-13T18:39:14.585728+0000","last_peered":"2024-09-13T18:39:14.585728+0000","last_clean":"2024-09-13T18:39:14.585728+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:39:14.585728+0000","last_undegraded":"2024-09-13T18:39:14.585728+0000","last_fullsized":"2024-09-13T18:39:14.585728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.010053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.588802+0000","last_change":"2024-09-13T18:39:13.571042+0000","last_active":"2024-09-13T18:39:14.588802+0000","last_peered":"2024-09-13T18:39:14.588802+0000","last_clean":"2024-09-13T18:39:14.588802+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:39:14.588802+0000","last_undegraded":"2024-09-13T18:39:14.588802+0000","last_fullsized":"2024-09-13T18:39:14.588802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.288993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600660+0000","last_change":"2024-09-13T18:39:14.593258+0000","last_active":"2024-09-13T18:39:14.600660+0000","last_peered":"2024-09-13T18:39:14.600660+0000","last_clean":"2024-09-13T18:39:14.600660+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:39:14.600660+0000","last_undegraded":"2024-09-13T18:39:14.600660+0000","last_fullsized":"2024-09-13T18:39:14.600660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:21.972039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.600247+0000","last_change":"2024-09-13T18:39:13.584903+0000","last_active":"2024-09-13T18:39:14.600247+0000","last_peered":"2024-09-13T18:39:14.600247+0000","last_clean":"2024-09-13T18:39:14.600247+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:39:14.600247+0000","last_undegraded":"2024-09-13T18:39:14.600247+0000","last_fullsized":"2024-09-13T18:39:14.600247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:46.551317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602577+0000","last_change":"2024-09-13T18:39:14.597339+0000","last_active":"2024-09-13T18:39:14.602577+0000","last_peered":"2024-09-13T18:39:14.602577+0000","last_clean":"2024-09-13T18:39:14.602577+0000","last_became_active":"2024-09-13T18:39:14.594896+0000","last_became_peered":"2024-09-13T18:39:14.594896+0000","last_unstale":"2024-09-13T18:39:14.602577+0000","last_undegraded":"2024-09-13T18:39:14.602577+0000","last_fullsized":"2024-09-13T18:39:14.602577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:00.992631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.593279+0000","last_change":"2024-09-13T18:39:13.574044+0000","last_active":"2024-09-13T18:39:14.593279+0000","last_peered":"2024-09-13T18:39:14.593279+0000","last_clean":"2024-09-13T18:39:14.593279+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:39:14.593279+0000","last_undegraded":"2024-09-13T18:39:14.593279+0000","last_fullsized":"2024-09-13T18:39:14.593279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:12.168801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.596996+0000","last_change":"2024-09-13T18:39:14.591381+0000","last_active":"2024-09-13T18:39:14.596996+0000","last_peered":"2024-09-13T18:39:14.596996+0000","last_clean":"2024-09-13T18:39:14.596996+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:39:14.596996+0000","last_undegraded":"2024-09-13T18:39:14.596996+0000","last_fullsized":"2024-09-13T18:39:14.596996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:17.239023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.602768+0000","last_change":"2024-09-13T18:39:13.575357+0000","last_active":"2024-09-13T18:39:14.602768+0000","last_peered":"2024-09-13T18:39:14.602768+0000","last_clean":"2024-09-13T18:39:14.602768+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:39:14.602768+0000","last_undegraded":"2024-09-13T18:39:14.602768+0000","last_fullsized":"2024-09-13T18:39:14.602768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:20.965325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.587405+0000","last_change":"2024-09-13T18:39:14.580750+0000","last_active":"2024-09-13T18:39:14.587405+0000","last_peered":"2024-09-13T18:39:14.587405+0000","last_clean":"2024-09-13T18:39:14.587405+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:39:14.587405+0000","last_undegraded":"2024-09-13T18:39:14.587405+0000","last_fullsized":"2024-09-13T18:39:14.587405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:08.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:39:14.584973+0000","last_change":"2024-09-13T18:39:13.583221+0000","last_active":"2024-09-13T18:39:14.584973+0000","last_peered":"2024-09-13T18:39:14.584973+0000","last_clean":"2024-09-13T18:39:14.584973+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:39:14.584973+0000","last_undegraded":"2024-09-13T18:39:14.584973+0000","last_fullsized":"2024-09-13T18:39:14.584973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":200704,"data_stored":57550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":184320,"data_stored":57337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":782336,"data_stored":646834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298128,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073712,"statfs":{"total":96636764160,"available":96331481088,"internally_reserved":0,"allocated":782336,"data_stored":646869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:39:21.123 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:39:21.123 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:39:21.123 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:39:21.123 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T18:39:21.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.247+0000 7f4c27f1d640 1 Processor -- start 2024-09-13T18:39:21.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.247+0000 7f4c27f1d640 1 -- start start 2024-09-13T18:39:21.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c27f1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c2012de60 0x7f4c20132510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c27f1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4c2012d1e0 0x7f4c20134a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c27f1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2006da20 con 0x7f4c200a1220 2024-09-13T18:39:21.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c27f1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c200a15f0 con 0x7f4c2012d1e0 2024-09-13T18:39:21.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c27f1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2009ff20 con 0x7f4c2012de60 2024-09-13T18:39:21.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c254b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c2012de60 0x7f4c20132510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c25cb9640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4c200a1220 0x7f4c2012d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47884/0 (socket says 172.21.15.97:47884) 2024-09-13T18:39:21.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c254b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c2012de60 0x7f4c20132510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35998/0 (socket says 172.21.15.97:35998) 2024-09-13T18:39:21.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c25cb9640 1 -- 172.21.15.97:0/3787639713 learned_addr learned my addr 172.21.15.97:0/3787639713 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:21.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c264ba640 1 --2- 172.21.15.97:0/3787639713 >> v2:172.21.15.97:3300/0 conn(0x7f4c2012d1e0 0x7f4c20134a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c254b8640 1 -- 172.21.15.97:0/3787639713 >> v2:172.21.15.97:3300/0 conn(0x7f4c2012d1e0 msgr2=0x7f4c20134a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:21.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c254b8640 1 --2- 172.21.15.97:0/3787639713 >> v2:172.21.15.97:3300/0 conn(0x7f4c2012d1e0 0x7f4c20134a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c254b8640 1 -- 172.21.15.97:0/3787639713 >> v1:172.21.15.97:6789/0 conn(0x7f4c200a1220 legacy=0x7f4c2012d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c24cb7640 1 -- 172.21.15.97:0/3787639713 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980742520 0 0) 0x7f4c2006da20 con 0x7f4c200a1220 2024-09-13T18:39:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c254b8640 1 -- 172.21.15.97:0/3787639713 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c200a0280 con 0x7f4c2012de60 2024-09-13T18:39:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.248+0000 7f4c264ba640 1 --2- 172.21.15.97:0/3787639713 >> v2:172.21.15.97:3300/0 conn(0x7f4c2012d1e0 0x7f4c20134a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.249+0000 7f4c254b8640 1 --2- 172.21.15.97:0/3787639713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c2012de60 0x7f4c20132510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009850 tx=0x7f4c100090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2ba9cf928489617 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.249+0000 7f4c24cb7640 1 -- 172.21.15.97:0/3787639713 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1002ad00 con 0x7f4c2012de60 2024-09-13T18:39:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.249+0000 7f4c24cb7640 1 -- 172.21.15.97:0/3787639713 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1002ae60 con 0x7f4c2012de60 2024-09-13T18:39:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.249+0000 7f4c24cb7640 1 -- 172.21.15.97:0/3787639713 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10032670 con 0x7f4c2012de60 2024-09-13T18:39:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.250+0000 7f4c27f1d640 1 -- 172.21.15.97:0/3787639713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c2012de60 msgr2=0x7f4c20132510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.250+0000 7f4c27f1d640 1 --2- 172.21.15.97:0/3787639713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c2012de60 0x7f4c20132510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009850 tx=0x7f4c100090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.250+0000 7f4c27f1d640 1 -- 172.21.15.97:0/3787639713 shutdown_connections 2024-09-13T18:39:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.250+0000 7f4c27f1d640 1 --2- 172.21.15.97:0/3787639713 >> v2:172.21.15.97:3300/0 conn(0x7f4c2012d1e0 0x7f4c20134a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.250+0000 7f4c27f1d640 1 --2- 172.21.15.97:0/3787639713 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c2012de60 0x7f4c20132510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.250+0000 7f4c27f1d640 1 -- 172.21.15.97:0/3787639713 >> 172.21.15.97:0/3787639713 conn(0x7f4c200677e0 msgr2=0x7f4c200a0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.250+0000 7f4c27f1d640 1 -- 172.21.15.97:0/3787639713 shutdown_connections 2024-09-13T18:39:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.250+0000 7f4c27f1d640 1 -- 172.21.15.97:0/3787639713 wait complete. 2024-09-13T18:39:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c27f1d640 1 Processor -- start 2024-09-13T18:39:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c27f1d640 1 -- start start 2024-09-13T18:39:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c27f1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c200a1220 0x7f4c20068220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c27f1d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c2012d1e0 0x7f4c20068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c27f1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c2012de60 0x7f4c20068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c27f1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2006c150 con 0x7f4c200a1220 2024-09-13T18:39:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c27f1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c20117e50 con 0x7f4c2012de60 2024-09-13T18:39:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c27f1d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2012a900 con 0x7f4c2012d1e0 2024-09-13T18:39:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c25cb9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c200a1220 0x7f4c20068220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c264ba640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c2012de60 0x7f4c20068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c254b8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c2012d1e0 0x7f4c20068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c25cb9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c200a1220 0x7f4c20068220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37796/0 (socket says 172.21.15.97:37796) 2024-09-13T18:39:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c25cb9640 1 -- 172.21.15.97:0/4177915678 learned_addr learned my addr 172.21.15.97:0/4177915678 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c25cb9640 1 -- 172.21.15.97:0/4177915678 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c2012d1e0 msgr2=0x7f4c20068760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c25cb9640 1 --2- 172.21.15.97:0/4177915678 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c2012d1e0 0x7f4c20068760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c25cb9640 1 -- 172.21.15.97:0/4177915678 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c2012de60 msgr2=0x7f4c20068ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c25cb9640 1 --2- 172.21.15.97:0/4177915678 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c2012de60 0x7f4c20068ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c25cb9640 1 -- 172.21.15.97:0/4177915678 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c18009a20 con 0x7f4c200a1220 2024-09-13T18:39:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.251+0000 7f4c264ba640 1 --2- 172.21.15.97:0/4177915678 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c2012de60 0x7f4c20068ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.252+0000 7f4c25cb9640 1 --2- 172.21.15.97:0/4177915678 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c200a1220 0x7f4c20068220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00c5e0 tx=0x7f4c1c007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.252+0000 7f4c15ffb640 1 -- 172.21.15.97:0/4177915678 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c005aa0 con 0x7f4c200a1220 2024-09-13T18:39:21.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.252+0000 7f4c15ffb640 1 -- 172.21.15.97:0/4177915678 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c005c00 con 0x7f4c200a1220 2024-09-13T18:39:21.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.252+0000 7f4c27f1d640 1 -- 172.21.15.97:0/4177915678 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c10009390 con 0x7f4c200a1220 2024-09-13T18:39:21.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.252+0000 7f4c15ffb640 1 -- 172.21.15.97:0/4177915678 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0070f0 con 0x7f4c200a1220 2024-09-13T18:39:21.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.252+0000 7f4c27f1d640 1 -- 172.21.15.97:0/4177915678 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2006a170 con 0x7f4c200a1220 2024-09-13T18:39:21.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.253+0000 7f4c15ffb640 1 -- 172.21.15.97:0/4177915678 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f4c1c007520 con 0x7f4c200a1220 2024-09-13T18:39:21.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.253+0000 7f4c15ffb640 1 -- 172.21.15.97:0/4177915678 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f4c1c041b10 con 0x7f4c200a1220 2024-09-13T18:39:21.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.253+0000 7f4c27f1d640 1 -- 172.21.15.97:0/4177915678 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c20117fc0 con 0x7f4c200a1220 2024-09-13T18:39:21.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.257+0000 7f4c15ffb640 1 -- 172.21.15.97:0/4177915678 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f4c1c01b400 con 0x7f4c200a1220 2024-09-13T18:39:21.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.437+0000 7f4c27f1d640 1 -- 172.21.15.97:0/4177915678 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4c20064600 con 0x7f4c200a1220 2024-09-13T18:39:21.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.437+0000 7f4c15ffb640 1 -- 172.21.15.97:0/4177915678 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4c1c01a360 con 0x7f4c200a1220 2024-09-13T18:39:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:21.440 INFO:teuthology.orchestra.run.smithi097.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:39:21.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.439+0000 7f4c27f1d640 1 -- 172.21.15.97:0/4177915678 >> v1:172.21.15.97:6816/34603 conn(0x7f4c04031160 legacy=0x7f4c04033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.439+0000 7f4c27f1d640 1 -- 172.21.15.97:0/4177915678 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c200a1220 msgr2=0x7f4c20068220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.439+0000 7f4c27f1d640 1 --2- 172.21.15.97:0/4177915678 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c200a1220 0x7f4c20068220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00c5e0 tx=0x7f4c1c007d00 comp rx=0 tx=0).stop 2024-09-13T18:39:21.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.439+0000 7f4c27f1d640 1 -- 172.21.15.97:0/4177915678 shutdown_connections 2024-09-13T18:39:21.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.439+0000 7f4c27f1d640 1 --2- 172.21.15.97:0/4177915678 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4c2012de60 0x7f4c20068ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.439+0000 7f4c27f1d640 1 --2- 172.21.15.97:0/4177915678 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4c2012d1e0 0x7f4c20068760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.439+0000 7f4c27f1d640 1 --2- 172.21.15.97:0/4177915678 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c200a1220 0x7f4c20068220 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.439+0000 7f4c27f1d640 1 -- 172.21.15.97:0/4177915678 >> 172.21.15.97:0/4177915678 conn(0x7f4c200677e0 msgr2=0x7f4c2009d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:21.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.439+0000 7f4c27f1d640 1 -- 172.21.15.97:0/4177915678 shutdown_connections 2024-09-13T18:39:21.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.439+0000 7f4c27f1d640 1 -- 172.21.15.97:0/4177915678 wait complete. 2024-09-13T18:39:21.452 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:39:21.452 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:21.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.543+0000 7fc6b319d640 1 Processor -- start 2024-09-13T18:39:21.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.543+0000 7fc6b319d640 1 -- start start 2024-09-13T18:39:21.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6b319d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc6ac0a32b0 0x7fc6ac12f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6b319d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6ac069080 0x7fc6ac137770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6b319d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac096b70 con 0x7fc6ac12fed0 2024-09-13T18:39:21.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6b319d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac1302f0 con 0x7fc6ac0a32b0 2024-09-13T18:39:21.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6b319d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0a3680 con 0x7fc6ac069080 2024-09-13T18:39:21.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6b0f39640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc6ac0a32b0 0x7fc6ac12f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6abfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc6ac12fed0 0x7fc6ac068970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47898/0 (socket says 172.21.15.97:47898) 2024-09-13T18:39:21.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6b0f39640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc6ac0a32b0 0x7fc6ac12f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37800/0 (socket says 172.21.15.97:37800) 2024-09-13T18:39:21.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6abfff640 1 -- 172.21.15.97:0/3205023412 learned_addr learned my addr 172.21.15.97:0/3205023412 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:21.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6b173a640 1 --2- 172.21.15.97:0/3205023412 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6ac069080 0x7fc6ac137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6b173a640 1 -- 172.21.15.97:0/3205023412 >> v2:172.21.15.97:3300/0 conn(0x7fc6ac0a32b0 msgr2=0x7fc6ac12f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:21.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6b173a640 1 --2- 172.21.15.97:0/3205023412 >> v2:172.21.15.97:3300/0 conn(0x7fc6ac0a32b0 0x7fc6ac12f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6b173a640 1 -- 172.21.15.97:0/3205023412 >> v1:172.21.15.97:6789/0 conn(0x7fc6ac12fed0 legacy=0x7fc6ac068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6ab7fe640 1 -- 172.21.15.97:0/3205023412 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468587465 0 0) 0x7fc6ac096b70 con 0x7fc6ac12fed0 2024-09-13T18:39:21.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6b173a640 1 -- 172.21.15.97:0/3205023412 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac097460 con 0x7fc6ac069080 2024-09-13T18:39:21.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.544+0000 7fc6b0f39640 1 --2- 172.21.15.97:0/3205023412 >> v2:172.21.15.97:3300/0 conn(0x7fc6ac0a32b0 0x7fc6ac12f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:21.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.545+0000 7fc6b173a640 1 --2- 172.21.15.97:0/3205023412 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6ac069080 0x7fc6ac137770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009850 tx=0x7fc6a40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d813c6ef94877ddc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:21.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.545+0000 7fc6ab7fe640 1 -- 172.21.15.97:0/3205023412 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a402ad00 con 0x7fc6ac069080 2024-09-13T18:39:21.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.545+0000 7fc6ab7fe640 1 -- 172.21.15.97:0/3205023412 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a402ae60 con 0x7fc6ac069080 2024-09-13T18:39:21.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.545+0000 7fc6ab7fe640 1 -- 172.21.15.97:0/3205023412 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4032670 con 0x7fc6ac069080 2024-09-13T18:39:21.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.546+0000 7fc6b319d640 1 -- 172.21.15.97:0/3205023412 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6ac069080 msgr2=0x7fc6ac137770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.546+0000 7fc6b319d640 1 --2- 172.21.15.97:0/3205023412 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6ac069080 0x7fc6ac137770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009850 tx=0x7fc6a40090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.546+0000 7fc6b319d640 1 -- 172.21.15.97:0/3205023412 shutdown_connections 2024-09-13T18:39:21.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.546+0000 7fc6b319d640 1 --2- 172.21.15.97:0/3205023412 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6ac069080 0x7fc6ac137770 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.546+0000 7fc6b319d640 1 --2- 172.21.15.97:0/3205023412 >> v2:172.21.15.97:3300/0 conn(0x7fc6ac0a32b0 0x7fc6ac12f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.546+0000 7fc6b319d640 1 -- 172.21.15.97:0/3205023412 >> 172.21.15.97:0/3205023412 conn(0x7fc6ac06eef0 msgr2=0x7fc6ac0a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:21.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.546+0000 7fc6b319d640 1 -- 172.21.15.97:0/3205023412 shutdown_connections 2024-09-13T18:39:21.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.546+0000 7fc6b319d640 1 -- 172.21.15.97:0/3205023412 wait complete. 2024-09-13T18:39:21.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.546+0000 7fc6b319d640 1 Processor -- start 2024-09-13T18:39:21.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b319d640 1 -- start start 2024-09-13T18:39:21.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b319d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6ac069080 0x7fc6ac11b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b319d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6ac0a32b0 0x7fc6ac11baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b319d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6ac12fed0 0x7fc6ac11c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b319d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac11d620 con 0x7fc6ac069080 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b319d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac11ed10 con 0x7fc6ac12fed0 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b319d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac12db00 con 0x7fc6ac0a32b0 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b0f39640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6ac069080 0x7fc6ac11b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6abfff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6ac0a32b0 0x7fc6ac11baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b0f39640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6ac069080 0x7fc6ac11b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37804/0 (socket says 172.21.15.97:37804) 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b0f39640 1 -- 172.21.15.97:0/2841537448 learned_addr learned my addr 172.21.15.97:0/2841537448 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b173a640 1 --2- 172.21.15.97:0/2841537448 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6ac12fed0 0x7fc6ac11c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b0f39640 1 -- 172.21.15.97:0/2841537448 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6ac0a32b0 msgr2=0x7fc6ac11baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b0f39640 1 --2- 172.21.15.97:0/2841537448 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6ac0a32b0 0x7fc6ac11baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b0f39640 1 -- 172.21.15.97:0/2841537448 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6ac12fed0 msgr2=0x7fc6ac11c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b0f39640 1 --2- 172.21.15.97:0/2841537448 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6ac12fed0 0x7fc6ac11c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6b0f39640 1 -- 172.21.15.97:0/2841537448 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c009390 con 0x7fc6ac069080 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.547+0000 7fc6abfff640 1 --2- 172.21.15.97:0/2841537448 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6ac0a32b0 0x7fc6ac11baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:21.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.548+0000 7fc6b0f39640 1 --2- 172.21.15.97:0/2841537448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6ac069080 0x7fc6ac11b5b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00ec80 tx=0x7fc69c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:21.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.548+0000 7fc6a8ff9640 1 -- 172.21.15.97:0/2841537448 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00eec0 con 0x7fc6ac069080 2024-09-13T18:39:21.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.548+0000 7fc6a8ff9640 1 -- 172.21.15.97:0/2841537448 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00cbc0 con 0x7fc6ac069080 2024-09-13T18:39:21.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.548+0000 7fc6a8ff9640 1 -- 172.21.15.97:0/2841537448 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c013470 con 0x7fc6ac069080 2024-09-13T18:39:21.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.548+0000 7fc6b319d640 1 -- 172.21.15.97:0/2841537448 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a4009390 con 0x7fc6ac069080 2024-09-13T18:39:21.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.548+0000 7fc6b319d640 1 -- 172.21.15.97:0/2841537448 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac11d860 con 0x7fc6ac069080 2024-09-13T18:39:21.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.548+0000 7fc6a8ff9640 1 -- 172.21.15.97:0/2841537448 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fc69c0137e0 con 0x7fc6ac069080 2024-09-13T18:39:21.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.549+0000 7fc6a8ff9640 1 -- 172.21.15.97:0/2841537448 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7fc69c042760 con 0x7fc6ac069080 2024-09-13T18:39:21.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.549+0000 7fc6b319d640 1 -- 172.21.15.97:0/2841537448 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac11ee50 con 0x7fc6ac069080 2024-09-13T18:39:21.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.553+0000 7fc6a8ff9640 1 -- 172.21.15.97:0/2841537448 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fc6ac11ee50 con 0x7fc6ac069080 2024-09-13T18:39:21.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.712+0000 7fc6b319d640 1 -- 172.21.15.97:0/2841537448 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6ac11ee50 con 0x7fc6ac069080 2024-09-13T18:39:21.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.712+0000 7fc6a8ff9640 1 -- 172.21.15.97:0/2841537448 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+11343 (secure 0 0 0) 0x7fc6ac11ee50 con 0x7fc6ac069080 2024-09-13T18:39:21.715 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:21.715 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:14.949504+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:21.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.714+0000 7fc6b319d640 1 -- 172.21.15.97:0/2841537448 >> v1:172.21.15.97:6816/34603 conn(0x7fc698031160 legacy=0x7fc698033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.714+0000 7fc6b319d640 1 -- 172.21.15.97:0/2841537448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6ac069080 msgr2=0x7fc6ac11b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.714+0000 7fc6b319d640 1 --2- 172.21.15.97:0/2841537448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6ac069080 0x7fc6ac11b5b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00ec80 tx=0x7fc69c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.714+0000 7fc6b319d640 1 -- 172.21.15.97:0/2841537448 shutdown_connections 2024-09-13T18:39:21.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.714+0000 7fc6b319d640 1 --2- 172.21.15.97:0/2841537448 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6ac12fed0 0x7fc6ac11c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.714+0000 7fc6b319d640 1 --2- 172.21.15.97:0/2841537448 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6ac0a32b0 0x7fc6ac11baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.714+0000 7fc6b319d640 1 --2- 172.21.15.97:0/2841537448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6ac069080 0x7fc6ac11b5b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.714+0000 7fc6b319d640 1 -- 172.21.15.97:0/2841537448 >> 172.21.15.97:0/2841537448 conn(0x7fc6ac06eef0 msgr2=0x7fc6ac0a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:21.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.714+0000 7fc6b319d640 1 -- 172.21.15.97:0/2841537448 shutdown_connections 2024-09-13T18:39:21.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.714+0000 7fc6b319d640 1 -- 172.21.15.97:0/2841537448 wait complete. 2024-09-13T18:39:21.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:39:01.375967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T18:39:05.732412+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:39:12.014248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:39:12.844264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:39:21.728 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:39:21.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.821+0000 7f5e7809f640 1 Processor -- start 2024-09-13T18:39:21.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.821+0000 7f5e7809f640 1 -- start start 2024-09-13T18:39:21.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e7809f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 0x7f5e70099310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e7809f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5e7009e630 0x7f5e7012c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e7809f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e70098760 con 0x7f5e70099850 2024-09-13T18:39:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e7809f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7009f130 con 0x7f5e7009e630 2024-09-13T18:39:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e7809f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700978d0 con 0x7f5e70098390 2024-09-13T18:39:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e7663c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5e7009e630 0x7f5e7012c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e75e3b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 0x7f5e70099310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e7663c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5e7009e630 0x7f5e7012c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37806/0 (socket says 172.21.15.97:37806) 2024-09-13T18:39:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e75e3b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 0x7f5e70099310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:36026/0 (socket says 172.21.15.97:36026) 2024-09-13T18:39:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e7663c640 1 -- 172.21.15.97:0/3694103835 learned_addr learned my addr 172.21.15.97:0/3694103835 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e7663c640 1 -- 172.21.15.97:0/3694103835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 msgr2=0x7f5e70099310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e7663c640 1 --2- 172.21.15.97:0/3694103835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 0x7f5e70099310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e7663c640 1 -- 172.21.15.97:0/3694103835 >> v1:172.21.15.97:6789/0 conn(0x7f5e70099850 legacy=0x7f5e7012c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e7663c640 1 -- 172.21.15.97:0/3694103835 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e70097b90 con 0x7f5e7009e630 2024-09-13T18:39:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e74e39640 1 -- 172.21.15.97:0/3694103835 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481915408 0 0) 0x7f5e70098760 con 0x7f5e70099850 2024-09-13T18:39:21.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.822+0000 7f5e75e3b640 1 --2- 172.21.15.97:0/3694103835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 0x7f5e70099310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:21.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.823+0000 7f5e7663c640 1 --2- 172.21.15.97:0/3694103835 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e7009e630 0x7f5e7012c760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800bbc0 tx=0x7f5e6800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e649e6b8660c08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:21.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.823+0000 7f5e74e39640 1 -- 172.21.15.97:0/3694103835 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68032590 con 0x7f5e7009e630 2024-09-13T18:39:21.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.823+0000 7f5e74e39640 1 -- 172.21.15.97:0/3694103835 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e680326f0 con 0x7f5e7009e630 2024-09-13T18:39:21.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.823+0000 7f5e74e39640 1 -- 172.21.15.97:0/3694103835 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68032a90 con 0x7f5e7009e630 2024-09-13T18:39:21.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.824+0000 7f5e7809f640 1 -- 172.21.15.97:0/3694103835 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e7009e630 msgr2=0x7f5e7012c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.824+0000 7f5e7809f640 1 --2- 172.21.15.97:0/3694103835 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e7009e630 0x7f5e7012c760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800bbc0 tx=0x7f5e6800b460 comp rx=0 tx=0).stop 2024-09-13T18:39:21.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.824+0000 7f5e7809f640 1 -- 172.21.15.97:0/3694103835 shutdown_connections 2024-09-13T18:39:21.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.824+0000 7f5e7809f640 1 --2- 172.21.15.97:0/3694103835 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e7009e630 0x7f5e7012c760 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.824+0000 7f5e7809f640 1 --2- 172.21.15.97:0/3694103835 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 0x7f5e70099310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.824+0000 7f5e7809f640 1 -- 172.21.15.97:0/3694103835 >> 172.21.15.97:0/3694103835 conn(0x7f5e7005e620 msgr2=0x7f5e7009f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:21.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.824+0000 7f5e7809f640 1 -- 172.21.15.97:0/3694103835 shutdown_connections 2024-09-13T18:39:21.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.824+0000 7f5e7809f640 1 -- 172.21.15.97:0/3694103835 wait complete. 2024-09-13T18:39:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e7809f640 1 Processor -- start 2024-09-13T18:39:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e7809f640 1 -- start start 2024-09-13T18:39:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e7809f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 0x7f5e7013a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e7809f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e70099850 0x7f5e7013aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e7809f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5e7009e630 0x7f5e701173b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e7809f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e70097010 con 0x7f5e70099850 2024-09-13T18:39:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e7809f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7009e340 con 0x7f5e70098390 2024-09-13T18:39:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e7809f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e701199f0 con 0x7f5e7009e630 2024-09-13T18:39:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e75e3b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 0x7f5e7013a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e75e3b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 0x7f5e7013a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:36038/0 (socket says 172.21.15.97:36038) 2024-09-13T18:39:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e75e3b640 1 -- 172.21.15.97:0/2577553538 learned_addr learned my addr 172.21.15.97:0/2577553538 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e7663c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5e7009e630 0x7f5e701173b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e7563a640 1 --2- 172.21.15.97:0/2577553538 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e70099850 0x7f5e7013aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e75e3b640 1 -- 172.21.15.97:0/2577553538 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5e7009e630 msgr2=0x7f5e701173b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e75e3b640 1 --2- 172.21.15.97:0/2577553538 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5e7009e630 0x7f5e701173b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e75e3b640 1 -- 172.21.15.97:0/2577553538 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e70099850 msgr2=0x7f5e7013aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e75e3b640 1 --2- 172.21.15.97:0/2577553538 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e70099850 0x7f5e7013aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e75e3b640 1 -- 172.21.15.97:0/2577553538 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60009a20 con 0x7f5e70098390 2024-09-13T18:39:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.825+0000 7f5e7563a640 1 --2- 172.21.15.97:0/2577553538 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e70099850 0x7f5e7013aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:21.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.826+0000 7f5e75e3b640 1 --2- 172.21.15.97:0/2577553538 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 0x7f5e7013a510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000c170 tx=0x7f5e6000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:21.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.826+0000 7f5e6dffb640 1 -- 172.21.15.97:0/2577553538 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60014480 con 0x7f5e70098390 2024-09-13T18:39:21.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.826+0000 7f5e6dffb640 1 -- 172.21.15.97:0/2577553538 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6000f040 con 0x7f5e70098390 2024-09-13T18:39:21.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.826+0000 7f5e7809f640 1 -- 172.21.15.97:0/2577553538 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6800b700 con 0x7f5e70098390 2024-09-13T18:39:21.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.826+0000 7f5e6dffb640 1 -- 172.21.15.97:0/2577553538 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e600147f0 con 0x7f5e70098390 2024-09-13T18:39:21.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.826+0000 7f5e7809f640 1 -- 172.21.15.97:0/2577553538 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7011a7e0 con 0x7f5e70098390 2024-09-13T18:39:21.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.827+0000 7f5e6dffb640 1 -- 172.21.15.97:0/2577553538 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f5e60014b60 con 0x7f5e70098390 2024-09-13T18:39:21.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.827+0000 7f5e6dffb640 1 -- 172.21.15.97:0/2577553538 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f5e60042e40 con 0x7f5e70098390 2024-09-13T18:39:21.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.827+0000 7f5e7809f640 1 -- 172.21.15.97:0/2577553538 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7013b0b0 con 0x7f5e70098390 2024-09-13T18:39:21.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.831+0000 7f5e6dffb640 1 -- 172.21.15.97:0/2577553538 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f5e6001d400 con 0x7f5e70098390 2024-09-13T18:39:21.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.979+0000 7f5e7809f640 1 -- 172.21.15.97:0/2577553538 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e700714b0 con 0x7f5e70098390 2024-09-13T18:39:21.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.979+0000 7f5e6dffb640 1 -- 172.21.15.97:0/2577553538 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e6002b0a0 con 0x7f5e70098390 2024-09-13T18:39:21.982 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2024-09-13T18:39:21.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.981+0000 7f5e7809f640 1 -- 172.21.15.97:0/2577553538 >> v1:172.21.15.97:6816/34603 conn(0x7f5e5c031160 legacy=0x7f5e5c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.981+0000 7f5e7809f640 1 -- 172.21.15.97:0/2577553538 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 msgr2=0x7f5e7013a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:21.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.981+0000 7f5e7809f640 1 --2- 172.21.15.97:0/2577553538 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 0x7f5e7013a510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000c170 tx=0x7f5e6000b040 comp rx=0 tx=0).stop 2024-09-13T18:39:21.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.981+0000 7f5e7809f640 1 -- 172.21.15.97:0/2577553538 shutdown_connections 2024-09-13T18:39:21.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.981+0000 7f5e7809f640 1 --2- 172.21.15.97:0/2577553538 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5e7009e630 0x7f5e701173b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.981+0000 7f5e7809f640 1 --2- 172.21.15.97:0/2577553538 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e70099850 0x7f5e7013aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.981+0000 7f5e7809f640 1 --2- 172.21.15.97:0/2577553538 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5e70098390 0x7f5e7013a510 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:21.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.981+0000 7f5e7809f640 1 -- 172.21.15.97:0/2577553538 >> 172.21.15.97:0/2577553538 conn(0x7f5e7005e620 msgr2=0x7f5e70129fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:21.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.981+0000 7f5e7809f640 1 -- 172.21.15.97:0/2577553538 shutdown_connections 2024-09-13T18:39:21.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:21.981+0000 7f5e7809f640 1 -- 172.21.15.97:0/2577553538 wait complete. 2024-09-13T18:39:21.994 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-13T18:39:22.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.087+0000 7fa958e20640 1 Processor -- start 2024-09-13T18:39:22.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.087+0000 7fa958e20640 1 -- start start 2024-09-13T18:39:22.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa958e20640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa9540688c0 0x7fa95409d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa958e20640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa95409d2c0 0x7fa95409dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa958e20640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9540975a0 con 0x7fa95412f410 2024-09-13T18:39:22.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa958e20640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa954068c90 con 0x7fa9540688c0 2024-09-13T18:39:22.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa958e20640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa95409ceb0 con 0x7fa95409d2c0 2024-09-13T18:39:22.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa951d9b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa95409d2c0 0x7fa95409dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa95259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa9540688c0 0x7fa95409d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa952d9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa95412f410 0x7fa95412f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47918/0 (socket says 172.21.15.97:47918) 2024-09-13T18:39:22.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa951d9b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa95409d2c0 0x7fa95409dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48252/0 (socket says 172.21.15.97:48252) 2024-09-13T18:39:22.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa952d9d640 1 -- 172.21.15.97:0/518363191 learned_addr learned my addr 172.21.15.97:0/518363191 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:22.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa951d9b640 1 -- 172.21.15.97:0/518363191 >> v2:172.21.15.97:3300/0 conn(0x7fa9540688c0 msgr2=0x7fa95409d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:22.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa951d9b640 1 --2- 172.21.15.97:0/518363191 >> v2:172.21.15.97:3300/0 conn(0x7fa9540688c0 0x7fa95409d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa951d9b640 1 -- 172.21.15.97:0/518363191 >> v1:172.21.15.97:6789/0 conn(0x7fa95412f410 legacy=0x7fa95412f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa951d9b640 1 -- 172.21.15.97:0/518363191 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa954069200 con 0x7fa95409d2c0 2024-09-13T18:39:22.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.088+0000 7fa95259c640 1 --2- 172.21.15.97:0/518363191 >> v2:172.21.15.97:3300/0 conn(0x7fa9540688c0 0x7fa95409d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:22.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.089+0000 7fa951d9b640 1 --2- 172.21.15.97:0/518363191 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa95409d2c0 0x7fa95409dd00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009880 tx=0x7fa93c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5748a9e969f4fa20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:22.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.089+0000 7fa95159a640 1 -- 172.21.15.97:0/518363191 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c02ac50 con 0x7fa95409d2c0 2024-09-13T18:39:22.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.089+0000 7fa95159a640 1 -- 172.21.15.97:0/518363191 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c02adb0 con 0x7fa95409d2c0 2024-09-13T18:39:22.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.089+0000 7fa95159a640 1 -- 172.21.15.97:0/518363191 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c032670 con 0x7fa95409d2c0 2024-09-13T18:39:22.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.090+0000 7fa958e20640 1 -- 172.21.15.97:0/518363191 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa95409d2c0 msgr2=0x7fa95409dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.090+0000 7fa958e20640 1 --2- 172.21.15.97:0/518363191 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa95409d2c0 0x7fa95409dd00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009880 tx=0x7fa93c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.090+0000 7fa958e20640 1 -- 172.21.15.97:0/518363191 shutdown_connections 2024-09-13T18:39:22.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.090+0000 7fa958e20640 1 --2- 172.21.15.97:0/518363191 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa95409d2c0 0x7fa95409dd00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.090+0000 7fa958e20640 1 --2- 172.21.15.97:0/518363191 >> v2:172.21.15.97:3300/0 conn(0x7fa9540688c0 0x7fa95409d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.090+0000 7fa958e20640 1 -- 172.21.15.97:0/518363191 >> 172.21.15.97:0/518363191 conn(0x7fa95406f310 msgr2=0x7fa9540a29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:22.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.090+0000 7fa958e20640 1 -- 172.21.15.97:0/518363191 shutdown_connections 2024-09-13T18:39:22.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.090+0000 7fa958e20640 1 -- 172.21.15.97:0/518363191 wait complete. 2024-09-13T18:39:22.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.090+0000 7fa958e20640 1 Processor -- start 2024-09-13T18:39:22.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa958e20640 1 -- start start 2024-09-13T18:39:22.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa958e20640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9540688c0 0x7fa95413eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa958e20640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa95409d2c0 0x7fa95413f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa958e20640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa95412f410 0x7fa95413f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa958e20640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95411cb10 con 0x7fa9540688c0 2024-09-13T18:39:22.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa958e20640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95411d9f0 con 0x7fa95409d2c0 2024-09-13T18:39:22.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa958e20640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa95411df50 con 0x7fa95412f410 2024-09-13T18:39:22.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa95259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9540688c0 0x7fa95413eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa952d9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa95412f410 0x7fa95413f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa95259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9540688c0 0x7fa95413eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37820/0 (socket says 172.21.15.97:37820) 2024-09-13T18:39:22.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa95259c640 1 -- 172.21.15.97:0/1688964314 learned_addr learned my addr 172.21.15.97:0/1688964314 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:22.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa951d9b640 1 --2- 172.21.15.97:0/1688964314 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa95409d2c0 0x7fa95413f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa95259c640 1 -- 172.21.15.97:0/1688964314 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa95412f410 msgr2=0x7fa95413f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa95259c640 1 --2- 172.21.15.97:0/1688964314 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa95412f410 0x7fa95413f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa95259c640 1 -- 172.21.15.97:0/1688964314 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa95409d2c0 msgr2=0x7fa95413f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa95259c640 1 --2- 172.21.15.97:0/1688964314 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa95409d2c0 0x7fa95413f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa95259c640 1 -- 172.21.15.97:0/1688964314 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa944009a20 con 0x7fa9540688c0 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa952d9d640 1 --2- 172.21.15.97:0/1688964314 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa95412f410 0x7fa95413f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.091+0000 7fa95259c640 1 --2- 172.21.15.97:0/1688964314 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9540688c0 0x7fa95413eb70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa94400c170 tx=0x7fa94400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.092+0000 7fa94a7fc640 1 -- 172.21.15.97:0/1688964314 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944014480 con 0x7fa9540688c0 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.092+0000 7fa94a7fc640 1 -- 172.21.15.97:0/1688964314 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94400f040 con 0x7fa9540688c0 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.092+0000 7fa958e20640 1 -- 172.21.15.97:0/1688964314 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa93c009390 con 0x7fa9540688c0 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.092+0000 7fa94a7fc640 1 -- 172.21.15.97:0/1688964314 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440147f0 con 0x7fa9540688c0 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.092+0000 7fa958e20640 1 -- 172.21.15.97:0/1688964314 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa95411c320 con 0x7fa9540688c0 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.092+0000 7fa94a7fc640 1 -- 172.21.15.97:0/1688964314 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fa944014b60 con 0x7fa9540688c0 2024-09-13T18:39:22.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.093+0000 7fa94a7fc640 1 -- 172.21.15.97:0/1688964314 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7fa944042fc0 con 0x7fa9540688c0 2024-09-13T18:39:22.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.093+0000 7fa958e20640 1 -- 172.21.15.97:0/1688964314 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9540714b0 con 0x7fa9540688c0 2024-09-13T18:39:22.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.097+0000 7fa94a7fc640 1 -- 172.21.15.97:0/1688964314 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fa944024500 con 0x7fa9540688c0 2024-09-13T18:39:22.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.247+0000 7fa958e20640 1 -- 172.21.15.97:0/1688964314 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa95405e0d0 con 0x7fa9540688c0 2024-09-13T18:39:22.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.247+0000 7fa94a7fc640 1 -- 172.21.15.97:0/1688964314 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa944007e60 con 0x7fa9540688c0 2024-09-13T18:39:22.250 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 8 2024-09-13T18:39:22.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.249+0000 7fa958e20640 1 -- 172.21.15.97:0/1688964314 >> v1:172.21.15.97:6816/34603 conn(0x7fa934031160 legacy=0x7fa934033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.249+0000 7fa958e20640 1 -- 172.21.15.97:0/1688964314 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9540688c0 msgr2=0x7fa95413eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.249+0000 7fa958e20640 1 --2- 172.21.15.97:0/1688964314 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9540688c0 0x7fa95413eb70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa94400c170 tx=0x7fa94400b040 comp rx=0 tx=0).stop 2024-09-13T18:39:22.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.249+0000 7fa958e20640 1 -- 172.21.15.97:0/1688964314 shutdown_connections 2024-09-13T18:39:22.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.249+0000 7fa958e20640 1 --2- 172.21.15.97:0/1688964314 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa95412f410 0x7fa95413f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.249+0000 7fa958e20640 1 --2- 172.21.15.97:0/1688964314 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa95409d2c0 0x7fa95413f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.249+0000 7fa958e20640 1 --2- 172.21.15.97:0/1688964314 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9540688c0 0x7fa95413eb70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.249+0000 7fa958e20640 1 -- 172.21.15.97:0/1688964314 >> 172.21.15.97:0/1688964314 conn(0x7fa95406f310 msgr2=0x7fa954132520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:22.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.249+0000 7fa958e20640 1 -- 172.21.15.97:0/1688964314 shutdown_connections 2024-09-13T18:39:22.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.249+0000 7fa958e20640 1 -- 172.21.15.97:0/1688964314 wait complete. 2024-09-13T18:39:22.262 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:39:22.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.355+0000 7f8f07ce8640 1 Processor -- start 2024-09-13T18:39:22.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.355+0000 7f8f07ce8640 1 -- start start 2024-09-13T18:39:22.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.355+0000 7f8f07ce8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8f00067110 0x7f8f0009a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.355+0000 7f8f07ce8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f0009ab50 0x7f8f0012f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.355+0000 7f8f07ce8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f00067b30 con 0x7f8f0009af20 2024-09-13T18:39:22.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.355+0000 7f8f07ce8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f000674e0 con 0x7f8f00067110 2024-09-13T18:39:22.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.355+0000 7f8f07ce8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0009b640 con 0x7f8f0009ab50 2024-09-13T18:39:22.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.355+0000 7f8f05a84640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8f00067110 0x7f8f0009a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.355+0000 7f8f05283640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f0009ab50 0x7f8f0012f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.356+0000 7f8f05a84640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8f00067110 0x7f8f0009a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37828/0 (socket says 172.21.15.97:37828) 2024-09-13T18:39:22.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.356+0000 7f8f05283640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f0009ab50 0x7f8f0012f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48270/0 (socket says 172.21.15.97:48270) 2024-09-13T18:39:22.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.356+0000 7f8f06285640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f8f0009af20 0x7f8f0012fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47920/0 (socket says 172.21.15.97:47920) 2024-09-13T18:39:22.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.356+0000 7f8f05a84640 1 -- 172.21.15.97:0/2148995376 learned_addr learned my addr 172.21.15.97:0/2148995376 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:22.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.356+0000 7f8f05283640 1 -- 172.21.15.97:0/2148995376 >> v2:172.21.15.97:3300/0 conn(0x7f8f00067110 msgr2=0x7f8f0009a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:22.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.356+0000 7f8f05283640 1 --2- 172.21.15.97:0/2148995376 >> v2:172.21.15.97:3300/0 conn(0x7f8f00067110 0x7f8f0009a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.356+0000 7f8f05283640 1 -- 172.21.15.97:0/2148995376 >> v1:172.21.15.97:6789/0 conn(0x7f8f0009af20 legacy=0x7f8f0012fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.356+0000 7f8f05283640 1 -- 172.21.15.97:0/2148995376 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00067f20 con 0x7f8f0009ab50 2024-09-13T18:39:22.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.356+0000 7f8f05a84640 1 --2- 172.21.15.97:0/2148995376 >> v2:172.21.15.97:3300/0 conn(0x7f8f00067110 0x7f8f0009a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:22.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.357+0000 7f8f05283640 1 --2- 172.21.15.97:0/2148995376 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f0009ab50 0x7f8f0012f6d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009850 tx=0x7f8ef00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc5eb642eaa7c6c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:22.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.357+0000 7f8f04a82640 1 -- 172.21.15.97:0/2148995376 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef002ad00 con 0x7f8f0009ab50 2024-09-13T18:39:22.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.357+0000 7f8f04a82640 1 -- 172.21.15.97:0/2148995376 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef002ae60 con 0x7f8f0009ab50 2024-09-13T18:39:22.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.357+0000 7f8f04a82640 1 -- 172.21.15.97:0/2148995376 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0032670 con 0x7f8f0009ab50 2024-09-13T18:39:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.357+0000 7f8f07ce8640 1 -- 172.21.15.97:0/2148995376 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f0009ab50 msgr2=0x7f8f0012f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.357+0000 7f8f07ce8640 1 --2- 172.21.15.97:0/2148995376 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f0009ab50 0x7f8f0012f6d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009850 tx=0x7f8ef00090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.357+0000 7f8f07ce8640 1 -- 172.21.15.97:0/2148995376 shutdown_connections 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.357+0000 7f8f07ce8640 1 --2- 172.21.15.97:0/2148995376 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f0009ab50 0x7f8f0012f6d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.357+0000 7f8f07ce8640 1 --2- 172.21.15.97:0/2148995376 >> v2:172.21.15.97:3300/0 conn(0x7f8f00067110 0x7f8f0009a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.357+0000 7f8f07ce8640 1 -- 172.21.15.97:0/2148995376 >> 172.21.15.97:0/2148995376 conn(0x7f8f0009f790 msgr2=0x7f8f0009fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.357+0000 7f8f07ce8640 1 -- 172.21.15.97:0/2148995376 shutdown_connections 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.357+0000 7f8f07ce8640 1 -- 172.21.15.97:0/2148995376 wait complete. 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.358+0000 7f8f07ce8640 1 Processor -- start 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.358+0000 7f8f07ce8640 1 -- start start 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f07ce8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f00067110 0x7f8f001326c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f07ce8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f0009ab50 0x7f8f00132c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f07ce8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0009af20 0x7f8f0013ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f07ce8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0012d1d0 con 0x7f8f0009ab50 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f07ce8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0009df20 con 0x7f8f0009af20 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f07ce8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0009bb10 con 0x7f8f00067110 2024-09-13T18:39:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f05a84640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f00067110 0x7f8f001326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f05a84640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f00067110 0x7f8f001326c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48284/0 (socket says 172.21.15.97:48284) 2024-09-13T18:39:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f05a84640 1 -- 172.21.15.97:0/4223898333 learned_addr learned my addr 172.21.15.97:0/4223898333 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f05283640 1 --2- 172.21.15.97:0/4223898333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f0009ab50 0x7f8f00132c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f06285640 1 --2- 172.21.15.97:0/4223898333 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0009af20 0x7f8f0013ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f05a84640 1 -- 172.21.15.97:0/4223898333 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0009af20 msgr2=0x7f8f0013ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f05a84640 1 --2- 172.21.15.97:0/4223898333 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0009af20 0x7f8f0013ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f05a84640 1 -- 172.21.15.97:0/4223898333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f0009ab50 msgr2=0x7f8f00132c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f05a84640 1 --2- 172.21.15.97:0/4223898333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f0009ab50 0x7f8f00132c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f05a84640 1 -- 172.21.15.97:0/4223898333 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc009450 con 0x7f8f00067110 2024-09-13T18:39:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f05a84640 1 --2- 172.21.15.97:0/4223898333 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f00067110 0x7f8f001326c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00ea60 tx=0x7f8efc0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8ef5ffb640 1 -- 172.21.15.97:0/4223898333 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc009690 con 0x7f8f00067110 2024-09-13T18:39:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8ef5ffb640 1 -- 172.21.15.97:0/4223898333 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc00ca10 con 0x7f8f00067110 2024-09-13T18:39:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8ef5ffb640 1 -- 172.21.15.97:0/4223898333 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00cdb0 con 0x7f8f00067110 2024-09-13T18:39:22.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.359+0000 7f8f07ce8640 1 -- 172.21.15.97:0/4223898333 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef0009390 con 0x7f8f00067110 2024-09-13T18:39:22.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.360+0000 7f8f07ce8640 1 -- 172.21.15.97:0/4223898333 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0011a3b0 con 0x7f8f00067110 2024-09-13T18:39:22.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.360+0000 7f8ef5ffb640 1 -- 172.21.15.97:0/4223898333 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f8efc013680 con 0x7f8f00067110 2024-09-13T18:39:22.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.360+0000 7f8ef5ffb640 1 -- 172.21.15.97:0/4223898333 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f8efc0424b0 con 0x7f8f00067110 2024-09-13T18:39:22.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.360+0000 7f8f07ce8640 1 -- 172.21.15.97:0/4223898333 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f00064000 con 0x7f8f00067110 2024-09-13T18:39:22.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.365+0000 7f8ef5ffb640 1 -- 172.21.15.97:0/4223898333 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f8efc023ad0 con 0x7f8f00067110 2024-09-13T18:39:22.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.515+0000 7f8f07ce8640 1 -- 172.21.15.97:0/4223898333 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f0006f720 con 0x7f8f00067110 2024-09-13T18:39:22.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.515+0000 7f8ef5ffb640 1 -- 172.21.15.97:0/4223898333 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8efc0232f0 con 0x7f8f00067110 2024-09-13T18:39:22.518 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2024-09-13T18:39:22.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.517+0000 7f8f07ce8640 1 -- 172.21.15.97:0/4223898333 >> v1:172.21.15.97:6816/34603 conn(0x7f8ee4031160 legacy=0x7f8ee4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.517+0000 7f8f07ce8640 1 -- 172.21.15.97:0/4223898333 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f00067110 msgr2=0x7f8f001326c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.517+0000 7f8f07ce8640 1 --2- 172.21.15.97:0/4223898333 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f00067110 0x7f8f001326c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00ea60 tx=0x7f8efc0091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.517+0000 7f8f07ce8640 1 -- 172.21.15.97:0/4223898333 shutdown_connections 2024-09-13T18:39:22.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.517+0000 7f8f07ce8640 1 --2- 172.21.15.97:0/4223898333 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8f0009af20 0x7f8f0013ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.517+0000 7f8f07ce8640 1 --2- 172.21.15.97:0/4223898333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f0009ab50 0x7f8f00132c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.517+0000 7f8f07ce8640 1 --2- 172.21.15.97:0/4223898333 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8f00067110 0x7f8f001326c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.517+0000 7f8f07ce8640 1 -- 172.21.15.97:0/4223898333 >> 172.21.15.97:0/4223898333 conn(0x7f8f0009f790 msgr2=0x7f8f00098a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:22.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.517+0000 7f8f07ce8640 1 -- 172.21.15.97:0/4223898333 shutdown_connections 2024-09-13T18:39:22.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.517+0000 7f8f07ce8640 1 -- 172.21.15.97:0/4223898333 wait complete. 2024-09-13T18:39:22.530 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:39:22.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fad59d640 1 Processor -- start 2024-09-13T18:39:22.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fad59d640 1 -- start start 2024-09-13T18:39:22.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fad59d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fa80699a0 0x7f8fa809edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fad59d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 0x7f8fa809f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fad59d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8fa812f450 0x7f8fa812f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fad59d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa8069d70 con 0x7f8fa812f450 2024-09-13T18:39:22.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fad59d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8068ee0 con 0x7f8fa80699a0 2024-09-13T18:39:22.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fad59d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80684a0 con 0x7f8fa809f330 2024-09-13T18:39:22.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fa67fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 0x7f8fa809f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fa6ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fa80699a0 0x7f8fa809edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fa77fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8fa812f450 0x7f8fa812f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fa67fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 0x7f8fa809f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48288/0 (socket says 172.21.15.97:48288) 2024-09-13T18:39:22.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fa6ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fa80699a0 0x7f8fa809edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:36066/0 (socket says 172.21.15.97:36066) 2024-09-13T18:39:22.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.627+0000 7f8fa67fc640 1 -- 172.21.15.97:0/3166965764 learned_addr learned my addr 172.21.15.97:0/3166965764 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:22.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.628+0000 7f8fa6ffd640 1 -- 172.21.15.97:0/3166965764 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 msgr2=0x7f8fa809f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:22.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.628+0000 7f8fa6ffd640 1 --2- 172.21.15.97:0/3166965764 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 0x7f8fa809f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.628+0000 7f8fa6ffd640 1 -- 172.21.15.97:0/3166965764 >> v2:172.21.15.97:3300/0 conn(0x7f8fa812f450 msgr2=0x7f8fa812f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:22.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.628+0000 7f8fa6ffd640 1 --2- 172.21.15.97:0/3166965764 >> v2:172.21.15.97:3300/0 conn(0x7f8fa812f450 0x7f8fa812f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.628+0000 7f8fa6ffd640 1 -- 172.21.15.97:0/3166965764 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa806a060 con 0x7f8fa80699a0 2024-09-13T18:39:22.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.628+0000 7f8fa67fc640 1 --2- 172.21.15.97:0/3166965764 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 0x7f8fa809f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:22.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.628+0000 7f8fa77fe640 1 --2- 172.21.15.97:0/3166965764 >> v2:172.21.15.97:3300/0 conn(0x7f8fa812f450 0x7f8fa812f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:22.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.628+0000 7f8fa6ffd640 1 --2- 172.21.15.97:0/3166965764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fa80699a0 0x7f8fa809edf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8f98009850 tx=0x7f8f980090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=981a45ca69513399 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:22.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.629+0000 7f8fa5ffb640 1 -- 172.21.15.97:0/3166965764 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9802ac50 con 0x7f8fa80699a0 2024-09-13T18:39:22.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.629+0000 7f8fa5ffb640 1 -- 172.21.15.97:0/3166965764 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9802adb0 con 0x7f8fa80699a0 2024-09-13T18:39:22.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.629+0000 7f8fa5ffb640 1 -- 172.21.15.97:0/3166965764 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f98032670 con 0x7f8fa80699a0 2024-09-13T18:39:22.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.629+0000 7f8fad59d640 1 -- 172.21.15.97:0/3166965764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fa80699a0 msgr2=0x7f8fa809edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.629+0000 7f8fad59d640 1 --2- 172.21.15.97:0/3166965764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fa80699a0 0x7f8fa809edf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8f98009850 tx=0x7f8f980090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.629+0000 7f8fad59d640 1 -- 172.21.15.97:0/3166965764 shutdown_connections 2024-09-13T18:39:22.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.629+0000 7f8fad59d640 1 --2- 172.21.15.97:0/3166965764 >> v2:172.21.15.97:3300/0 conn(0x7f8fa812f450 0x7f8fa812f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.629+0000 7f8fad59d640 1 --2- 172.21.15.97:0/3166965764 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 0x7f8fa809f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.629+0000 7f8fad59d640 1 --2- 172.21.15.97:0/3166965764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fa80699a0 0x7f8fa809edf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.629+0000 7f8fad59d640 1 -- 172.21.15.97:0/3166965764 >> 172.21.15.97:0/3166965764 conn(0x7f8fa8067b70 msgr2=0x7f8fa80a0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:22.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.629+0000 7f8fad59d640 1 -- 172.21.15.97:0/3166965764 shutdown_connections 2024-09-13T18:39:22.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.629+0000 7f8fad59d640 1 -- 172.21.15.97:0/3166965764 wait complete. 2024-09-13T18:39:22.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.630+0000 7f8fad59d640 1 Processor -- start 2024-09-13T18:39:22.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.630+0000 7f8fad59d640 1 -- start start 2024-09-13T18:39:22.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.630+0000 7f8fad59d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fa80699a0 0x7f8fa8118d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.630+0000 7f8fad59d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 0x7f8fa81192a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.630+0000 7f8fad59d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fa812f450 0x7f8fa813ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.630+0000 7f8fad59d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8068900 con 0x7f8fa80699a0 2024-09-13T18:39:22.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.630+0000 7f8fad59d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa811bb30 con 0x7f8fa812f450 2024-09-13T18:39:22.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.630+0000 7f8fad59d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8118ac0 con 0x7f8fa809f330 2024-09-13T18:39:22.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fa67fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 0x7f8fa81192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fa6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fa80699a0 0x7f8fa8118d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fa77fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fa812f450 0x7f8fa813ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fa67fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 0x7f8fa81192a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48300/0 (socket says 172.21.15.97:48300) 2024-09-13T18:39:22.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fa67fc640 1 -- 172.21.15.97:0/2622171160 learned_addr learned my addr 172.21.15.97:0/2622171160 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:22.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fa67fc640 1 -- 172.21.15.97:0/2622171160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fa812f450 msgr2=0x7f8fa813ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fa67fc640 1 --2- 172.21.15.97:0/2622171160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fa812f450 0x7f8fa813ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fa67fc640 1 -- 172.21.15.97:0/2622171160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fa80699a0 msgr2=0x7f8fa8118d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fa67fc640 1 --2- 172.21.15.97:0/2622171160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fa80699a0 0x7f8fa8118d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fa67fc640 1 -- 172.21.15.97:0/2622171160 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c009450 con 0x7f8fa809f330 2024-09-13T18:39:22.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fa6ffd640 1 --2- 172.21.15.97:0/2622171160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fa80699a0 0x7f8fa8118d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:22.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fa77fe640 1 --2- 172.21.15.97:0/2622171160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fa812f450 0x7f8fa813ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:22.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fa67fc640 1 --2- 172.21.15.97:0/2622171160 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 0x7f8fa81192a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00ec80 tx=0x7f8f9c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:22.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8f8effd640 1 -- 172.21.15.97:0/2622171160 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00eec0 con 0x7f8fa809f330 2024-09-13T18:39:22.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8f8effd640 1 -- 172.21.15.97:0/2622171160 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c00cb00 con 0x7f8fa809f330 2024-09-13T18:39:22.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8f8effd640 1 -- 172.21.15.97:0/2622171160 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00ce80 con 0x7f8fa809f330 2024-09-13T18:39:22.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fad59d640 1 -- 172.21.15.97:0/2622171160 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa0009a20 con 0x7f8fa809f330 2024-09-13T18:39:22.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.631+0000 7f8fad59d640 1 -- 172.21.15.97:0/2622171160 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f98009390 con 0x7f8fa809f330 2024-09-13T18:39:22.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.632+0000 7f8f8effd640 1 -- 172.21.15.97:0/2622171160 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f8f9c013680 con 0x7f8fa809f330 2024-09-13T18:39:22.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.632+0000 7f8f8effd640 1 -- 172.21.15.97:0/2622171160 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f8f9c042430 con 0x7f8fa809f330 2024-09-13T18:39:22.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.632+0000 7f8fad59d640 1 -- 172.21.15.97:0/2622171160 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa80714b0 con 0x7f8fa809f330 2024-09-13T18:39:22.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.637+0000 7f8f8effd640 1 -- 172.21.15.97:0/2622171160 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f8f9c023ad0 con 0x7f8fa809f330 2024-09-13T18:39:22.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.790+0000 7f8fad59d640 1 -- 172.21.15.97:0/2622171160 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8fa806d0a0 con 0x7f8fa809f330 2024-09-13T18:39:22.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.790+0000 7f8f8effd640 1 -- 172.21.15.97:0/2622171160 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f9c0232f0 con 0x7f8fa809f330 2024-09-13T18:39:22.793 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2024-09-13T18:39:22.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.792+0000 7f8fad59d640 1 -- 172.21.15.97:0/2622171160 >> v1:172.21.15.97:6816/34603 conn(0x7f8f94031160 legacy=0x7f8f94033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.792+0000 7f8fad59d640 1 -- 172.21.15.97:0/2622171160 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 msgr2=0x7f8fa81192a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.792+0000 7f8fad59d640 1 --2- 172.21.15.97:0/2622171160 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 0x7f8fa81192a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00ec80 tx=0x7f8f9c0091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.792+0000 7f8fad59d640 1 -- 172.21.15.97:0/2622171160 shutdown_connections 2024-09-13T18:39:22.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.792+0000 7f8fad59d640 1 --2- 172.21.15.97:0/2622171160 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fa812f450 0x7f8fa813ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.792+0000 7f8fad59d640 1 --2- 172.21.15.97:0/2622171160 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fa809f330 0x7f8fa81192a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.792+0000 7f8fad59d640 1 --2- 172.21.15.97:0/2622171160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fa80699a0 0x7f8fa8118d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.792+0000 7f8fad59d640 1 -- 172.21.15.97:0/2622171160 >> 172.21.15.97:0/2622171160 conn(0x7f8fa8067b70 msgr2=0x7f8fa812e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:22.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.792+0000 7f8fad59d640 1 -- 172.21.15.97:0/2622171160 shutdown_connections 2024-09-13T18:39:22.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.792+0000 7f8fad59d640 1 -- 172.21.15.97:0/2622171160 wait complete. 2024-09-13T18:39:22.805 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:39:22.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.896+0000 7fa93de2b640 1 Processor -- start 2024-09-13T18:39:22.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.896+0000 7fa93de2b640 1 -- start start 2024-09-13T18:39:22.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.896+0000 7fa93de2b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 0x7fa938099370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.896+0000 7fa93de2b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa9380998b0 0x7fa938099ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.896+0000 7fa93de2b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93809a1e0 con 0x7fa93812d260 2024-09-13T18:39:22.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.896+0000 7fa93de2b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93809b410 con 0x7fa9380998b0 2024-09-13T18:39:22.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.896+0000 7fa93de2b640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa93806b780 con 0x7fa93809b040 2024-09-13T18:39:22.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.896+0000 7fa9377fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 0x7fa938099370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.896+0000 7fa936ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa9380998b0 0x7fa938099ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.896+0000 7fa9377fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 0x7fa938099370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48302/0 (socket says 172.21.15.97:48302) 2024-09-13T18:39:22.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.896+0000 7fa937fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa93812d260 0x7fa93812d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47934/0 (socket says 172.21.15.97:47934) 2024-09-13T18:39:22.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.896+0000 7fa936ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa9380998b0 0x7fa938099ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37866/0 (socket says 172.21.15.97:37866) 2024-09-13T18:39:22.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.896+0000 7fa9377fe640 1 -- 172.21.15.97:0/3959530804 learned_addr learned my addr 172.21.15.97:0/3959530804 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:22.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.897+0000 7fa936ffd640 1 -- 172.21.15.97:0/3959530804 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 msgr2=0x7fa938099370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:22.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.897+0000 7fa936ffd640 1 --2- 172.21.15.97:0/3959530804 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 0x7fa938099370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.897+0000 7fa936ffd640 1 -- 172.21.15.97:0/3959530804 >> v1:172.21.15.97:6789/0 conn(0x7fa93812d260 legacy=0x7fa93812d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.897+0000 7fa936ffd640 1 -- 172.21.15.97:0/3959530804 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93806a620 con 0x7fa9380998b0 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.897+0000 7fa9367fc640 1 -- 172.21.15.97:0/3959530804 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711568202 0 0) 0x7fa930001490 con 0x7fa93812d260 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.897+0000 7fa9377fe640 1 --2- 172.21.15.97:0/3959530804 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 0x7fa938099370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.897+0000 7fa936ffd640 1 --2- 172.21.15.97:0/3959530804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9380998b0 0x7fa938099ca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009850 tx=0x7fa92c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242518106e09ccff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.897+0000 7fa9367fc640 1 -- 172.21.15.97:0/3959530804 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c02ad00 con 0x7fa9380998b0 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.898+0000 7fa9367fc640 1 -- 172.21.15.97:0/3959530804 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92c02ae60 con 0x7fa9380998b0 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.898+0000 7fa9367fc640 1 -- 172.21.15.97:0/3959530804 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c032670 con 0x7fa9380998b0 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.898+0000 7fa93de2b640 1 -- 172.21.15.97:0/3959530804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9380998b0 msgr2=0x7fa938099ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.898+0000 7fa93de2b640 1 --2- 172.21.15.97:0/3959530804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9380998b0 0x7fa938099ca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009850 tx=0x7fa92c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.898+0000 7fa93de2b640 1 -- 172.21.15.97:0/3959530804 shutdown_connections 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.898+0000 7fa93de2b640 1 --2- 172.21.15.97:0/3959530804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9380998b0 0x7fa938099ca0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.898+0000 7fa93de2b640 1 --2- 172.21.15.97:0/3959530804 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 0x7fa938099370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.898+0000 7fa93de2b640 1 -- 172.21.15.97:0/3959530804 >> 172.21.15.97:0/3959530804 conn(0x7fa93805e5d0 msgr2=0x7fa93809ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:22.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.898+0000 7fa93de2b640 1 -- 172.21.15.97:0/3959530804 shutdown_connections 2024-09-13T18:39:22.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.898+0000 7fa93de2b640 1 -- 172.21.15.97:0/3959530804 wait complete. 2024-09-13T18:39:22.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.899+0000 7fa93de2b640 1 Processor -- start 2024-09-13T18:39:22.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.899+0000 7fa93de2b640 1 -- start start 2024-09-13T18:39:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.899+0000 7fa93de2b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9380998b0 0x7fa93811c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.899+0000 7fa93de2b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 0x7fa938118f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.899+0000 7fa93de2b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa93812d260 0x7fa938119450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.899+0000 7fa93de2b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93806ea60 con 0x7fa9380998b0 2024-09-13T18:39:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.899+0000 7fa93de2b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93811bb40 con 0x7fa93812d260 2024-09-13T18:39:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.899+0000 7fa93de2b640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa93811a1d0 con 0x7fa93809b040 2024-09-13T18:39:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa936ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 0x7fa938118f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa9377fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9380998b0 0x7fa93811c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa936ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 0x7fa938118f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48316/0 (socket says 172.21.15.97:48316) 2024-09-13T18:39:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa9377fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9380998b0 0x7fa93811c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37874/0 (socket says 172.21.15.97:37874) 2024-09-13T18:39:22.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa936ffd640 1 -- 172.21.15.97:0/3453887522 learned_addr learned my addr 172.21.15.97:0/3453887522 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa937fff640 1 --2- 172.21.15.97:0/3453887522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa93812d260 0x7fa938119450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa9377fe640 1 -- 172.21.15.97:0/3453887522 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 msgr2=0x7fa938118f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa9377fe640 1 --2- 172.21.15.97:0/3453887522 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 0x7fa938118f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa9377fe640 1 -- 172.21.15.97:0/3453887522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa93812d260 msgr2=0x7fa938119450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa9377fe640 1 --2- 172.21.15.97:0/3453887522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa93812d260 0x7fa938119450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa9377fe640 1 -- 172.21.15.97:0/3453887522 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa928009450 con 0x7fa9380998b0 2024-09-13T18:39:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa936ffd640 1 --2- 172.21.15.97:0/3453887522 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 0x7fa938118f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa9377fe640 1 --2- 172.21.15.97:0/3453887522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9380998b0 0x7fa93811c5e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa928010db0 tx=0x7fa9280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa91f7fe640 1 -- 172.21.15.97:0/3453887522 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa928015070 con 0x7fa9380998b0 2024-09-13T18:39:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa91f7fe640 1 -- 172.21.15.97:0/3453887522 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa928009680 con 0x7fa9380998b0 2024-09-13T18:39:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa93de2b640 1 -- 172.21.15.97:0/3453887522 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92c009390 con 0x7fa9380998b0 2024-09-13T18:39:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa91f7fe640 1 -- 172.21.15.97:0/3453887522 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa928019450 con 0x7fa9380998b0 2024-09-13T18:39:22.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.900+0000 7fa93de2b640 1 -- 172.21.15.97:0/3453887522 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa938119990 con 0x7fa9380998b0 2024-09-13T18:39:22.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.901+0000 7fa91f7fe640 1 -- 172.21.15.97:0/3453887522 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fa928005970 con 0x7fa9380998b0 2024-09-13T18:39:22.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.901+0000 7fa91f7fe640 1 -- 172.21.15.97:0/3453887522 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7fa928045e20 con 0x7fa9380998b0 2024-09-13T18:39:22.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.901+0000 7fa93de2b640 1 -- 172.21.15.97:0/3453887522 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa938071440 con 0x7fa9380998b0 2024-09-13T18:39:22.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:22.906+0000 7fa91f7fe640 1 -- 172.21.15.97:0/3453887522 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fa92801e030 con 0x7fa9380998b0 2024-09-13T18:39:23.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.087+0000 7fa93de2b640 1 -- 172.21.15.97:0/3453887522 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa93811bd60 con 0x7fa9380998b0 2024-09-13T18:39:23.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.088+0000 7fa91f7fe640 1 -- 172.21.15.97:0/3453887522 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2264 (secure 0 0 0) 0x7fa92801e020 con 0x7fa9380998b0 2024-09-13T18:39:23.090 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:23.091 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:13.885647+0000","modified":"2024-09-13T18:39:16.567097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6817/3890865357","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6817","nonce":3890865357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-09-13T18:39:23.091 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 5 2024-09-13T18:39:23.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.090+0000 7fa93de2b640 1 -- 172.21.15.97:0/3453887522 >> v1:172.21.15.97:6816/34603 conn(0x7fa924031160 legacy=0x7fa924033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.090+0000 7fa93de2b640 1 -- 172.21.15.97:0/3453887522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9380998b0 msgr2=0x7fa93811c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.090+0000 7fa93de2b640 1 --2- 172.21.15.97:0/3453887522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9380998b0 0x7fa93811c5e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa928010db0 tx=0x7fa9280091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.090+0000 7fa93de2b640 1 -- 172.21.15.97:0/3453887522 shutdown_connections 2024-09-13T18:39:23.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.090+0000 7fa93de2b640 1 --2- 172.21.15.97:0/3453887522 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa93812d260 0x7fa938119450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.090+0000 7fa93de2b640 1 --2- 172.21.15.97:0/3453887522 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa93809b040 0x7fa938118f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.090+0000 7fa93de2b640 1 --2- 172.21.15.97:0/3453887522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9380998b0 0x7fa93811c5e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.090+0000 7fa93de2b640 1 -- 172.21.15.97:0/3453887522 >> 172.21.15.97:0/3453887522 conn(0x7fa93805e5d0 msgr2=0x7fa93812e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:23.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.090+0000 7fa93de2b640 1 -- 172.21.15.97:0/3453887522 shutdown_connections 2024-09-13T18:39:23.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.090+0000 7fa93de2b640 1 -- 172.21.15.97:0/3453887522 wait complete. 2024-09-13T18:39:23.103 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:23.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.195+0000 7f85fe59d640 1 Processor -- start 2024-09-13T18:39:23.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.195+0000 7f85fe59d640 1 -- start start 2024-09-13T18:39:23.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.195+0000 7f85fe59d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 0x7f85f809d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.195+0000 7f85fe59d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f85f812d880 0x7f85f81354c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.195+0000 7f85fe59d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f809cca0 con 0x7f85f809d7b0 2024-09-13T18:39:23.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.195+0000 7f85fe59d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f809cac0 con 0x7f85f812d880 2024-09-13T18:39:23.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.195+0000 7f85fe59d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85f806a350 con 0x7f85f809cea0 2024-09-13T18:39:23.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.196+0000 7f85fcb3a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f85f812d880 0x7f85f81354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.196+0000 7f85f7fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 0x7f85f809d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.196+0000 7f85fcb3a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f85f812d880 0x7f85f81354c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37888/0 (socket says 172.21.15.97:37888) 2024-09-13T18:39:23.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.196+0000 7f85f7fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 0x7f85f809d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48326/0 (socket says 172.21.15.97:48326) 2024-09-13T18:39:23.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.196+0000 7f85fcb3a640 1 -- 172.21.15.97:0/269631896 learned_addr learned my addr 172.21.15.97:0/269631896 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:23.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.196+0000 7f85f77fe640 1 --1- 172.21.15.97:0/269631896 >> v1:172.21.15.97:6789/0 conn(0x7f85f809d7b0 0x7f85f812d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47944/0 (socket says 172.21.15.97:47944) 2024-09-13T18:39:23.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.196+0000 7f85f6ffd640 1 -- 172.21.15.97:0/269631896 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699355419 0 0) 0x7f85f809cca0 con 0x7f85f809d7b0 2024-09-13T18:39:23.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.196+0000 7f85f6ffd640 1 -- 172.21.15.97:0/269631896 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e00034e0 con 0x7f85f809d7b0 2024-09-13T18:39:23.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.196+0000 7f85f7fff640 1 -- 172.21.15.97:0/269631896 >> v2:172.21.15.97:3300/0 conn(0x7f85f812d880 msgr2=0x7f85f81354c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:23.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.196+0000 7f85f7fff640 1 --2- 172.21.15.97:0/269631896 >> v2:172.21.15.97:3300/0 conn(0x7f85f812d880 0x7f85f81354c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.196+0000 7f85f7fff640 1 -- 172.21.15.97:0/269631896 >> v1:172.21.15.97:6789/0 conn(0x7f85f809d7b0 legacy=0x7f85f812d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.196+0000 7f85f7fff640 1 -- 172.21.15.97:0/269631896 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f806e930 con 0x7f85f809cea0 2024-09-13T18:39:23.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.196+0000 7f85fcb3a640 1 --2- 172.21.15.97:0/269631896 >> v2:172.21.15.97:3300/0 conn(0x7f85f812d880 0x7f85f81354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:23.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.197+0000 7f85f7fff640 1 --2- 172.21.15.97:0/269631896 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 0x7f85f809d270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009850 tx=0x7f85e80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89053ba4490a817f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:23.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.197+0000 7f85f6ffd640 1 -- 172.21.15.97:0/269631896 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e802ac80 con 0x7f85f809cea0 2024-09-13T18:39:23.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.197+0000 7f85f6ffd640 1 -- 172.21.15.97:0/269631896 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e802ade0 con 0x7f85f809cea0 2024-09-13T18:39:23.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.197+0000 7f85f6ffd640 1 -- 172.21.15.97:0/269631896 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e8032670 con 0x7f85f809cea0 2024-09-13T18:39:23.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.197+0000 7f85fe59d640 1 -- 172.21.15.97:0/269631896 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 msgr2=0x7f85f809d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.197+0000 7f85fe59d640 1 --2- 172.21.15.97:0/269631896 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 0x7f85f809d270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009850 tx=0x7f85e80090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.197+0000 7f85fe59d640 1 -- 172.21.15.97:0/269631896 shutdown_connections 2024-09-13T18:39:23.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.197+0000 7f85fe59d640 1 --2- 172.21.15.97:0/269631896 >> v2:172.21.15.97:3300/0 conn(0x7f85f812d880 0x7f85f81354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.197+0000 7f85fe59d640 1 --2- 172.21.15.97:0/269631896 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 0x7f85f809d270 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.197+0000 7f85fe59d640 1 -- 172.21.15.97:0/269631896 >> 172.21.15.97:0/269631896 conn(0x7f85f809b200 msgr2=0x7f85f809b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:23.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.197+0000 7f85fe59d640 1 -- 172.21.15.97:0/269631896 shutdown_connections 2024-09-13T18:39:23.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.197+0000 7f85fe59d640 1 -- 172.21.15.97:0/269631896 wait complete. 2024-09-13T18:39:23.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.198+0000 7f85fe59d640 1 Processor -- start 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.198+0000 7f85fe59d640 1 -- start start 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85fe59d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 0x7f85f811f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85fe59d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85f809d7b0 0x7f85f811bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85fe59d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85f812d880 0x7f85f811c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85fe59d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f811db10 con 0x7f85f812d880 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85fe59d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f812cd90 con 0x7f85f809d7b0 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85fe59d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85f811e550 con 0x7f85f809cea0 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85f7fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 0x7f85f811f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85f7fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 0x7f85f811f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48332/0 (socket says 172.21.15.97:48332) 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85fcb3a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85f812d880 0x7f85f811c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85f7fff640 1 -- 172.21.15.97:0/2303526648 learned_addr learned my addr 172.21.15.97:0/2303526648 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85f77fe640 1 --2- 172.21.15.97:0/2303526648 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85f809d7b0 0x7f85f811bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85f7fff640 1 -- 172.21.15.97:0/2303526648 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85f809d7b0 msgr2=0x7f85f811bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85f7fff640 1 --2- 172.21.15.97:0/2303526648 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85f809d7b0 0x7f85f811bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85f7fff640 1 -- 172.21.15.97:0/2303526648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85f812d880 msgr2=0x7f85f811c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85f7fff640 1 --2- 172.21.15.97:0/2303526648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85f812d880 0x7f85f811c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85f7fff640 1 -- 172.21.15.97:0/2303526648 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0009ae0 con 0x7f85f809cea0 2024-09-13T18:39:23.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85f7fff640 1 --2- 172.21.15.97:0/2303526648 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 0x7f85f811f9e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f85e802a5b0 tx=0x7f85e8032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:23.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85dffff640 1 -- 172.21.15.97:0/2303526648 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e803d700 con 0x7f85f809cea0 2024-09-13T18:39:23.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85dffff640 1 -- 172.21.15.97:0/2303526648 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e803d860 con 0x7f85f809cea0 2024-09-13T18:39:23.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85fe59d640 1 -- 172.21.15.97:0/2303526648 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e8009390 con 0x7f85f809cea0 2024-09-13T18:39:23.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.199+0000 7f85dffff640 1 -- 172.21.15.97:0/2303526648 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e803dc20 con 0x7f85f809cea0 2024-09-13T18:39:23.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.200+0000 7f85fe59d640 1 -- 172.21.15.97:0/2303526648 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f811ef40 con 0x7f85f809cea0 2024-09-13T18:39:23.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.200+0000 7f85dffff640 1 -- 172.21.15.97:0/2303526648 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f85e8039040 con 0x7f85f809cea0 2024-09-13T18:39:23.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.200+0000 7f85dffff640 1 -- 172.21.15.97:0/2303526648 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f85e8061a90 con 0x7f85f809cea0 2024-09-13T18:39:23.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.200+0000 7f85fe59d640 1 -- 172.21.15.97:0/2303526648 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f811ddb0 con 0x7f85f809cea0 2024-09-13T18:39:23.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.205+0000 7f85dffff640 1 -- 172.21.15.97:0/2303526648 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f85e8044540 con 0x7f85f809cea0 2024-09-13T18:39:23.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.359+0000 7f85fe59d640 1 -- 172.21.15.97:0/2303526648 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85f8064000 con 0x7f85f809cea0 2024-09-13T18:39:23.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.359+0000 7f85dffff640 1 -- 172.21.15.97:0/2303526648 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+11343 (secure 0 0 0) 0x7f85e8037020 con 0x7f85f809cea0 2024-09-13T18:39:23.362 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:23.362 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:14.949504+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:23.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.361+0000 7f85fe59d640 1 -- 172.21.15.97:0/2303526648 >> v1:172.21.15.97:6816/34603 conn(0x7f85e4031160 legacy=0x7f85e4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.361+0000 7f85fe59d640 1 -- 172.21.15.97:0/2303526648 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 msgr2=0x7f85f811f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.361+0000 7f85fe59d640 1 --2- 172.21.15.97:0/2303526648 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 0x7f85f811f9e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f85e802a5b0 tx=0x7f85e8032000 comp rx=0 tx=0).stop 2024-09-13T18:39:23.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.361+0000 7f85fe59d640 1 -- 172.21.15.97:0/2303526648 shutdown_connections 2024-09-13T18:39:23.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.361+0000 7f85fe59d640 1 --2- 172.21.15.97:0/2303526648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85f812d880 0x7f85f811c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.361+0000 7f85fe59d640 1 --2- 172.21.15.97:0/2303526648 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f85f809d7b0 0x7f85f811bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.361+0000 7f85fe59d640 1 --2- 172.21.15.97:0/2303526648 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f85f809cea0 0x7f85f811f9e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.361+0000 7f85fe59d640 1 -- 172.21.15.97:0/2303526648 >> 172.21.15.97:0/2303526648 conn(0x7f85f809b200 msgr2=0x7f85f812d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:23.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.362+0000 7f85fe59d640 1 -- 172.21.15.97:0/2303526648 shutdown_connections 2024-09-13T18:39:23.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.362+0000 7f85fe59d640 1 -- 172.21.15.97:0/2303526648 wait complete. 2024-09-13T18:39:23.375 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:39:01.375967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T18:39:05.732412+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:39:12.014248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:39:12.844264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:39:23.375 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:39:23.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.468+0000 7fe29d19d640 1 Processor -- start 2024-09-13T18:39:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.468+0000 7fe29d19d640 1 -- start start 2024-09-13T18:39:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.468+0000 7fe29d19d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe29812db60 0x7fe2981324b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.468+0000 7fe29d19d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe2981329f0 0x7fe298134dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.468+0000 7fe29d19d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29809bc40 con 0x7fe2980a0290 2024-09-13T18:39:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.469+0000 7fe29d19d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2980a0660 con 0x7fe29812db60 2024-09-13T18:39:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.469+0000 7fe29d19d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe298099540 con 0x7fe2981329f0 2024-09-13T18:39:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.469+0000 7fe28e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe29812db60 0x7fe2981324b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.469+0000 7fe29759e640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe2981329f0 0x7fe298134dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.469+0000 7fe296d9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe2980a0290 0x7fe29812d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47950/0 (socket says 172.21.15.97:47950) 2024-09-13T18:39:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.469+0000 7fe296d9d640 1 -- 172.21.15.97:0/625411560 learned_addr learned my addr 172.21.15.97:0/625411560 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.469+0000 7fe28e59c640 1 -- 172.21.15.97:0/625411560 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe2981329f0 msgr2=0x7fe298134dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.469+0000 7fe28e59c640 1 --2- 172.21.15.97:0/625411560 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe2981329f0 0x7fe298134dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.469+0000 7fe28e59c640 1 -- 172.21.15.97:0/625411560 >> v1:172.21.15.97:6789/0 conn(0x7fe2980a0290 legacy=0x7fe29812d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.469+0000 7fe29659c640 1 -- 172.21.15.97:0/625411560 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774751931 0 0) 0x7fe29809bc40 con 0x7fe2980a0290 2024-09-13T18:39:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.469+0000 7fe28e59c640 1 -- 172.21.15.97:0/625411560 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe298099c00 con 0x7fe29812db60 2024-09-13T18:39:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.469+0000 7fe29759e640 1 --2- 172.21.15.97:0/625411560 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe2981329f0 0x7fe298134dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.470+0000 7fe28e59c640 1 --2- 172.21.15.97:0/625411560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29812db60 0x7fe2981324b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe280009850 tx=0x7fe2800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50210f4a9462e3d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.470+0000 7fe29659c640 1 -- 172.21.15.97:0/625411560 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28002ac80 con 0x7fe29812db60 2024-09-13T18:39:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.470+0000 7fe29659c640 1 -- 172.21.15.97:0/625411560 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28002ade0 con 0x7fe29812db60 2024-09-13T18:39:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.470+0000 7fe29659c640 1 -- 172.21.15.97:0/625411560 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280032670 con 0x7fe29812db60 2024-09-13T18:39:23.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.470+0000 7fe29d19d640 1 -- 172.21.15.97:0/625411560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29812db60 msgr2=0x7fe2981324b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.470+0000 7fe29d19d640 1 --2- 172.21.15.97:0/625411560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29812db60 0x7fe2981324b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe280009850 tx=0x7fe2800090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.470+0000 7fe29d19d640 1 -- 172.21.15.97:0/625411560 shutdown_connections 2024-09-13T18:39:23.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.470+0000 7fe29d19d640 1 --2- 172.21.15.97:0/625411560 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29812db60 0x7fe2981324b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.470+0000 7fe29d19d640 1 --2- 172.21.15.97:0/625411560 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe2981329f0 0x7fe298134dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.470+0000 7fe29d19d640 1 -- 172.21.15.97:0/625411560 >> 172.21.15.97:0/625411560 conn(0x7fe29805e5d0 msgr2=0x7fe29809f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.470+0000 7fe29d19d640 1 -- 172.21.15.97:0/625411560 shutdown_connections 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.470+0000 7fe29d19d640 1 -- 172.21.15.97:0/625411560 wait complete. 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.471+0000 7fe29d19d640 1 Processor -- start 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.471+0000 7fe29d19d640 1 -- start start 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29d19d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2980a0290 0x7fe298115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29d19d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29812db60 0x7fe298116330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29d19d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe2981329f0 0x7fe298116870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29d19d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe298067ae0 con 0x7fe29812db60 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29d19d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29809a3b0 con 0x7fe2980a0290 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29d19d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe29806ded0 con 0x7fe2981329f0 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe28e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29812db60 0x7fe298116330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29759e640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe2981329f0 0x7fe298116870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe28e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29812db60 0x7fe298116330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37906/0 (socket says 172.21.15.97:37906) 2024-09-13T18:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe28e59c640 1 -- 172.21.15.97:0/3837741637 learned_addr learned my addr 172.21.15.97:0/3837741637 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe296d9d640 1 --2- 172.21.15.97:0/3837741637 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2980a0290 0x7fe298115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29759e640 1 -- 172.21.15.97:0/3837741637 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2980a0290 msgr2=0x7fe298115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29759e640 1 --2- 172.21.15.97:0/3837741637 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2980a0290 0x7fe298115df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29759e640 1 -- 172.21.15.97:0/3837741637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29812db60 msgr2=0x7fe298116330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29759e640 1 --2- 172.21.15.97:0/3837741637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29812db60 0x7fe298116330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29759e640 1 -- 172.21.15.97:0/3837741637 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe290009a20 con 0x7fe2981329f0 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe28e59c640 1 --2- 172.21.15.97:0/3837741637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29812db60 0x7fe298116330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29759e640 1 --2- 172.21.15.97:0/3837741637 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe2981329f0 0x7fe298116870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe290009ed0 tx=0x7fe29000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe28f7fe640 1 -- 172.21.15.97:0/3837741637 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29000ce10 con 0x7fe2981329f0 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe28f7fe640 1 -- 172.21.15.97:0/3837741637 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29000f040 con 0x7fe2981329f0 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe29d19d640 1 -- 172.21.15.97:0/3837741637 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe280009390 con 0x7fe2981329f0 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.472+0000 7fe28f7fe640 1 -- 172.21.15.97:0/3837741637 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900146d0 con 0x7fe2981329f0 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.473+0000 7fe29d19d640 1 -- 172.21.15.97:0/3837741637 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe298116e40 con 0x7fe2981329f0 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.473+0000 7fe28f7fe640 1 -- 172.21.15.97:0/3837741637 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fe290014a40 con 0x7fe2981329f0 2024-09-13T18:39:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.473+0000 7fe28f7fe640 1 -- 172.21.15.97:0/3837741637 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7fe290042dd0 con 0x7fe2981329f0 2024-09-13T18:39:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.473+0000 7fe29d19d640 1 -- 172.21.15.97:0/3837741637 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2980714b0 con 0x7fe2981329f0 2024-09-13T18:39:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.478+0000 7fe28f7fe640 1 -- 172.21.15.97:0/3837741637 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fe290024530 con 0x7fe2981329f0 2024-09-13T18:39:23.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.632+0000 7fe29d19d640 1 -- 172.21.15.97:0/3837741637 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe298131960 con 0x7fe2981329f0 2024-09-13T18:39:23.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.633+0000 7fe28f7fe640 1 -- 172.21.15.97:0/3837741637 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe290007e60 con 0x7fe2981329f0 2024-09-13T18:39:23.636 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2024-09-13T18:39:23.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.634+0000 7fe29d19d640 1 -- 172.21.15.97:0/3837741637 >> v1:172.21.15.97:6816/34603 conn(0x7fe278031160 legacy=0x7fe278033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.634+0000 7fe29d19d640 1 -- 172.21.15.97:0/3837741637 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe2981329f0 msgr2=0x7fe298116870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.634+0000 7fe29d19d640 1 --2- 172.21.15.97:0/3837741637 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe2981329f0 0x7fe298116870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe290009ed0 tx=0x7fe29000b040 comp rx=0 tx=0).stop 2024-09-13T18:39:23.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.634+0000 7fe29d19d640 1 -- 172.21.15.97:0/3837741637 shutdown_connections 2024-09-13T18:39:23.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.634+0000 7fe29d19d640 1 --2- 172.21.15.97:0/3837741637 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe2981329f0 0x7fe298116870 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.634+0000 7fe29d19d640 1 --2- 172.21.15.97:0/3837741637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe29812db60 0x7fe298116330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.634+0000 7fe29d19d640 1 --2- 172.21.15.97:0/3837741637 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe2980a0290 0x7fe298115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.634+0000 7fe29d19d640 1 -- 172.21.15.97:0/3837741637 >> 172.21.15.97:0/3837741637 conn(0x7fe29805e5d0 msgr2=0x7fe29809ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:23.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.635+0000 7fe29d19d640 1 -- 172.21.15.97:0/3837741637 shutdown_connections 2024-09-13T18:39:23.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.635+0000 7fe29d19d640 1 -- 172.21.15.97:0/3837741637 wait complete. 2024-09-13T18:39:23.647 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-13T18:39:23.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.740+0000 7f725599d640 1 Processor -- start 2024-09-13T18:39:23.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.740+0000 7f725599d640 1 -- start start 2024-09-13T18:39:23.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.740+0000 7f725599d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f725006e7c0 0x7f725009e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.740+0000 7f725599d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f725006eb90 0x7f725009eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.740+0000 7f725599d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f725009f0c0 0x7f7250134040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.740+0000 7f725599d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725006ced0 con 0x7f725009f0c0 2024-09-13T18:39:23.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.740+0000 7f725599d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72500a0090 con 0x7f725006e7c0 2024-09-13T18:39:23.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.740+0000 7f725599d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f725009fa90 con 0x7f725006eb90 2024-09-13T18:39:23.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.741+0000 7f724f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f725009f0c0 0x7f7250134040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.741+0000 7f724effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f725006e7c0 0x7f725009e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.741+0000 7f724e7fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f725006eb90 0x7f725009eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.741+0000 7f724f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f725009f0c0 0x7f7250134040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37912/0 (socket says 172.21.15.97:37912) 2024-09-13T18:39:23.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.741+0000 7f724f7fe640 1 -- 172.21.15.97:0/1893741178 learned_addr learned my addr 172.21.15.97:0/1893741178 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:23.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.741+0000 7f724e7fc640 1 -- 172.21.15.97:0/1893741178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f725006e7c0 msgr2=0x7f725009e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:23.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.741+0000 7f724e7fc640 1 --2- 172.21.15.97:0/1893741178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f725006e7c0 0x7f725009e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.741+0000 7f724e7fc640 1 -- 172.21.15.97:0/1893741178 >> v2:172.21.15.97:3300/0 conn(0x7f725009f0c0 msgr2=0x7f7250134040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:23.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.741+0000 7f724e7fc640 1 --2- 172.21.15.97:0/1893741178 >> v2:172.21.15.97:3300/0 conn(0x7f725009f0c0 0x7f7250134040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.741+0000 7f724e7fc640 1 -- 172.21.15.97:0/1893741178 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725006e600 con 0x7f725006eb90 2024-09-13T18:39:23.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.741+0000 7f724effd640 1 --2- 172.21.15.97:0/1893741178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f725006e7c0 0x7f725009e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:23.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.741+0000 7f724f7fe640 1 --2- 172.21.15.97:0/1893741178 >> v2:172.21.15.97:3300/0 conn(0x7f725009f0c0 0x7f7250134040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:23.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.742+0000 7f724e7fc640 1 --2- 172.21.15.97:0/1893741178 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f725006eb90 0x7f725009eb80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7244009880 tx=0x7f72440090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a63c027ec2bc959 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:23.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.742+0000 7f724dffb640 1 -- 172.21.15.97:0/1893741178 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724402abc0 con 0x7f725006eb90 2024-09-13T18:39:23.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.742+0000 7f724dffb640 1 -- 172.21.15.97:0/1893741178 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724402ad20 con 0x7f725006eb90 2024-09-13T18:39:23.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.742+0000 7f724dffb640 1 -- 172.21.15.97:0/1893741178 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7244032670 con 0x7f725006eb90 2024-09-13T18:39:23.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.742+0000 7f725599d640 1 -- 172.21.15.97:0/1893741178 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f725006eb90 msgr2=0x7f725009eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.742+0000 7f725599d640 1 --2- 172.21.15.97:0/1893741178 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f725006eb90 0x7f725009eb80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7244009880 tx=0x7f72440090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.742+0000 7f725599d640 1 -- 172.21.15.97:0/1893741178 shutdown_connections 2024-09-13T18:39:23.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.742+0000 7f725599d640 1 --2- 172.21.15.97:0/1893741178 >> v2:172.21.15.97:3300/0 conn(0x7f725009f0c0 0x7f7250134040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.742+0000 7f725599d640 1 --2- 172.21.15.97:0/1893741178 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f725006eb90 0x7f725009eb80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.742+0000 7f725599d640 1 --2- 172.21.15.97:0/1893741178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f725006e7c0 0x7f725009e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.742+0000 7f725599d640 1 -- 172.21.15.97:0/1893741178 >> 172.21.15.97:0/1893741178 conn(0x7f7250067b70 msgr2=0x7f72500a0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:23.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.742+0000 7f725599d640 1 -- 172.21.15.97:0/1893741178 shutdown_connections 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.742+0000 7f725599d640 1 -- 172.21.15.97:0/1893741178 wait complete. 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.743+0000 7f725599d640 1 Processor -- start 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.743+0000 7f725599d640 1 -- start start 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f725599d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f725006e7c0 0x7f725011ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f725599d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f725009f0c0 0x7f725011b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f725599d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f725011e4e0 0x7f725013a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f725599d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725006c2b0 con 0x7f725006e7c0 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f725599d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725011da40 con 0x7f725011e4e0 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f725599d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f725011c140 con 0x7f725009f0c0 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f724f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f725011e4e0 0x7f725013a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f724e7fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f725009f0c0 0x7f725011b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f724effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f725006e7c0 0x7f725011ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f724e7fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f725009f0c0 0x7f725011b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48376/0 (socket says 172.21.15.97:48376) 2024-09-13T18:39:23.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f724e7fc640 1 -- 172.21.15.97:0/2249180636 learned_addr learned my addr 172.21.15.97:0/2249180636 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:23.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f724e7fc640 1 -- 172.21.15.97:0/2249180636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f725011e4e0 msgr2=0x7f725013a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f724e7fc640 1 --2- 172.21.15.97:0/2249180636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f725011e4e0 0x7f725013a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f724e7fc640 1 -- 172.21.15.97:0/2249180636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f725006e7c0 msgr2=0x7f725011ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f724e7fc640 1 --2- 172.21.15.97:0/2249180636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f725006e7c0 0x7f725011ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f724e7fc640 1 -- 172.21.15.97:0/2249180636 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7240009390 con 0x7f725009f0c0 2024-09-13T18:39:23.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f724f7fe640 1 --2- 172.21.15.97:0/2249180636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f725011e4e0 0x7f725013a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:23.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f724e7fc640 1 --2- 172.21.15.97:0/2249180636 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f725009f0c0 0x7f725011b2e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7244009880 tx=0x7f7244032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:23.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f7236ffd640 1 -- 172.21.15.97:0/2249180636 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724403d720 con 0x7f725009f0c0 2024-09-13T18:39:23.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f7236ffd640 1 -- 172.21.15.97:0/2249180636 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724402ae90 con 0x7f725009f0c0 2024-09-13T18:39:23.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f7236ffd640 1 -- 172.21.15.97:0/2249180636 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724403dab0 con 0x7f725009f0c0 2024-09-13T18:39:23.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f725599d640 1 -- 172.21.15.97:0/2249180636 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724800f050 con 0x7f725009f0c0 2024-09-13T18:39:23.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.744+0000 7f725599d640 1 -- 172.21.15.97:0/2249180636 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7244009390 con 0x7f725009f0c0 2024-09-13T18:39:23.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.745+0000 7f7236ffd640 1 -- 172.21.15.97:0/2249180636 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f7244039040 con 0x7f725009f0c0 2024-09-13T18:39:23.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.745+0000 7f7236ffd640 1 -- 172.21.15.97:0/2249180636 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f7244061850 con 0x7f725009f0c0 2024-09-13T18:39:23.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.745+0000 7f725599d640 1 -- 172.21.15.97:0/2249180636 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72500714b0 con 0x7f725009f0c0 2024-09-13T18:39:23.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.750+0000 7f7236ffd640 1 -- 172.21.15.97:0/2249180636 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f7244042080 con 0x7f725009f0c0 2024-09-13T18:39:23.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.899+0000 7f725599d640 1 -- 172.21.15.97:0/2249180636 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f725005e0b0 con 0x7f725009f0c0 2024-09-13T18:39:23.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.899+0000 7f7236ffd640 1 -- 172.21.15.97:0/2249180636 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7244037020 con 0x7f725009f0c0 2024-09-13T18:39:23.902 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 8 2024-09-13T18:39:23.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.901+0000 7f725599d640 1 -- 172.21.15.97:0/2249180636 >> v1:172.21.15.97:6816/34603 conn(0x7f723c031160 legacy=0x7f723c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.901+0000 7f725599d640 1 -- 172.21.15.97:0/2249180636 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f725009f0c0 msgr2=0x7f725011b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:23.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.901+0000 7f725599d640 1 --2- 172.21.15.97:0/2249180636 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f725009f0c0 0x7f725011b2e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7244009880 tx=0x7f7244032000 comp rx=0 tx=0).stop 2024-09-13T18:39:23.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.901+0000 7f725599d640 1 -- 172.21.15.97:0/2249180636 shutdown_connections 2024-09-13T18:39:23.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.901+0000 7f725599d640 1 --2- 172.21.15.97:0/2249180636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f725011e4e0 0x7f725013a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.901+0000 7f725599d640 1 --2- 172.21.15.97:0/2249180636 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f725009f0c0 0x7f725011b2e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.901+0000 7f725599d640 1 --2- 172.21.15.97:0/2249180636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f725006e7c0 0x7f725011ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:23.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.901+0000 7f725599d640 1 -- 172.21.15.97:0/2249180636 >> 172.21.15.97:0/2249180636 conn(0x7f7250067b70 msgr2=0x7f72500690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:23.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.901+0000 7f725599d640 1 -- 172.21.15.97:0/2249180636 shutdown_connections 2024-09-13T18:39:23.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:23.901+0000 7f725599d640 1 -- 172.21.15.97:0/2249180636 wait complete. 2024-09-13T18:39:23.915 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:39:24.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.008+0000 7f400539d640 1 Processor -- start 2024-09-13T18:39:24.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.008+0000 7f400539d640 1 -- start start 2024-09-13T18:39:24.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f400539d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f400009dee0 0x7f40001346d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f400539d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4000134c10 0x7f4000136ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f400539d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40000974f0 con 0x7f40000689b0 2024-09-13T18:39:24.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f400539d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4000068d80 con 0x7f4000134c10 2024-09-13T18:39:24.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f400539d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f400009cee0 con 0x7f400009dee0 2024-09-13T18:39:24.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f3ffeffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f40000689b0 0x7f400009d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47958/0 (socket says 172.21.15.97:47958) 2024-09-13T18:39:24.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f3ffeffd640 1 -- 172.21.15.97:0/1632550766 learned_addr learned my addr 172.21.15.97:0/1632550766 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:24.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f3ff67fc640 1 --2- 172.21.15.97:0/1632550766 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f400009dee0 0x7f40001346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f3fff7fe640 1 --2- 172.21.15.97:0/1632550766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4000134c10 0x7f4000136ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f3ffe7fc640 1 -- 172.21.15.97:0/1632550766 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567795555 0 0) 0x7f3ff0001110 con 0x7f40000689b0 2024-09-13T18:39:24.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f3ffe7fc640 1 -- 172.21.15.97:0/1632550766 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fec0034e0 con 0x7f40000689b0 2024-09-13T18:39:24.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f3fff7fe640 1 -- 172.21.15.97:0/1632550766 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f400009dee0 msgr2=0x7f40001346d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:24.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f3fff7fe640 1 --2- 172.21.15.97:0/1632550766 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f400009dee0 0x7f40001346d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f3fff7fe640 1 -- 172.21.15.97:0/1632550766 >> v1:172.21.15.97:6789/0 conn(0x7f40000689b0 legacy=0x7f400009d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f3fff7fe640 1 -- 172.21.15.97:0/1632550766 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40000692f0 con 0x7f4000134c10 2024-09-13T18:39:24.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.009+0000 7f3ff67fc640 1 --2- 172.21.15.97:0/1632550766 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f400009dee0 0x7f40001346d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:24.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.010+0000 7f3fff7fe640 1 --2- 172.21.15.97:0/1632550766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4000134c10 0x7f4000136ff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009e90 tx=0x7f3ff8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0dfb3f6f9c3daf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:24.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.010+0000 7f3ffe7fc640 1 -- 172.21.15.97:0/1632550766 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8031400 con 0x7f4000134c10 2024-09-13T18:39:24.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.010+0000 7f3ffe7fc640 1 -- 172.21.15.97:0/1632550766 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff802d050 con 0x7f4000134c10 2024-09-13T18:39:24.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.010+0000 7f3ffe7fc640 1 -- 172.21.15.97:0/1632550766 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80317d0 con 0x7f4000134c10 2024-09-13T18:39:24.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.011+0000 7f400539d640 1 -- 172.21.15.97:0/1632550766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4000134c10 msgr2=0x7f4000136ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.011+0000 7f400539d640 1 --2- 172.21.15.97:0/1632550766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4000134c10 0x7f4000136ff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009e90 tx=0x7f3ff8009780 comp rx=0 tx=0).stop 2024-09-13T18:39:24.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.011+0000 7f400539d640 1 -- 172.21.15.97:0/1632550766 shutdown_connections 2024-09-13T18:39:24.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.011+0000 7f400539d640 1 --2- 172.21.15.97:0/1632550766 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4000134c10 0x7f4000136ff0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.011+0000 7f400539d640 1 --2- 172.21.15.97:0/1632550766 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f400009dee0 0x7f40001346d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.011+0000 7f400539d640 1 -- 172.21.15.97:0/1632550766 >> 172.21.15.97:0/1632550766 conn(0x7f400006f450 msgr2=0x7f40000a2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.011+0000 7f400539d640 1 -- 172.21.15.97:0/1632550766 shutdown_connections 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.011+0000 7f400539d640 1 -- 172.21.15.97:0/1632550766 wait complete. 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f400539d640 1 Processor -- start 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f400539d640 1 -- start start 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f400539d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40000689b0 0x7f400009c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f400539d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f400009dee0 0x7f4000098350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f400539d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4000134c10 0x7f4000098890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f400539d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400009a900 con 0x7f40000689b0 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f400539d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400009e6f0 con 0x7f4000134c10 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f400539d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f400009b800 con 0x7f400009dee0 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f3ffeffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40000689b0 0x7f400009c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f3ff67fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f400009dee0 0x7f4000098350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f3fff7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4000134c10 0x7f4000098890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f3ffeffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40000689b0 0x7f400009c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37924/0 (socket says 172.21.15.97:37924) 2024-09-13T18:39:24.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f3ffeffd640 1 -- 172.21.15.97:0/2644668544 learned_addr learned my addr 172.21.15.97:0/2644668544 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:24.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.012+0000 7f3ff67fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f400009dee0 0x7f4000098350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48396/0 (socket says 172.21.15.97:48396) 2024-09-13T18:39:24.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.013+0000 7f3ffeffd640 1 -- 172.21.15.97:0/2644668544 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f400009dee0 msgr2=0x7f4000098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.013+0000 7f3ffeffd640 1 --2- 172.21.15.97:0/2644668544 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f400009dee0 0x7f4000098350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.013+0000 7f3ffeffd640 1 -- 172.21.15.97:0/2644668544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4000134c10 msgr2=0x7f4000098890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.013+0000 7f3ffeffd640 1 --2- 172.21.15.97:0/2644668544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4000134c10 0x7f4000098890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.013+0000 7f3ffeffd640 1 -- 172.21.15.97:0/2644668544 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe8009390 con 0x7f40000689b0 2024-09-13T18:39:24.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.013+0000 7f3fff7fe640 1 --2- 172.21.15.97:0/2644668544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4000134c10 0x7f4000098890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:24.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.013+0000 7f3ffeffd640 1 --2- 172.21.15.97:0/2644668544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40000689b0 0x7f400009c270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000c7c0 tx=0x7f3ff0007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:24.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.013+0000 7f3ff77fe640 1 -- 172.21.15.97:0/2644668544 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff000ce90 con 0x7f40000689b0 2024-09-13T18:39:24.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.013+0000 7f3ff77fe640 1 -- 172.21.15.97:0/2644668544 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff0005870 con 0x7f40000689b0 2024-09-13T18:39:24.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.013+0000 7f400539d640 1 -- 172.21.15.97:0/2644668544 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff8009a20 con 0x7f40000689b0 2024-09-13T18:39:24.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.013+0000 7f3ff77fe640 1 -- 172.21.15.97:0/2644668544 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0005c90 con 0x7f40000689b0 2024-09-13T18:39:24.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.013+0000 7f400539d640 1 -- 172.21.15.97:0/2644668544 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4000099f70 con 0x7f40000689b0 2024-09-13T18:39:24.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.014+0000 7f3ff77fe640 1 -- 172.21.15.97:0/2644668544 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f3ff0007300 con 0x7f40000689b0 2024-09-13T18:39:24.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.014+0000 7f3ff77fe640 1 -- 172.21.15.97:0/2644668544 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f3ff0041a30 con 0x7f40000689b0 2024-09-13T18:39:24.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.014+0000 7f400539d640 1 -- 172.21.15.97:0/2644668544 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40000974f0 con 0x7f40000689b0 2024-09-13T18:39:24.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.018+0000 7f3ff77fe640 1 -- 172.21.15.97:0/2644668544 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f40000974f0 con 0x7f40000689b0 2024-09-13T18:39:24.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.168+0000 7f400539d640 1 -- 172.21.15.97:0/2644668544 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40000974f0 con 0x7f40000689b0 2024-09-13T18:39:24.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.169+0000 7f3ff77fe640 1 -- 172.21.15.97:0/2644668544 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40000974f0 con 0x7f40000689b0 2024-09-13T18:39:24.172 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2024-09-13T18:39:24.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.170+0000 7f400539d640 1 -- 172.21.15.97:0/2644668544 >> v1:172.21.15.97:6816/34603 conn(0x7f3fe0031160 legacy=0x7f3fe0033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.170+0000 7f400539d640 1 -- 172.21.15.97:0/2644668544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40000689b0 msgr2=0x7f400009c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.170+0000 7f400539d640 1 --2- 172.21.15.97:0/2644668544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40000689b0 0x7f400009c270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000c7c0 tx=0x7f3ff0007be0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.170+0000 7f400539d640 1 -- 172.21.15.97:0/2644668544 shutdown_connections 2024-09-13T18:39:24.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.171+0000 7f400539d640 1 --2- 172.21.15.97:0/2644668544 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4000134c10 0x7f4000098890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.171+0000 7f400539d640 1 --2- 172.21.15.97:0/2644668544 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f400009dee0 0x7f4000098350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.171+0000 7f400539d640 1 --2- 172.21.15.97:0/2644668544 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40000689b0 0x7f400009c270 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.171+0000 7f400539d640 1 -- 172.21.15.97:0/2644668544 >> 172.21.15.97:0/2644668544 conn(0x7f400006f450 msgr2=0x7f400012d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:24.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.171+0000 7f400539d640 1 -- 172.21.15.97:0/2644668544 shutdown_connections 2024-09-13T18:39:24.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.171+0000 7f400539d640 1 -- 172.21.15.97:0/2644668544 wait complete. 2024-09-13T18:39:24.183 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:39:24.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.277+0000 7f07a028b640 1 Processor -- start 2024-09-13T18:39:24.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.277+0000 7f07a028b640 1 -- start start 2024-09-13T18:39:24.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f07a028b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f079809a870 0x7f079809ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f07a028b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0798095740 0x7f0798135650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f07a028b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079806df40 con 0x7f079809b180 2024-09-13T18:39:24.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f07a028b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0798069fe0 con 0x7f079809a870 2024-09-13T18:39:24.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f07a028b640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f079806d330 con 0x7f0798095740 2024-09-13T18:39:24.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f079e828640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0798095740 0x7f0798135650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f079e027640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f079809a870 0x7f079809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f079d826640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f079809b180 0x7f0798095030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47962/0 (socket says 172.21.15.97:47962) 2024-09-13T18:39:24.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f079d826640 1 -- 172.21.15.97:0/1885784247 learned_addr learned my addr 172.21.15.97:0/1885784247 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:24.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f079d025640 1 -- 172.21.15.97:0/1885784247 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555330144 0 0) 0x7f079806df40 con 0x7f079809b180 2024-09-13T18:39:24.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f079e828640 1 -- 172.21.15.97:0/1885784247 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f079809a870 msgr2=0x7f079809ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:24.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f079e828640 1 --2- 172.21.15.97:0/1885784247 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f079809a870 0x7f079809ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f079e828640 1 -- 172.21.15.97:0/1885784247 >> v1:172.21.15.97:6789/0 conn(0x7f079809b180 legacy=0x7f0798095030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f079e828640 1 -- 172.21.15.97:0/1885784247 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079806c640 con 0x7f0798095740 2024-09-13T18:39:24.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.278+0000 7f079e027640 1 --2- 172.21.15.97:0/1885784247 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f079809a870 0x7f079809ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:24.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.279+0000 7f079e828640 1 --2- 172.21.15.97:0/1885784247 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0798095740 0x7f0798135650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0790009e90 tx=0x7f0790009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91dba55f0f1fcb9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:24.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.279+0000 7f079d025640 1 -- 172.21.15.97:0/1885784247 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790007550 con 0x7f0798095740 2024-09-13T18:39:24.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.279+0000 7f079d025640 1 -- 172.21.15.97:0/1885784247 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079002d050 con 0x7f0798095740 2024-09-13T18:39:24.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.279+0000 7f079d025640 1 -- 172.21.15.97:0/1885784247 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07900078e0 con 0x7f0798095740 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.279+0000 7f07a028b640 1 -- 172.21.15.97:0/1885784247 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0798095740 msgr2=0x7f0798135650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.279+0000 7f07a028b640 1 --2- 172.21.15.97:0/1885784247 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0798095740 0x7f0798135650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0790009e90 tx=0x7f0790009780 comp rx=0 tx=0).stop 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.280+0000 7f07a028b640 1 -- 172.21.15.97:0/1885784247 shutdown_connections 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.280+0000 7f07a028b640 1 --2- 172.21.15.97:0/1885784247 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0798095740 0x7f0798135650 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.280+0000 7f07a028b640 1 --2- 172.21.15.97:0/1885784247 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f079809a870 0x7f079809ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.280+0000 7f07a028b640 1 -- 172.21.15.97:0/1885784247 >> 172.21.15.97:0/1885784247 conn(0x7f079809f910 msgr2=0x7f079809b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.280+0000 7f07a028b640 1 -- 172.21.15.97:0/1885784247 shutdown_connections 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.280+0000 7f07a028b640 1 -- 172.21.15.97:0/1885784247 wait complete. 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.280+0000 7f07a028b640 1 Processor -- start 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.280+0000 7f07a028b640 1 -- start start 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f07a028b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0798095740 0x7f079813e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f07a028b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f079809a870 0x7f079813ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f07a028b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f079809b180 0x7f079813f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f07a028b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07980950f0 con 0x7f0798095740 2024-09-13T18:39:24.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f07a028b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0798088a30 con 0x7f079809b180 2024-09-13T18:39:24.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f07a028b640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0798088cd0 con 0x7f079809a870 2024-09-13T18:39:24.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f079e027640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0798095740 0x7f079813e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f079d826640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f079809a870 0x7f079813ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f079e027640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0798095740 0x7f079813e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37926/0 (socket says 172.21.15.97:37926) 2024-09-13T18:39:24.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f079e027640 1 -- 172.21.15.97:0/4270700524 learned_addr learned my addr 172.21.15.97:0/4270700524 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:24.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f079e828640 1 --2- 172.21.15.97:0/4270700524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f079809b180 0x7f079813f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f079d826640 1 -- 172.21.15.97:0/4270700524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f079809b180 msgr2=0x7f079813f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f079d826640 1 --2- 172.21.15.97:0/4270700524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f079809b180 0x7f079813f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f079d826640 1 -- 172.21.15.97:0/4270700524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0798095740 msgr2=0x7f079813e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f079d826640 1 --2- 172.21.15.97:0/4270700524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0798095740 0x7f079813e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f079d826640 1 -- 172.21.15.97:0/4270700524 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0794009390 con 0x7f079809a870 2024-09-13T18:39:24.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f079e027640 1 --2- 172.21.15.97:0/4270700524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0798095740 0x7f079813e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:24.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f079d826640 1 --2- 172.21.15.97:0/4270700524 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f079809a870 0x7f079813ec50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0788000c00 tx=0x7f0788007c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:24.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f078e7fc640 1 -- 172.21.15.97:0/4270700524 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0788005aa0 con 0x7f079809a870 2024-09-13T18:39:24.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f078e7fc640 1 -- 172.21.15.97:0/4270700524 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0788005c40 con 0x7f079809a870 2024-09-13T18:39:24.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.281+0000 7f078e7fc640 1 -- 172.21.15.97:0/4270700524 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880070d0 con 0x7f079809a870 2024-09-13T18:39:24.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.282+0000 7f07a028b640 1 -- 172.21.15.97:0/4270700524 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0790009a20 con 0x7f079809a870 2024-09-13T18:39:24.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.282+0000 7f07a028b640 1 -- 172.21.15.97:0/4270700524 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079812dcf0 con 0x7f079809a870 2024-09-13T18:39:24.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.282+0000 7f078e7fc640 1 -- 172.21.15.97:0/4270700524 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f07880074c0 con 0x7f079809a870 2024-09-13T18:39:24.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.282+0000 7f078e7fc640 1 -- 172.21.15.97:0/4270700524 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f07880413e0 con 0x7f079809a870 2024-09-13T18:39:24.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.283+0000 7f07a028b640 1 -- 172.21.15.97:0/4270700524 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0798088760 con 0x7f079809a870 2024-09-13T18:39:24.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.287+0000 7f078e7fc640 1 -- 172.21.15.97:0/4270700524 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f0788017080 con 0x7f079809a870 2024-09-13T18:39:24.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.438+0000 7f07a028b640 1 -- 172.21.15.97:0/4270700524 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0798127ff0 con 0x7f079809a870 2024-09-13T18:39:24.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.438+0000 7f078e7fc640 1 -- 172.21.15.97:0/4270700524 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0798127ff0 con 0x7f079809a870 2024-09-13T18:39:24.441 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2024-09-13T18:39:24.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.440+0000 7f07a028b640 1 -- 172.21.15.97:0/4270700524 >> v1:172.21.15.97:6816/34603 conn(0x7f077c031160 legacy=0x7f077c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.440+0000 7f07a028b640 1 -- 172.21.15.97:0/4270700524 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f079809a870 msgr2=0x7f079813ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.440+0000 7f07a028b640 1 --2- 172.21.15.97:0/4270700524 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f079809a870 0x7f079813ec50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0788000c00 tx=0x7f0788007c80 comp rx=0 tx=0).stop 2024-09-13T18:39:24.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.440+0000 7f07a028b640 1 -- 172.21.15.97:0/4270700524 shutdown_connections 2024-09-13T18:39:24.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.440+0000 7f07a028b640 1 --2- 172.21.15.97:0/4270700524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f079809b180 0x7f079813f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.440+0000 7f07a028b640 1 --2- 172.21.15.97:0/4270700524 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f079809a870 0x7f079813ec50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.440+0000 7f07a028b640 1 --2- 172.21.15.97:0/4270700524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0798095740 0x7f079813e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.440+0000 7f07a028b640 1 -- 172.21.15.97:0/4270700524 >> 172.21.15.97:0/4270700524 conn(0x7f079809f910 msgr2=0x7f079806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:24.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.440+0000 7f07a028b640 1 -- 172.21.15.97:0/4270700524 shutdown_connections 2024-09-13T18:39:24.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.440+0000 7f07a028b640 1 -- 172.21.15.97:0/4270700524 wait complete. 2024-09-13T18:39:24.453 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:39:24.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f1978c34640 1 Processor -- start 2024-09-13T18:39:24.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f1978c34640 1 -- start start 2024-09-13T18:39:24.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f1978c34640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f197409c8a0 0x7f197412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f1978c34640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f197412daf0 0x7f197412dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f1978c34640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1974098be0 0x7f1974099060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f1978c34640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197409cc70 con 0x7f197412daf0 2024-09-13T18:39:24.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f1978c34640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197412d380 con 0x7f1974098be0 2024-09-13T18:39:24.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f1978c34640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1974067e30 con 0x7f197409c8a0 2024-09-13T18:39:24.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f1972d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1974098be0 0x7f1974099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f197259c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f197409c8a0 0x7f197412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f197259c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f197409c8a0 0x7f197412d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48438/0 (socket says 172.21.15.97:48438) 2024-09-13T18:39:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f1972d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1974098be0 0x7f1974099060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:36128/0 (socket says 172.21.15.97:36128) 2024-09-13T18:39:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f197259c640 1 -- 172.21.15.97:0/3627368262 learned_addr learned my addr 172.21.15.97:0/3627368262 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.544+0000 7f1971d9b640 1 --2- 172.21.15.97:0/3627368262 >> v2:172.21.15.97:3300/0 conn(0x7f197412daf0 0x7f197412dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.545+0000 7f1972d9d640 1 -- 172.21.15.97:0/3627368262 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f197409c8a0 msgr2=0x7f197412d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.545+0000 7f1972d9d640 1 --2- 172.21.15.97:0/3627368262 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f197409c8a0 0x7f197412d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.545+0000 7f1972d9d640 1 -- 172.21.15.97:0/3627368262 >> v2:172.21.15.97:3300/0 conn(0x7f197412daf0 msgr2=0x7f197412dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.545+0000 7f1972d9d640 1 --2- 172.21.15.97:0/3627368262 >> v2:172.21.15.97:3300/0 conn(0x7f197412daf0 0x7f197412dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.545+0000 7f1972d9d640 1 -- 172.21.15.97:0/3627368262 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1974067970 con 0x7f1974098be0 2024-09-13T18:39:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.545+0000 7f197259c640 1 --2- 172.21.15.97:0/3627368262 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f197409c8a0 0x7f197412d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:24.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.545+0000 7f1971d9b640 1 --2- 172.21.15.97:0/3627368262 >> v2:172.21.15.97:3300/0 conn(0x7f197412daf0 0x7f197412dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.545+0000 7f1972d9d640 1 --2- 172.21.15.97:0/3627368262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1974098be0 0x7f1974099060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f196c009850 tx=0x7f196c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=257c3493e4cf56e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.546+0000 7f197159a640 1 -- 172.21.15.97:0/3627368262 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c02ac50 con 0x7f1974098be0 2024-09-13T18:39:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.546+0000 7f197159a640 1 -- 172.21.15.97:0/3627368262 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c02adb0 con 0x7f1974098be0 2024-09-13T18:39:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.546+0000 7f197159a640 1 -- 172.21.15.97:0/3627368262 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c032670 con 0x7f1974098be0 2024-09-13T18:39:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.546+0000 7f1978c34640 1 -- 172.21.15.97:0/3627368262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1974098be0 msgr2=0x7f1974099060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.546+0000 7f1978c34640 1 --2- 172.21.15.97:0/3627368262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1974098be0 0x7f1974099060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f196c009850 tx=0x7f196c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.546+0000 7f1978c34640 1 -- 172.21.15.97:0/3627368262 shutdown_connections 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.546+0000 7f1978c34640 1 --2- 172.21.15.97:0/3627368262 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1974098be0 0x7f1974099060 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.546+0000 7f1978c34640 1 --2- 172.21.15.97:0/3627368262 >> v2:172.21.15.97:3300/0 conn(0x7f197412daf0 0x7f197412dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.546+0000 7f1978c34640 1 --2- 172.21.15.97:0/3627368262 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f197409c8a0 0x7f197412d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.546+0000 7f1978c34640 1 -- 172.21.15.97:0/3627368262 >> 172.21.15.97:0/3627368262 conn(0x7f197405e5d0 msgr2=0x7f197409f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.546+0000 7f1978c34640 1 -- 172.21.15.97:0/3627368262 shutdown_connections 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.546+0000 7f1978c34640 1 -- 172.21.15.97:0/3627368262 wait complete. 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.547+0000 7f1978c34640 1 Processor -- start 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.547+0000 7f1978c34640 1 -- start start 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.547+0000 7f1978c34640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1974098be0 0x7f19741194a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.547+0000 7f1978c34640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f197409c8a0 0x7f19741199e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.547+0000 7f1978c34640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f197412daf0 0x7f1974119f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.547+0000 7f1978c34640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197411dac0 con 0x7f1974098be0 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.547+0000 7f1978c34640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197409eb40 con 0x7f197409c8a0 2024-09-13T18:39:24.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.547+0000 7f1978c34640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f197411a8f0 con 0x7f197412daf0 2024-09-13T18:39:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.547+0000 7f197259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1974098be0 0x7f19741194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.547+0000 7f1971d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f197409c8a0 0x7f19741199e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.547+0000 7f1972d9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f197412daf0 0x7f1974119f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.547+0000 7f197259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1974098be0 0x7f19741194a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37948/0 (socket says 172.21.15.97:37948) 2024-09-13T18:39:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.547+0000 7f197259c640 1 -- 172.21.15.97:0/561102771 learned_addr learned my addr 172.21.15.97:0/561102771 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.548+0000 7f197259c640 1 -- 172.21.15.97:0/561102771 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f197412daf0 msgr2=0x7f1974119f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.548+0000 7f197259c640 1 --2- 172.21.15.97:0/561102771 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f197412daf0 0x7f1974119f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.548+0000 7f197259c640 1 -- 172.21.15.97:0/561102771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f197409c8a0 msgr2=0x7f19741199e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.548+0000 7f197259c640 1 --2- 172.21.15.97:0/561102771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f197409c8a0 0x7f19741199e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.548+0000 7f197259c640 1 -- 172.21.15.97:0/561102771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964009ae0 con 0x7f1974098be0 2024-09-13T18:39:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.548+0000 7f197259c640 1 --2- 172.21.15.97:0/561102771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1974098be0 0x7f19741194a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f196400c170 tx=0x7f196400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.548+0000 7f196a7fc640 1 -- 172.21.15.97:0/561102771 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19640090d0 con 0x7f1974098be0 2024-09-13T18:39:24.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.548+0000 7f196a7fc640 1 -- 172.21.15.97:0/561102771 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196400f040 con 0x7f1974098be0 2024-09-13T18:39:24.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.548+0000 7f1978c34640 1 -- 172.21.15.97:0/561102771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c009390 con 0x7f1974098be0 2024-09-13T18:39:24.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.548+0000 7f196a7fc640 1 -- 172.21.15.97:0/561102771 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964014690 con 0x7f1974098be0 2024-09-13T18:39:24.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.548+0000 7f1978c34640 1 -- 172.21.15.97:0/561102771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c009390 con 0x7f1974098be0 2024-09-13T18:39:24.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.549+0000 7f196a7fc640 1 -- 172.21.15.97:0/561102771 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f1964014a40 con 0x7f1974098be0 2024-09-13T18:39:24.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.549+0000 7f196a7fc640 1 -- 172.21.15.97:0/561102771 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f1964042bb0 con 0x7f1974098be0 2024-09-13T18:39:24.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.549+0000 7f1978c34640 1 -- 172.21.15.97:0/561102771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1974064000 con 0x7f1974098be0 2024-09-13T18:39:24.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.553+0000 7f196a7fc640 1 -- 172.21.15.97:0/561102771 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f1964012570 con 0x7f1974098be0 2024-09-13T18:39:24.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.738+0000 7f1978c34640 1 -- 172.21.15.97:0/561102771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1974069770 con 0x7f1974098be0 2024-09-13T18:39:24.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.738+0000 7f196a7fc640 1 -- 172.21.15.97:0/561102771 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2264 (secure 0 0 0) 0x7f1964021110 con 0x7f1974098be0 2024-09-13T18:39:24.742 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:24.742 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:13.885647+0000","modified":"2024-09-13T18:39:16.567097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6817/3890865357","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6817","nonce":3890865357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-09-13T18:39:24.742 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 5 2024-09-13T18:39:24.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.740+0000 7f1978c34640 1 -- 172.21.15.97:0/561102771 >> v1:172.21.15.97:6816/34603 conn(0x7f1954031160 legacy=0x7f1954033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.740+0000 7f1978c34640 1 -- 172.21.15.97:0/561102771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1974098be0 msgr2=0x7f19741194a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.740+0000 7f1978c34640 1 --2- 172.21.15.97:0/561102771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1974098be0 0x7f19741194a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f196400c170 tx=0x7f196400b040 comp rx=0 tx=0).stop 2024-09-13T18:39:24.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.740+0000 7f1978c34640 1 -- 172.21.15.97:0/561102771 shutdown_connections 2024-09-13T18:39:24.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.740+0000 7f1978c34640 1 --2- 172.21.15.97:0/561102771 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f197412daf0 0x7f1974119f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.740+0000 7f1978c34640 1 --2- 172.21.15.97:0/561102771 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f197409c8a0 0x7f19741199e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.740+0000 7f1978c34640 1 --2- 172.21.15.97:0/561102771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1974098be0 0x7f19741194a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.740+0000 7f1978c34640 1 -- 172.21.15.97:0/561102771 >> 172.21.15.97:0/561102771 conn(0x7f197405e5d0 msgr2=0x7f197412c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:24.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.740+0000 7f1978c34640 1 -- 172.21.15.97:0/561102771 shutdown_connections 2024-09-13T18:39:24.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.740+0000 7f1978c34640 1 -- 172.21.15.97:0/561102771 wait complete. 2024-09-13T18:39:24.753 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:24.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.843+0000 7f452555d640 1 Processor -- start 2024-09-13T18:39:24.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.843+0000 7f452555d640 1 -- start start 2024-09-13T18:39:24.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f452555d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45200a1290 0x7f452012d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f452555d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f452012db90 0x7f452009b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f452555d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452006da40 con 0x7f452012d7c0 2024-09-13T18:39:24.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f452555d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452006ee70 con 0x7f45200a1290 2024-09-13T18:39:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f452555d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f452009cd30 con 0x7f452012db90 2024-09-13T18:39:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f451effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45200a1290 0x7f452012d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f451f7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f452012db90 0x7f452009b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f45167fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f452012d7c0 0x7f452009b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47968/0 (socket says 172.21.15.97:47968) 2024-09-13T18:39:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f45167fc640 1 -- 172.21.15.97:0/2154453470 learned_addr learned my addr 172.21.15.97:0/2154453470 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f451effd640 1 -- 172.21.15.97:0/2154453470 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f452012db90 msgr2=0x7f452009b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f451effd640 1 --2- 172.21.15.97:0/2154453470 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f452012db90 0x7f452009b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f451effd640 1 -- 172.21.15.97:0/2154453470 >> v1:172.21.15.97:6789/0 conn(0x7f452012d7c0 legacy=0x7f452009b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f451e7fc640 1 -- 172.21.15.97:0/2154453470 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127448049 0 0) 0x7f452006da40 con 0x7f452012d7c0 2024-09-13T18:39:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f451effd640 1 -- 172.21.15.97:0/2154453470 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452006cb20 con 0x7f45200a1290 2024-09-13T18:39:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.844+0000 7f451f7fe640 1 --2- 172.21.15.97:0/2154453470 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f452012db90 0x7f452009b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:24.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.845+0000 7f451effd640 1 --2- 172.21.15.97:0/2154453470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45200a1290 0x7f452012d1e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4510009880 tx=0x7f45100090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0d94ea39211cc7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:24.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.845+0000 7f451e7fc640 1 -- 172.21.15.97:0/2154453470 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451002ac50 con 0x7f45200a1290 2024-09-13T18:39:24.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.845+0000 7f451e7fc640 1 -- 172.21.15.97:0/2154453470 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451002adb0 con 0x7f45200a1290 2024-09-13T18:39:24.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.845+0000 7f451e7fc640 1 -- 172.21.15.97:0/2154453470 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4510032670 con 0x7f45200a1290 2024-09-13T18:39:24.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.845+0000 7f452555d640 1 -- 172.21.15.97:0/2154453470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45200a1290 msgr2=0x7f452012d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.845+0000 7f452555d640 1 --2- 172.21.15.97:0/2154453470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45200a1290 0x7f452012d1e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4510009880 tx=0x7f45100090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.846+0000 7f452555d640 1 -- 172.21.15.97:0/2154453470 shutdown_connections 2024-09-13T18:39:24.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.846+0000 7f452555d640 1 --2- 172.21.15.97:0/2154453470 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f452012db90 0x7f452009b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.846+0000 7f452555d640 1 --2- 172.21.15.97:0/2154453470 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45200a1290 0x7f452012d1e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.846+0000 7f452555d640 1 -- 172.21.15.97:0/2154453470 >> 172.21.15.97:0/2154453470 conn(0x7f4520067820 msgr2=0x7f45200a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:24.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.846+0000 7f452555d640 1 -- 172.21.15.97:0/2154453470 shutdown_connections 2024-09-13T18:39:24.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.846+0000 7f452555d640 1 -- 172.21.15.97:0/2154453470 wait complete. 2024-09-13T18:39:24.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.846+0000 7f452555d640 1 Processor -- start 2024-09-13T18:39:24.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.846+0000 7f452555d640 1 -- start start 2024-09-13T18:39:24.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f452555d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45200a1290 0x7f4520119ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f452555d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f452012d7c0 0x7f452011a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f452555d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f452012db90 0x7f452011a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f452555d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452012af10 con 0x7f452012d7c0 2024-09-13T18:39:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f452555d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452011cec0 con 0x7f45200a1290 2024-09-13T18:39:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f452555d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f452011ba20 con 0x7f452012db90 2024-09-13T18:39:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f451effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45200a1290 0x7f4520119ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f451effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45200a1290 0x7f4520119ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:36156/0 (socket says 172.21.15.97:36156) 2024-09-13T18:39:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f451f7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f452012db90 0x7f452011a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f451effd640 1 -- 172.21.15.97:0/1760776438 learned_addr learned my addr 172.21.15.97:0/1760776438 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f45167fc640 1 --2- 172.21.15.97:0/1760776438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f452012d7c0 0x7f452011a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f45167fc640 1 -- 172.21.15.97:0/1760776438 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f452012db90 msgr2=0x7f452011a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f45167fc640 1 --2- 172.21.15.97:0/1760776438 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f452012db90 0x7f452011a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f45167fc640 1 -- 172.21.15.97:0/1760776438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45200a1290 msgr2=0x7f4520119ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f45167fc640 1 --2- 172.21.15.97:0/1760776438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45200a1290 0x7f4520119ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f45167fc640 1 -- 172.21.15.97:0/1760776438 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4518009a20 con 0x7f452012d7c0 2024-09-13T18:39:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f451effd640 1 --2- 172.21.15.97:0/1760776438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45200a1290 0x7f4520119ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.847+0000 7f45167fc640 1 --2- 172.21.15.97:0/1760776438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f452012d7c0 0x7f452011a020 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4508000c00 tx=0x7f4508007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.848+0000 7f45177fe640 1 -- 172.21.15.97:0/1760776438 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508005aa0 con 0x7f452012d7c0 2024-09-13T18:39:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.848+0000 7f45177fe640 1 -- 172.21.15.97:0/1760776438 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4508005c40 con 0x7f452012d7c0 2024-09-13T18:39:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.848+0000 7f45177fe640 1 -- 172.21.15.97:0/1760776438 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45080070d0 con 0x7f452012d7c0 2024-09-13T18:39:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.848+0000 7f452555d640 1 -- 172.21.15.97:0/1760776438 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4510009390 con 0x7f452012d7c0 2024-09-13T18:39:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.848+0000 7f452555d640 1 -- 172.21.15.97:0/1760776438 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452011bc60 con 0x7f452012d7c0 2024-09-13T18:39:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.848+0000 7f45177fe640 1 -- 172.21.15.97:0/1760776438 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f4508007500 con 0x7f452012d7c0 2024-09-13T18:39:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.849+0000 7f45177fe640 1 -- 172.21.15.97:0/1760776438 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f4508041320 con 0x7f452012d7c0 2024-09-13T18:39:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.849+0000 7f452555d640 1 -- 172.21.15.97:0/1760776438 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4520064600 con 0x7f452012d7c0 2024-09-13T18:39:24.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:24.853+0000 7f45177fe640 1 -- 172.21.15.97:0/1760776438 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f4508017070 con 0x7f452012d7c0 2024-09-13T18:39:25.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.004+0000 7f452555d640 1 -- 172.21.15.97:0/1760776438 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f452006c150 con 0x7f452012d7c0 2024-09-13T18:39:25.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.005+0000 7f45177fe640 1 -- 172.21.15.97:0/1760776438 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+11343 (secure 0 0 0) 0x7f4508012c80 con 0x7f452012d7c0 2024-09-13T18:39:25.007 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:25.008 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:14.949504+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:25.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.006+0000 7f452555d640 1 -- 172.21.15.97:0/1760776438 >> v1:172.21.15.97:6816/34603 conn(0x7f4500031160 legacy=0x7f4500033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.006+0000 7f452555d640 1 -- 172.21.15.97:0/1760776438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f452012d7c0 msgr2=0x7f452011a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.006+0000 7f452555d640 1 --2- 172.21.15.97:0/1760776438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f452012d7c0 0x7f452011a020 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4508000c00 tx=0x7f4508007c80 comp rx=0 tx=0).stop 2024-09-13T18:39:25.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.006+0000 7f452555d640 1 -- 172.21.15.97:0/1760776438 shutdown_connections 2024-09-13T18:39:25.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.006+0000 7f452555d640 1 --2- 172.21.15.97:0/1760776438 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f452012db90 0x7f452011a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.006+0000 7f452555d640 1 --2- 172.21.15.97:0/1760776438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f452012d7c0 0x7f452011a020 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.006+0000 7f452555d640 1 --2- 172.21.15.97:0/1760776438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f45200a1290 0x7f4520119ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.006+0000 7f452555d640 1 -- 172.21.15.97:0/1760776438 >> 172.21.15.97:0/1760776438 conn(0x7f4520067820 msgr2=0x7f452009f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:25.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.007+0000 7f452555d640 1 -- 172.21.15.97:0/1760776438 shutdown_connections 2024-09-13T18:39:25.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.007+0000 7f452555d640 1 -- 172.21.15.97:0/1760776438 wait complete. 2024-09-13T18:39:25.020 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:39:25.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.110+0000 7f0447e4f640 1 Processor -- start 2024-09-13T18:39:25.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.110+0000 7f0447e4f640 1 -- start start 2024-09-13T18:39:25.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.110+0000 7f0447e4f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 0x7f044009d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.110+0000 7f0447e4f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f044012d880 0x7f04401354c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.110+0000 7f0447e4f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044009cca0 con 0x7f044009d7b0 2024-09-13T18:39:25.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.110+0000 7f0447e4f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044009cac0 con 0x7f044012d880 2024-09-13T18:39:25.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.110+0000 7f0447e4f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f044006a350 con 0x7f044009cea0 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.111+0000 7f0445beb640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 0x7f044009d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.111+0000 7f04463ec640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f044012d880 0x7f04401354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.111+0000 7f0445beb640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 0x7f044009d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48480/0 (socket says 172.21.15.97:48480) 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.111+0000 7f04463ec640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f044012d880 0x7f04401354c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:36166/0 (socket says 172.21.15.97:36166) 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.111+0000 7f0445beb640 1 -- 172.21.15.97:0/2349557096 learned_addr learned my addr 172.21.15.97:0/2349557096 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.111+0000 7f0445beb640 1 -- 172.21.15.97:0/2349557096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f044012d880 msgr2=0x7f04401354c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.111+0000 7f0444be9640 1 -- 172.21.15.97:0/2349557096 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646835914 0 0) 0x7f044009cca0 con 0x7f044009d7b0 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.111+0000 7f0445beb640 1 --2- 172.21.15.97:0/2349557096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f044012d880 0x7f04401354c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.111+0000 7f0445beb640 1 -- 172.21.15.97:0/2349557096 >> v1:172.21.15.97:6789/0 conn(0x7f044009d7b0 legacy=0x7f044012d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.111+0000 7f0445beb640 1 -- 172.21.15.97:0/2349557096 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044006e930 con 0x7f044009cea0 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.111+0000 7f04463ec640 1 --2- 172.21.15.97:0/2349557096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f044012d880 0x7f04401354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.112+0000 7f0445beb640 1 --2- 172.21.15.97:0/2349557096 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 0x7f044009d270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f043c009940 tx=0x7f043c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc045a13935d13d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.112+0000 7f0444be9640 1 -- 172.21.15.97:0/2349557096 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c02ad00 con 0x7f044009cea0 2024-09-13T18:39:25.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.112+0000 7f0444be9640 1 -- 172.21.15.97:0/2349557096 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c02ae60 con 0x7f044009cea0 2024-09-13T18:39:25.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.112+0000 7f0444be9640 1 -- 172.21.15.97:0/2349557096 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c032670 con 0x7f044009cea0 2024-09-13T18:39:25.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.112+0000 7f0447e4f640 1 -- 172.21.15.97:0/2349557096 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 msgr2=0x7f044009d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.112+0000 7f0447e4f640 1 --2- 172.21.15.97:0/2349557096 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 0x7f044009d270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f043c009940 tx=0x7f043c0091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.112+0000 7f0447e4f640 1 -- 172.21.15.97:0/2349557096 shutdown_connections 2024-09-13T18:39:25.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.112+0000 7f0447e4f640 1 --2- 172.21.15.97:0/2349557096 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f044012d880 0x7f04401354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.112+0000 7f0447e4f640 1 --2- 172.21.15.97:0/2349557096 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 0x7f044009d270 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.112+0000 7f0447e4f640 1 -- 172.21.15.97:0/2349557096 >> 172.21.15.97:0/2349557096 conn(0x7f044009b200 msgr2=0x7f044009b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.112+0000 7f0447e4f640 1 -- 172.21.15.97:0/2349557096 shutdown_connections 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.113+0000 7f0447e4f640 1 -- 172.21.15.97:0/2349557096 wait complete. 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.113+0000 7f0447e4f640 1 Processor -- start 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.113+0000 7f0447e4f640 1 -- start start 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0447e4f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 0x7f044011bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0447e4f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f044009d7b0 0x7f044011c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0447e4f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f044012d880 0x7f044011c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0447e4f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044011d230 con 0x7f044009d7b0 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0447e4f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044006e060 con 0x7f044012d880 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0447e4f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f044011ede0 con 0x7f044009cea0 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0445beb640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 0x7f044011bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f04453ea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f044009d7b0 0x7f044011c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f04463ec640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f044012d880 0x7f044011c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0445beb640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 0x7f044011bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48496/0 (socket says 172.21.15.97:48496) 2024-09-13T18:39:25.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0445beb640 1 -- 172.21.15.97:0/439432670 learned_addr learned my addr 172.21.15.97:0/439432670 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:25.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f04463ec640 1 -- 172.21.15.97:0/439432670 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 msgr2=0x7f044011bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f04463ec640 1 --2- 172.21.15.97:0/439432670 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 0x7f044011bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f04463ec640 1 -- 172.21.15.97:0/439432670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f044009d7b0 msgr2=0x7f044011c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f04463ec640 1 --2- 172.21.15.97:0/439432670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f044009d7b0 0x7f044011c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f04463ec640 1 -- 172.21.15.97:0/439432670 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0438009a20 con 0x7f044012d880 2024-09-13T18:39:25.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f04453ea640 1 --2- 172.21.15.97:0/439432670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f044009d7b0 0x7f044011c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:25.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0445beb640 1 --2- 172.21.15.97:0/439432670 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 0x7f044011bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:25.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f04463ec640 1 --2- 172.21.15.97:0/439432670 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f044012d880 0x7f044011c820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f043800b460 tx=0x7f043800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:25.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0435ffb640 1 -- 172.21.15.97:0/439432670 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438015070 con 0x7f044012d880 2024-09-13T18:39:25.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0435ffb640 1 -- 172.21.15.97:0/439432670 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0438009c70 con 0x7f044012d880 2024-09-13T18:39:25.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0447e4f640 1 -- 172.21.15.97:0/439432670 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c009450 con 0x7f044012d880 2024-09-13T18:39:25.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.114+0000 7f0435ffb640 1 -- 172.21.15.97:0/439432670 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04380077a0 con 0x7f044012d880 2024-09-13T18:39:25.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.115+0000 7f0447e4f640 1 -- 172.21.15.97:0/439432670 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044011dfb0 con 0x7f044012d880 2024-09-13T18:39:25.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.116+0000 7f0435ffb640 1 -- 172.21.15.97:0/439432670 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f0438003020 con 0x7f044012d880 2024-09-13T18:39:25.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.116+0000 7f0435ffb640 1 -- 172.21.15.97:0/439432670 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f0438046200 con 0x7f044012d880 2024-09-13T18:39:25.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.116+0000 7f0447e4f640 1 -- 172.21.15.97:0/439432670 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0440064000 con 0x7f044012d880 2024-09-13T18:39:25.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.120+0000 7f0435ffb640 1 -- 172.21.15.97:0/439432670 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f043801f4e0 con 0x7f044012d880 2024-09-13T18:39:25.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.302+0000 7f0447e4f640 1 -- 172.21.15.97:0/439432670 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f044006e500 con 0x7f044012d880 2024-09-13T18:39:25.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.303+0000 7f0435ffb640 1 -- 172.21.15.97:0/439432670 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2264 (secure 0 0 0) 0x7f0438017b00 con 0x7f044012d880 2024-09-13T18:39:25.306 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:25.306 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:13.885647+0000","modified":"2024-09-13T18:39:16.567097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6817/3890865357","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6817","nonce":3890865357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-09-13T18:39:25.307 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 5 2024-09-13T18:39:25.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.305+0000 7f0447e4f640 1 -- 172.21.15.97:0/439432670 >> v1:172.21.15.97:6816/34603 conn(0x7f0424031160 legacy=0x7f0424033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.305+0000 7f0447e4f640 1 -- 172.21.15.97:0/439432670 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f044012d880 msgr2=0x7f044011c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.305+0000 7f0447e4f640 1 --2- 172.21.15.97:0/439432670 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f044012d880 0x7f044011c820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f043800b460 tx=0x7f043800b040 comp rx=0 tx=0).stop 2024-09-13T18:39:25.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.305+0000 7f0447e4f640 1 -- 172.21.15.97:0/439432670 shutdown_connections 2024-09-13T18:39:25.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.305+0000 7f0447e4f640 1 --2- 172.21.15.97:0/439432670 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f044012d880 0x7f044011c820 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.305+0000 7f0447e4f640 1 --2- 172.21.15.97:0/439432670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f044009d7b0 0x7f044011c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.305+0000 7f0447e4f640 1 --2- 172.21.15.97:0/439432670 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f044009cea0 0x7f044011bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.305+0000 7f0447e4f640 1 -- 172.21.15.97:0/439432670 >> 172.21.15.97:0/439432670 conn(0x7f044009b200 msgr2=0x7f044012d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:25.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.305+0000 7f0447e4f640 1 -- 172.21.15.97:0/439432670 shutdown_connections 2024-09-13T18:39:25.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.305+0000 7f0447e4f640 1 -- 172.21.15.97:0/439432670 wait complete. 2024-09-13T18:39:25.418 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:39:13.885647+0000', 'modified': '2024-09-13T18:39:16.567097+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.97:6817/3890865357', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6817', 'nonce': 3890865357}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-09-13T18:39:25.418 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:39:25.419 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:39:25.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.511+0000 7f29aaf9d640 1 Processor -- start 2024-09-13T18:39:25.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.511+0000 7f29aaf9d640 1 -- start start 2024-09-13T18:39:25.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.511+0000 7f29aaf9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f29a412d1e0 0x7f29a4132510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.511+0000 7f29aaf9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29a4132a50 0x7f29a4134e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.511+0000 7f29aaf9d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a406da40 con 0x7f29a40a1290 2024-09-13T18:39:25.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.511+0000 7f29aaf9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a406ee70 con 0x7f29a4132a50 2024-09-13T18:39:25.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.511+0000 7f29aaf9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29a412d5b0 con 0x7f29a412d1e0 2024-09-13T18:39:25.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.511+0000 7f29a3fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f29a412d1e0 0x7f29a4132510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.511+0000 7f29a953a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29a4132a50 0x7f29a4134e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.511+0000 7f29a8d39640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f29a40a1290 0x7f29a412d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47986/0 (socket says 172.21.15.97:47986) 2024-09-13T18:39:25.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.511+0000 7f29a8d39640 1 -- 172.21.15.97:0/4099850111 learned_addr learned my addr 172.21.15.97:0/4099850111 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:25.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.512+0000 7f29a37fe640 1 -- 172.21.15.97:0/4099850111 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854427766 0 0) 0x7f29a406da40 con 0x7f29a40a1290 2024-09-13T18:39:25.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.512+0000 7f29a37fe640 1 -- 172.21.15.97:0/4099850111 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29940034e0 con 0x7f29a40a1290 2024-09-13T18:39:25.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.512+0000 7f29a953a640 1 -- 172.21.15.97:0/4099850111 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f29a412d1e0 msgr2=0x7f29a4132510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.512+0000 7f29a953a640 1 --2- 172.21.15.97:0/4099850111 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f29a412d1e0 0x7f29a4132510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.512+0000 7f29a953a640 1 -- 172.21.15.97:0/4099850111 >> v1:172.21.15.97:6789/0 conn(0x7f29a40a1290 legacy=0x7f29a412d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.512+0000 7f29a953a640 1 -- 172.21.15.97:0/4099850111 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a409cd30 con 0x7f29a4132a50 2024-09-13T18:39:25.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.512+0000 7f29a3fff640 1 --2- 172.21.15.97:0/4099850111 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f29a412d1e0 0x7f29a4132510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:25.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.512+0000 7f29a953a640 1 --2- 172.21.15.97:0/4099850111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29a4132a50 0x7f29a4134e30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f299c009e90 tx=0x7f299c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=923f34961e3056ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:25.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.512+0000 7f29a37fe640 1 -- 172.21.15.97:0/4099850111 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c031400 con 0x7f29a4132a50 2024-09-13T18:39:25.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.512+0000 7f29a37fe640 1 -- 172.21.15.97:0/4099850111 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c02d050 con 0x7f29a4132a50 2024-09-13T18:39:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.512+0000 7f29a37fe640 1 -- 172.21.15.97:0/4099850111 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c0317d0 con 0x7f29a4132a50 2024-09-13T18:39:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.513+0000 7f29aaf9d640 1 -- 172.21.15.97:0/4099850111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29a4132a50 msgr2=0x7f29a4134e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.513+0000 7f29aaf9d640 1 --2- 172.21.15.97:0/4099850111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29a4132a50 0x7f29a4134e30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f299c009e90 tx=0x7f299c009780 comp rx=0 tx=0).stop 2024-09-13T18:39:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.513+0000 7f29aaf9d640 1 -- 172.21.15.97:0/4099850111 shutdown_connections 2024-09-13T18:39:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.513+0000 7f29aaf9d640 1 --2- 172.21.15.97:0/4099850111 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29a4132a50 0x7f29a4134e30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.513+0000 7f29aaf9d640 1 --2- 172.21.15.97:0/4099850111 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f29a412d1e0 0x7f29a4132510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.513+0000 7f29aaf9d640 1 -- 172.21.15.97:0/4099850111 >> 172.21.15.97:0/4099850111 conn(0x7f29a4067820 msgr2=0x7f29a40a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.513+0000 7f29aaf9d640 1 -- 172.21.15.97:0/4099850111 shutdown_connections 2024-09-13T18:39:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.513+0000 7f29aaf9d640 1 -- 172.21.15.97:0/4099850111 wait complete. 2024-09-13T18:39:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.514+0000 7f29aaf9d640 1 Processor -- start 2024-09-13T18:39:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.514+0000 7f29aaf9d640 1 -- start start 2024-09-13T18:39:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.514+0000 7f29aaf9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f29a40a1290 0x7f29a40969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.514+0000 7f29aaf9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29a412d1e0 0x7f29a4096f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.514+0000 7f29aaf9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29a4132a50 0x7f29a4097450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.514+0000 7f29aaf9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a406c150 con 0x7f29a412d1e0 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.514+0000 7f29aaf9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a409a6b0 con 0x7f29a4132a50 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.514+0000 7f29aaf9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29a409abe0 con 0x7f29a40a1290 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a8d39640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f29a40a1290 0x7f29a40969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29a412d1e0 0x7f29a4096f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a953a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29a4132a50 0x7f29a4097450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29a412d1e0 0x7f29a4096f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:37964/0 (socket says 172.21.15.97:37964) 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a3fff640 1 -- 172.21.15.97:0/3879819567 learned_addr learned my addr 172.21.15.97:0/3879819567 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a3fff640 1 -- 172.21.15.97:0/3879819567 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f29a40a1290 msgr2=0x7f29a40969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a3fff640 1 --2- 172.21.15.97:0/3879819567 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f29a40a1290 0x7f29a40969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a3fff640 1 -- 172.21.15.97:0/3879819567 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29a4132a50 msgr2=0x7f29a4097450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a3fff640 1 --2- 172.21.15.97:0/3879819567 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29a4132a50 0x7f29a4097450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a3fff640 1 -- 172.21.15.97:0/3879819567 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2990009390 con 0x7f29a412d1e0 2024-09-13T18:39:25.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a3fff640 1 --2- 172.21.15.97:0/3879819567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29a412d1e0 0x7f29a4096f10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f299000ec80 tx=0x7f29900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:25.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a0ff9640 1 -- 172.21.15.97:0/3879819567 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299000eec0 con 0x7f29a412d1e0 2024-09-13T18:39:25.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a0ff9640 1 -- 172.21.15.97:0/3879819567 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299000cbc0 con 0x7f29a412d1e0 2024-09-13T18:39:25.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29aaf9d640 1 -- 172.21.15.97:0/3879819567 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c009a20 con 0x7f29a412d1e0 2024-09-13T18:39:25.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29a0ff9640 1 -- 172.21.15.97:0/3879819567 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990013470 con 0x7f29a412d1e0 2024-09-13T18:39:25.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.515+0000 7f29aaf9d640 1 -- 172.21.15.97:0/3879819567 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a4098a40 con 0x7f29a412d1e0 2024-09-13T18:39:25.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.516+0000 7f29a0ff9640 1 -- 172.21.15.97:0/3879819567 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f29900137e0 con 0x7f29a412d1e0 2024-09-13T18:39:25.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.516+0000 7f29a0ff9640 1 -- 172.21.15.97:0/3879819567 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f2990042430 con 0x7f29a412d1e0 2024-09-13T18:39:25.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29ad47b740 1 Processor -- start 2024-09-13T18:39:25.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29ad47b740 1 -- start start 2024-09-13T18:39:25.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29ad47b740 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae6473e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29ad47b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae6459050 0x559ae64743a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29ad47b740 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae646e510 0x559ae646e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29ad47b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae63c3e70 con 0x559ae6459050 2024-09-13T18:39:25.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29ad47b740 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ae63c1600 con 0x559ae646e510 2024-09-13T18:39:25.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29ad47b740 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x559ae63bd2e0 con 0x559ae6473a90 2024-09-13T18:39:25.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29a8d39640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae6473e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29a8d39640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae6473e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48530/0 (socket says 172.21.15.97:48530) 2024-09-13T18:39:25.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29a953a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae646e510 0x559ae646e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29a8d39640 1 -- 172.21.15.97:0/15446383 learned_addr learned my addr 172.21.15.97:0/15446383 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:25.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29a3fff640 1 --2- 172.21.15.97:0/15446383 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae6459050 0x559ae64743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29a8d39640 1 -- 172.21.15.97:0/15446383 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae646e510 msgr2=0x559ae646e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29a8d39640 1 --2- 172.21.15.97:0/15446383 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae646e510 0x559ae646e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29a8d39640 1 -- 172.21.15.97:0/15446383 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae6459050 msgr2=0x559ae64743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29a8d39640 1 --2- 172.21.15.97:0/15446383 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae6459050 0x559ae64743a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.518+0000 7f29a8d39640 1 -- 172.21.15.97:0/15446383 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ae60e59e0 con 0x559ae6473a90 2024-09-13T18:39:25.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.519+0000 7f29a8d39640 1 --2- 172.21.15.97:0/15446383 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae6473e60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2998001c80 tx=0x7f2998007cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e15f28c1d76085be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:25.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.519+0000 7f298dffb640 1 -- 172.21.15.97:0/15446383 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998011d90 con 0x559ae6473a90 2024-09-13T18:39:25.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.519+0000 7f298dffb640 1 -- 172.21.15.97:0/15446383 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2998015410 con 0x559ae6473a90 2024-09-13T18:39:25.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.519+0000 7f298dffb640 1 -- 172.21.15.97:0/15446383 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998015790 con 0x559ae6473a90 2024-09-13T18:39:25.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.519+0000 7f29ad47b740 1 -- 172.21.15.97:0/15446383 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 msgr2=0x559ae6473e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.519+0000 7f29ad47b740 1 --2- 172.21.15.97:0/15446383 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae6473e60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2998001c80 tx=0x7f2998007cc0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.519+0000 7f29ad47b740 1 -- 172.21.15.97:0/15446383 shutdown_connections 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.519+0000 7f29ad47b740 1 --2- 172.21.15.97:0/15446383 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae646e510 0x559ae646e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.519+0000 7f29ad47b740 1 --2- 172.21.15.97:0/15446383 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae6459050 0x559ae64743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.519+0000 7f29ad47b740 1 --2- 172.21.15.97:0/15446383 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae6473e60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.519+0000 7f29ad47b740 1 -- 172.21.15.97:0/15446383 >> 172.21.15.97:0/15446383 conn(0x559ae6459b30 msgr2=0x559ae645b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.519+0000 7f29ad47b740 1 -- 172.21.15.97:0/15446383 shutdown_connections 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.519+0000 7f29ad47b740 1 -- 172.21.15.97:0/15446383 wait complete. 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.520+0000 7f29ad47b740 1 -- start start 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.520+0000 7f29ad47b740 1 Processor -- start 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.520+0000 7f29ad47b740 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae6459050 0x559ae64796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.520+0000 7f29ad47b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae646e510 0x559ae6479be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.520+0000 7f29ad47b740 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae647a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.520+0000 7f29ad47b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae635f1b0 con 0x559ae646e510 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.520+0000 7f29ad47b740 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ae635ee50 con 0x559ae6459050 2024-09-13T18:39:25.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.520+0000 7f29ad47b740 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x559ae6107590 con 0x559ae6473a90 2024-09-13T18:39:25.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29ad47b740 10 client.0 _ll_register_callbacks cb 0x559ae63b6b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:39:25.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29a8d39640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae6459050 0x559ae64796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29a8d39640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae6459050 0x559ae64796a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:36220/0 (socket says 172.21.15.97:36220) 2024-09-13T18:39:25.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29a8d39640 1 -- 172.21.15.97:0/3489635969 learned_addr learned my addr 172.21.15.97:0/3489635969 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:25.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29a3fff640 1 --2- 172.21.15.97:0/3489635969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae646e510 0x559ae6479be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29a953a640 1 --2- 172.21.15.97:0/3489635969 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae647a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29a8d39640 1 -- 172.21.15.97:0/3489635969 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 msgr2=0x559ae647a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29a8d39640 1 --2- 172.21.15.97:0/3489635969 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae647a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29a8d39640 1 -- 172.21.15.97:0/3489635969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae646e510 msgr2=0x559ae6479be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29a8d39640 1 --2- 172.21.15.97:0/3489635969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae646e510 0x559ae6479be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29a8d39640 1 -- 172.21.15.97:0/3489635969 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29940034e0 con 0x559ae6459050 2024-09-13T18:39:25.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29a3fff640 1 --2- 172.21.15.97:0/3489635969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae646e510 0x559ae6479be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:25.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29a8d39640 1 --2- 172.21.15.97:0/3489635969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae6459050 0x559ae64796a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29980010e0 tx=0x7f299801a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8514340bce7b41df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:25.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f2982ffd640 10 client.0 ms_handle_connect on v2:172.21.15.97:3301/0 2024-09-13T18:39:25.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f2982ffd640 1 -- 172.21.15.97:0/3489635969 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998011e60 con 0x559ae6459050 2024-09-13T18:39:25.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f2982ffd640 1 -- 172.21.15.97:0/3489635969 <== mon.1 v2:172.21.15.97:3301/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f2998015d50 con 0x559ae6459050 2024-09-13T18:39:25.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29ad47b740 1 -- 172.21.15.97:0/3489635969 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ae60c33c0 con 0x559ae6459050 2024-09-13T18:39:25.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f2982ffd640 1 -- 172.21.15.97:0/3489635969 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7f299801e630 con 0x559ae6459050 2024-09-13T18:39:25.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29ad47b740 10 client.4477 fetch_fsmap learned FSMap version 5 2024-09-13T18:39:25.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f29ad47b740 1 -- 172.21.15.97:0/3489635969 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x559ae636fab0 con 0x559ae6459050 2024-09-13T18:39:25.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.521+0000 7f2982ffd640 1 -- 172.21.15.97:0/3489635969 <== mon.1 v2:172.21.15.97:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ae60c33c0 con 0x559ae6459050 2024-09-13T18:39:25.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.522+0000 7f2982ffd640 1 -- 172.21.15.97:0/3489635969 <== mon.1 v2:172.21.15.97:3301/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f299802a420 con 0x559ae6459050 2024-09-13T18:39:25.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.522+0000 7f29ad47b740 10 client.4477 fetch_fsmap finished waiting for FSMap version 5 2024-09-13T18:39:25.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.522+0000 7f29ad47b740 10 client.4477 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:39:25.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.522+0000 7f29ad47b740 20 client.4477 populate_metadata read hostname 'smithi097' 2024-09-13T18:39:25.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.522+0000 7f29ad47b740 4 client.4477 mds_command: new command op to 4204 tid=0[{"prefix": "get_command_descriptions"}] 2024-09-13T18:39:25.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.522+0000 7f29ad47b740 1 -- 172.21.15.97:0/3489635969 --> v1:172.21.15.97:6817/3890865357 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ae60d46c0 con 0x559ae6490800 2024-09-13T18:39:25.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.522+0000 7f2982ffd640 10 client.4477 ms_handle_connect on v1:172.21.15.97:6817/3890865357 2024-09-13T18:39:25.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.522+0000 7f2982ffd640 1 -- 172.21.15.97:0/3489635969 <== mds.0 v1:172.21.15.97:6817/3890865357 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (unknown 0 0 610023333) 0x559ae60d46c0 con 0x559ae6490800 2024-09-13T18:39:25.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.522+0000 7f2982ffd640 10 client.4477 handle_command_reply: tid=0 2024-09-13T18:39:25.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.522+0000 7f29ad47b740 1 client.4477 shutdown 2024-09-13T18:39:25.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.523+0000 7f29ad47b740 1 -- 172.21.15.97:0/3489635969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae6459050 msgr2=0x559ae64796a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.523+0000 7f29ad47b740 1 --2- 172.21.15.97:0/3489635969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae6459050 0x559ae64796a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29980010e0 tx=0x7f299801a000 comp rx=0 tx=0).stop 2024-09-13T18:39:25.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.523+0000 7f29ad47b740 1 -- 172.21.15.97:0/3489635969 shutdown_connections 2024-09-13T18:39:25.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.523+0000 7f29ad47b740 1 --2- 172.21.15.97:0/3489635969 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae647a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.523+0000 7f2982ffd640 0 client.4477 ms_handle_reset on v1:172.21.15.97:6817/3890865357 2024-09-13T18:39:25.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.523+0000 7f29ad47b740 1 --2- 172.21.15.97:0/3489635969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae646e510 0x559ae6479be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.523+0000 7f29ad47b740 1 --2- 172.21.15.97:0/3489635969 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae6459050 0x559ae64796a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.523+0000 7f29ad47b740 1 -- 172.21.15.97:0/3489635969 >> 172.21.15.97:0/3489635969 conn(0x559ae6459b30 msgr2=0x559ae6473e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:25.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.523+0000 7f29ad47b740 1 -- 172.21.15.97:0/3489635969 shutdown_connections 2024-09-13T18:39:25.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.523+0000 7f29ad47b740 1 -- 172.21.15.97:0/3489635969 wait complete. 2024-09-13T18:39:25.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.523+0000 7f29ad47b740 20 client.4477 trim_cache size 0 max 16384 2024-09-13T18:39:25.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29ad47b740 1 Processor -- start 2024-09-13T18:39:25.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29ad47b740 1 -- start start 2024-09-13T18:39:25.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29ad47b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae6459050 0x559ae6493bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29ad47b740 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae646e510 0x559ae6471850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29ad47b740 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae6471d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29ad47b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae6458e90 con 0x559ae6459050 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29ad47b740 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ae647c740 con 0x559ae646e510 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29ad47b740 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x559ae64986d0 con 0x559ae6473a90 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29a8d39640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae6459050 0x559ae6493bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29a3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae646e510 0x559ae6471850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29a953a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae6471d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29a8d39640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae6459050 0x559ae6493bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38004/0 (socket says 172.21.15.97:38004) 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29a8d39640 1 -- 172.21.15.97:0/4118505515 learned_addr learned my addr 172.21.15.97:0/4118505515 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29a3fff640 1 -- 172.21.15.97:0/4118505515 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 msgr2=0x559ae6471d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29a3fff640 1 --2- 172.21.15.97:0/4118505515 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae6471d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.537+0000 7f29a3fff640 1 -- 172.21.15.97:0/4118505515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae6459050 msgr2=0x559ae6493bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f29a3fff640 1 --2- 172.21.15.97:0/4118505515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae6459050 0x559ae6493bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f29a3fff640 1 -- 172.21.15.97:0/4118505515 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ae6363bc0 con 0x559ae646e510 2024-09-13T18:39:25.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f29a8d39640 1 --2- 172.21.15.97:0/4118505515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae6459050 0x559ae6493bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:25.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f29a3fff640 1 --2- 172.21.15.97:0/4118505515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae646e510 0x559ae6471850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2990041350 tx=0x7f299003e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ccbd59de13cdeb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:25.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f298e7fc640 1 -- 172.21.15.97:0/4118505515 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900238d0 con 0x559ae646e510 2024-09-13T18:39:25.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f298e7fc640 1 -- 172.21.15.97:0/4118505515 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2990023d00 con 0x559ae646e510 2024-09-13T18:39:25.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f298e7fc640 1 -- 172.21.15.97:0/4118505515 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990011e60 con 0x559ae646e510 2024-09-13T18:39:25.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f29ad47b740 1 -- 172.21.15.97:0/4118505515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae646e510 msgr2=0x559ae6471850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f29ad47b740 1 --2- 172.21.15.97:0/4118505515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae646e510 0x559ae6471850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2990041350 tx=0x7f299003e040 comp rx=0 tx=0).stop 2024-09-13T18:39:25.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f29ad47b740 1 -- 172.21.15.97:0/4118505515 shutdown_connections 2024-09-13T18:39:25.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f29ad47b740 1 --2- 172.21.15.97:0/4118505515 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae6471d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f29ad47b740 1 --2- 172.21.15.97:0/4118505515 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae646e510 0x559ae6471850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f29ad47b740 1 --2- 172.21.15.97:0/4118505515 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae6459050 0x559ae6493bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f29ad47b740 1 -- 172.21.15.97:0/4118505515 >> 172.21.15.97:0/4118505515 conn(0x559ae6459b30 msgr2=0x559ae646e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:25.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f29ad47b740 1 -- 172.21.15.97:0/4118505515 shutdown_connections 2024-09-13T18:39:25.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.538+0000 7f29ad47b740 1 -- 172.21.15.97:0/4118505515 wait complete. 2024-09-13T18:39:25.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.539+0000 7f29ad47b740 1 -- start start 2024-09-13T18:39:25.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.539+0000 7f29ad47b740 1 Processor -- start 2024-09-13T18:39:25.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.539+0000 7f29ad47b740 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae6459050 0x559ae64817f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.539+0000 7f29ad47b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae646e510 0x559ae6481d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.539+0000 7f29ad47b740 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae64df440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.539+0000 7f29ad47b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae64c3c90 con 0x559ae646e510 2024-09-13T18:39:25.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.539+0000 7f29ad47b740 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ae635e520 con 0x559ae6459050 2024-09-13T18:39:25.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.539+0000 7f29ad47b740 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x559ae64c2160 con 0x559ae6473a90 2024-09-13T18:39:25.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.539+0000 7f29ad47b740 10 client.0 _ll_register_callbacks cb 0x7f299001f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:39:25.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.539+0000 7f29a8d39640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae6459050 0x559ae64817f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.539+0000 7f29a953a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae64df440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.539+0000 7f29a3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae646e510 0x559ae6481d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f29a3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae646e510 0x559ae6481d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38014/0 (socket says 172.21.15.97:38014) 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f29a3fff640 1 -- 172.21.15.97:0/1291013404 learned_addr learned my addr 172.21.15.97:0/1291013404 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f29a8d39640 1 -- 172.21.15.97:0/1291013404 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 msgr2=0x559ae64df440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f29a8d39640 1 --2- 172.21.15.97:0/1291013404 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae64df440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f29a8d39640 1 -- 172.21.15.97:0/1291013404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae646e510 msgr2=0x559ae6481d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f29a8d39640 1 --2- 172.21.15.97:0/1291013404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae646e510 0x559ae6481d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f29a8d39640 1 -- 172.21.15.97:0/1291013404 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ae636fab0 con 0x559ae6459050 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f29a953a640 1 --2- 172.21.15.97:0/1291013404 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae64df440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f29a3fff640 1 --2- 172.21.15.97:0/1291013404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae646e510 0x559ae6481d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f29a8d39640 1 --2- 172.21.15.97:0/1291013404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae6459050 0x559ae64817f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f299802d040 tx=0x7f2998023040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce3b0aee53ac9879 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f2982ffd640 10 client.0 ms_handle_connect on v2:172.21.15.97:3301/0 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f2982ffd640 1 -- 172.21.15.97:0/1291013404 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998001800 con 0x559ae6459050 2024-09-13T18:39:25.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f2982ffd640 1 -- 172.21.15.97:0/1291013404 <== mon.1 v2:172.21.15.97:3301/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f299802a930 con 0x559ae6459050 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f29ad47b740 1 -- 172.21.15.97:0/1291013404 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2998015410 con 0x559ae6459050 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f2982ffd640 1 -- 172.21.15.97:0/1291013404 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7f299803da60 con 0x559ae6459050 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f29ad47b740 10 client.4483 fetch_fsmap learned FSMap version 5 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f29ad47b740 1 -- 172.21.15.97:0/1291013404 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x7f29a4098a40 con 0x559ae6459050 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.540+0000 7f2982ffd640 1 -- 172.21.15.97:0/1291013404 <== mon.1 v2:172.21.15.97:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2998015410 con 0x559ae6459050 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f2982ffd640 1 -- 172.21.15.97:0/1291013404 <== mon.1 v2:172.21.15.97:3301/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f299801ec40 con 0x559ae6459050 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f29ad47b740 10 client.4483 fetch_fsmap finished waiting for FSMap version 5 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f29ad47b740 10 client.4483 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f29ad47b740 20 client.4483 populate_metadata read hostname 'smithi097' 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f29ad47b740 4 client.4483 mds_command: new command op to 4204 tid=0[{"prefix": "status"}] 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f29ad47b740 1 -- 172.21.15.97:0/1291013404 --> v1:172.21.15.97:6817/3890865357 -- command(tid 0: {"prefix": "status"}) v1 -- 0x559ae6127d10 con 0x559ae64dfc90 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f2982ffd640 10 client.4483 ms_handle_connect on v1:172.21.15.97:6817/3890865357 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f2982ffd640 1 -- 172.21.15.97:0/1291013404 <== mds.0 v1:172.21.15.97:6817/3890865357 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (unknown 0 0 4050920176) 0x559ae6127d10 con 0x559ae64dfc90 2024-09-13T18:39:25.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f2982ffd640 10 client.4483 handle_command_reply: tid=0 2024-09-13T18:39:25.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f29ad47b740 1 client.4483 shutdown 2024-09-13T18:39:25.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f29ad47b740 1 -- 172.21.15.97:0/1291013404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae6459050 msgr2=0x559ae64817f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f29ad47b740 1 --2- 172.21.15.97:0/1291013404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae6459050 0x559ae64817f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f299802d040 tx=0x7f2998023040 comp rx=0 tx=0).stop 2024-09-13T18:39:25.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f29ad47b740 1 -- 172.21.15.97:0/1291013404 shutdown_connections 2024-09-13T18:39:25.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f29ad47b740 1 --2- 172.21.15.97:0/1291013404 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x559ae6473a90 0x559ae64df440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f2982ffd640 0 client.4483 ms_handle_reset on v1:172.21.15.97:6817/3890865357 2024-09-13T18:39:25.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f29ad47b740 1 --2- 172.21.15.97:0/1291013404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559ae646e510 0x559ae6481d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f29ad47b740 1 --2- 172.21.15.97:0/1291013404 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x559ae6459050 0x559ae64817f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.541+0000 7f29ad47b740 1 -- 172.21.15.97:0/1291013404 >> 172.21.15.97:0/1291013404 conn(0x559ae6459b30 msgr2=0x559ae6471850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:25.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.542+0000 7f29ad47b740 1 -- 172.21.15.97:0/1291013404 shutdown_connections 2024-09-13T18:39:25.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.542+0000 7f29ad47b740 1 -- 172.21.15.97:0/1291013404 wait complete. 2024-09-13T18:39:25.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.542+0000 7f29ad47b740 20 client.4483 trim_cache size 0 max 16384 2024-09-13T18:39:25.552 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-13T18:39:25.552 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_fsid": "26171290-0086-4a00-9403-ffac581535bf", 2024-09-13T18:39:25.552 INFO:teuthology.orchestra.run.smithi097.stdout: "whoami": 0, 2024-09-13T18:39:25.552 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 4204, 2024-09-13T18:39:25.552 INFO:teuthology.orchestra.run.smithi097.stdout: "want_state": "up:active", 2024-09-13T18:39:25.552 INFO:teuthology.orchestra.run.smithi097.stdout: "state": "up:active", 2024-09-13T18:39:25.552 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs", 2024-09-13T18:39:25.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rank_uptime": 10.991587744, 2024-09-13T18:39:25.552 INFO:teuthology.orchestra.run.smithi097.stdout: "mdsmap_epoch": 5, 2024-09-13T18:39:25.552 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch": 20, 2024-09-13T18:39:25.552 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch_barrier": 20, 2024-09-13T18:39:25.552 INFO:teuthology.orchestra.run.smithi097.stdout: "uptime": 15.920588592 2024-09-13T18:39:25.553 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-13T18:39:25.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.542+0000 7f29aaf9d640 1 -- 172.21.15.97:0/3879819567 >> v1:172.21.15.97:6816/34603 conn(0x7f2988031160 legacy=0x7f2988033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.542+0000 7f29aaf9d640 1 -- 172.21.15.97:0/3879819567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29a412d1e0 msgr2=0x7f29a4096f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.542+0000 7f29aaf9d640 1 --2- 172.21.15.97:0/3879819567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29a412d1e0 0x7f29a4096f10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f299000ec80 tx=0x7f29900090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.542+0000 7f29aaf9d640 1 -- 172.21.15.97:0/3879819567 shutdown_connections 2024-09-13T18:39:25.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.542+0000 7f29aaf9d640 1 --2- 172.21.15.97:0/3879819567 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f29a4132a50 0x7f29a4097450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.542+0000 7f29aaf9d640 1 --2- 172.21.15.97:0/3879819567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29a412d1e0 0x7f29a4096f10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.542+0000 7f29aaf9d640 1 --2- 172.21.15.97:0/3879819567 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f29a40a1290 0x7f29a40969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.542+0000 7f29aaf9d640 1 -- 172.21.15.97:0/3879819567 >> 172.21.15.97:0/3879819567 conn(0x7f29a4067820 msgr2=0x7f29a409e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:25.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.542+0000 7f29aaf9d640 1 -- 172.21.15.97:0/3879819567 shutdown_connections 2024-09-13T18:39:25.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.542+0000 7f29aaf9d640 1 -- 172.21.15.97:0/3879819567 wait complete. 2024-09-13T18:39:25.555 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T18:39:25.565 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T18:39:25.565 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi097.front.sepia.ceph.com 2024-09-13T18:39:25.566 DEBUG:teuthology.orchestra.run.smithi097:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client quincy' 2024-09-13T18:39:25.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.658+0000 7f554a59d640 1 Processor -- start 2024-09-13T18:39:25.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.658+0000 7f554a59d640 1 -- start start 2024-09-13T18:39:25.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.658+0000 7f554a59d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f554412b800 0x7f554412bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.658+0000 7f554a59d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f554412c110 0x7f5544128300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.658+0000 7f554a59d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5544097f80 con 0x7f554409c760 2024-09-13T18:39:25.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.658+0000 7f554a59d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5544098950 con 0x7f554412b800 2024-09-13T18:39:25.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.658+0000 7f554a59d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f554409e460 con 0x7f554412c110 2024-09-13T18:39:25.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.659+0000 7f5543fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f554412b800 0x7f554412bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.659+0000 7f55437fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f554412c110 0x7f5544128300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.659+0000 7f5543fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f554412b800 0x7f554412bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38018/0 (socket says 172.21.15.97:38018) 2024-09-13T18:39:25.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.659+0000 7f55437fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f554412c110 0x7f5544128300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:48570/0 (socket says 172.21.15.97:48570) 2024-09-13T18:39:25.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.659+0000 7f5543fff640 1 -- 172.21.15.97:0/3664748351 learned_addr learned my addr 172.21.15.97:0/3664748351 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:25.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.659+0000 7f5548b3a640 1 --1- 172.21.15.97:0/3664748351 >> v1:172.21.15.97:6789/0 conn(0x7f554409c760 0x7f5544128840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47994/0 (socket says 172.21.15.97:47994) 2024-09-13T18:39:25.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.659+0000 7f55437fe640 1 -- 172.21.15.97:0/3664748351 >> v2:172.21.15.97:3300/0 conn(0x7f554412b800 msgr2=0x7f554412bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:25.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.659+0000 7f55437fe640 1 --2- 172.21.15.97:0/3664748351 >> v2:172.21.15.97:3300/0 conn(0x7f554412b800 0x7f554412bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.659+0000 7f55437fe640 1 -- 172.21.15.97:0/3664748351 >> v1:172.21.15.97:6789/0 conn(0x7f554409c760 legacy=0x7f5544128840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.659+0000 7f55437fe640 1 -- 172.21.15.97:0/3664748351 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5544098d80 con 0x7f554412c110 2024-09-13T18:39:25.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.659+0000 7f5543fff640 1 --2- 172.21.15.97:0/3664748351 >> v2:172.21.15.97:3300/0 conn(0x7f554412b800 0x7f554412bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:25.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.660+0000 7f55437fe640 1 --2- 172.21.15.97:0/3664748351 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f554412c110 0x7f5544128300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5538009850 tx=0x7f55380090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbd67f09cf0648e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:25.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.660+0000 7f5542ffd640 1 -- 172.21.15.97:0/3664748351 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553802ac80 con 0x7f554412c110 2024-09-13T18:39:25.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.660+0000 7f5542ffd640 1 -- 172.21.15.97:0/3664748351 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553802ade0 con 0x7f554412c110 2024-09-13T18:39:25.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.660+0000 7f5542ffd640 1 -- 172.21.15.97:0/3664748351 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538032670 con 0x7f554412c110 2024-09-13T18:39:25.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.660+0000 7f554a59d640 1 -- 172.21.15.97:0/3664748351 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f554412c110 msgr2=0x7f5544128300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.660+0000 7f554a59d640 1 --2- 172.21.15.97:0/3664748351 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f554412c110 0x7f5544128300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5538009850 tx=0x7f55380090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.660+0000 7f554a59d640 1 -- 172.21.15.97:0/3664748351 shutdown_connections 2024-09-13T18:39:25.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.660+0000 7f554a59d640 1 --2- 172.21.15.97:0/3664748351 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f554412c110 0x7f5544128300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.660+0000 7f554a59d640 1 --2- 172.21.15.97:0/3664748351 >> v2:172.21.15.97:3300/0 conn(0x7f554412b800 0x7f554412bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.660+0000 7f554a59d640 1 -- 172.21.15.97:0/3664748351 >> 172.21.15.97:0/3664748351 conn(0x7f5544063970 msgr2=0x7f554409e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:25.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.660+0000 7f554a59d640 1 -- 172.21.15.97:0/3664748351 shutdown_connections 2024-09-13T18:39:25.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.660+0000 7f554a59d640 1 -- 172.21.15.97:0/3664748351 wait complete. 2024-09-13T18:39:25.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.661+0000 7f554a59d640 1 Processor -- start 2024-09-13T18:39:25.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.661+0000 7f554a59d640 1 -- start start 2024-09-13T18:39:25.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f554a59d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f554409c760 0x7f554413ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f554a59d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f554412b800 0x7f554413d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f554a59d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f554412c110 0x7f554406c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:25.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f554a59d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554406e8c0 con 0x7f554412c110 2024-09-13T18:39:25.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f554a59d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5544125fb0 con 0x7f554409c760 2024-09-13T18:39:25.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f554a59d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5544115c10 con 0x7f554412b800 2024-09-13T18:39:25.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f5543fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f554409c760 0x7f554413ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f5548b3a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f554412c110 0x7f554406c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f55437fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f554412b800 0x7f554413d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:25.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f5543fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f554409c760 0x7f554413ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:36242/0 (socket says 172.21.15.97:36242) 2024-09-13T18:39:25.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f5548b3a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f554412c110 0x7f554406c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38032/0 (socket says 172.21.15.97:38032) 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f5543fff640 1 -- 172.21.15.97:0/1678396121 learned_addr learned my addr 172.21.15.97:0/1678396121 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f5543fff640 1 -- 172.21.15.97:0/1678396121 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f554412b800 msgr2=0x7f554413d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f5543fff640 1 --2- 172.21.15.97:0/1678396121 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f554412b800 0x7f554413d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f5543fff640 1 -- 172.21.15.97:0/1678396121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f554412c110 msgr2=0x7f554406c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f5543fff640 1 --2- 172.21.15.97:0/1678396121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f554412c110 0x7f554406c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f5543fff640 1 -- 172.21.15.97:0/1678396121 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5534009450 con 0x7f554409c760 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f5543fff640 1 --2- 172.21.15.97:0/1678396121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f554409c760 0x7f554413ceb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f553400ec80 tx=0x7f55340091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f552bfff640 1 -- 172.21.15.97:0/1678396121 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553400eec0 con 0x7f554409c760 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f552bfff640 1 -- 172.21.15.97:0/1678396121 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553400cbc0 con 0x7f554409c760 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f552bfff640 1 -- 172.21.15.97:0/1678396121 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534013470 con 0x7f554409c760 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.662+0000 7f554a59d640 1 -- 172.21.15.97:0/1678396121 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5538009390 con 0x7f554409c760 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.663+0000 7f554a59d640 1 -- 172.21.15.97:0/1678396121 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5544115670 con 0x7f554409c760 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.663+0000 7f552bfff640 1 -- 172.21.15.97:0/1678396121 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f5534013820 con 0x7f554409c760 2024-09-13T18:39:25.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.663+0000 7f552bfff640 1 -- 172.21.15.97:0/1678396121 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f5534042480 con 0x7f554409c760 2024-09-13T18:39:25.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.663+0000 7f554a59d640 1 -- 172.21.15.97:0/1678396121 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5544071790 con 0x7f554409c760 2024-09-13T18:39:25.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.668+0000 7f552bfff640 1 -- 172.21.15.97:0/1678396121 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f5534021080 con 0x7f554409c760 2024-09-13T18:39:25.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:25.827+0000 7f554a59d640 1 -- 172.21.15.97:0/1678396121 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "quincy"} v 0) v1 -- 0x7f55440008d0 con 0x7f554409c760 2024-09-13T18:39:26.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.611+0000 7f552bfff640 1 -- 172.21.15.97:0/1678396121 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "quincy"}]=0 set require_min_compat_client to quincy v21) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5534023ad0 con 0x7f554409c760 2024-09-13T18:39:26.614 INFO:teuthology.orchestra.run.smithi097.stderr:set require_min_compat_client to quincy 2024-09-13T18:39:26.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.613+0000 7f554a59d640 1 -- 172.21.15.97:0/1678396121 >> v1:172.21.15.97:6816/34603 conn(0x7f5530031160 legacy=0x7f5530033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:26.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.613+0000 7f554a59d640 1 -- 172.21.15.97:0/1678396121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f554409c760 msgr2=0x7f554413ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:26.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.613+0000 7f554a59d640 1 --2- 172.21.15.97:0/1678396121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f554409c760 0x7f554413ceb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f553400ec80 tx=0x7f55340091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:26.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.614+0000 7f554a59d640 1 -- 172.21.15.97:0/1678396121 shutdown_connections 2024-09-13T18:39:26.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.614+0000 7f554a59d640 1 --2- 172.21.15.97:0/1678396121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f554412c110 0x7f554406c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:26.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.614+0000 7f554a59d640 1 --2- 172.21.15.97:0/1678396121 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f554412b800 0x7f554413d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:26.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.614+0000 7f554a59d640 1 --2- 172.21.15.97:0/1678396121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f554409c760 0x7f554413ceb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:26.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.614+0000 7f554a59d640 1 -- 172.21.15.97:0/1678396121 >> 172.21.15.97:0/1678396121 conn(0x7f5544063970 msgr2=0x7f55441281f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:26.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.614+0000 7f554a59d640 1 -- 172.21.15.97:0/1678396121 shutdown_connections 2024-09-13T18:39:26.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.614+0000 7f554a59d640 1 -- 172.21.15.97:0/1678396121 wait complete. 2024-09-13T18:39:26.628 INFO:teuthology.run_tasks:Running task print... 2024-09-13T18:39:26.636 INFO:teuthology.task.print:**** done ceph 2024-09-13T18:39:26.636 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T18:39:26.664 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T18:39:26.664 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-13T18:39:26.664 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-13T18:39:26.664 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:39:26.665 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:39:26.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:26.665 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-13T18:39:26.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:26.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-09-13T18:39:26.756 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-09-13T18:39:26.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:39:26.758 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T18:39:26.758 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:39:26.758 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:39:26.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.852+0000 7f7cf7d5d640 1 Processor -- start 2024-09-13T18:39:26.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.852+0000 7f7cf7d5d640 1 -- start start 2024-09-13T18:39:26.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.852+0000 7f7cf7d5d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7cf009bf60 0x7f7cf006e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:26.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.852+0000 7f7cf7d5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cf006ebd0 0x7f7cf009a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:26.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.852+0000 7f7cf7d5d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7cf009aaa0 0x7f7cf009af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:26.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.852+0000 7f7cf7d5d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf009c330 con 0x7f7cf009aaa0 2024-09-13T18:39:26.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.852+0000 7f7cf7d5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf0097690 con 0x7f7cf006ebd0 2024-09-13T18:39:26.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.852+0000 7f7cf7d5d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf00698c0 con 0x7f7cf009bf60 2024-09-13T18:39:26.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.852+0000 7f7cf52f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cf006ebd0 0x7f7cf009a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:26.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.852+0000 7f7cf5af9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7cf009bf60 0x7f7cf006e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:26.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.852+0000 7f7cf62fa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7cf009aaa0 0x7f7cf009af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:26.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.852+0000 7f7cf52f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cf006ebd0 0x7f7cf009a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:36244/0 (socket says 172.21.15.97:36244) 2024-09-13T18:39:26.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.852+0000 7f7cf52f8640 1 -- 172.21.15.97:0/3581616709 learned_addr learned my addr 172.21.15.97:0/3581616709 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:26.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.853+0000 7f7cf52f8640 1 -- 172.21.15.97:0/3581616709 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7cf009bf60 msgr2=0x7f7cf006e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:26.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.853+0000 7f7cf52f8640 1 --2- 172.21.15.97:0/3581616709 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7cf009bf60 0x7f7cf006e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:26.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.853+0000 7f7cf52f8640 1 -- 172.21.15.97:0/3581616709 >> v2:172.21.15.97:3300/0 conn(0x7f7cf009aaa0 msgr2=0x7f7cf009af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:26.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.853+0000 7f7cf52f8640 1 --2- 172.21.15.97:0/3581616709 >> v2:172.21.15.97:3300/0 conn(0x7f7cf009aaa0 0x7f7cf009af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:26.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.853+0000 7f7cf52f8640 1 -- 172.21.15.97:0/3581616709 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf0066230 con 0x7f7cf006ebd0 2024-09-13T18:39:26.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.853+0000 7f7cf62fa640 1 --2- 172.21.15.97:0/3581616709 >> v2:172.21.15.97:3300/0 conn(0x7f7cf009aaa0 0x7f7cf009af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:26.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.853+0000 7f7cf52f8640 1 --2- 172.21.15.97:0/3581616709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cf006ebd0 0x7f7cf009a560 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0009970 tx=0x7f7ce00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef23c0f1ec156363 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:26.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.854+0000 7f7cf4af7640 1 -- 172.21.15.97:0/3581616709 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce002ad40 con 0x7f7cf006ebd0 2024-09-13T18:39:26.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.854+0000 7f7cf4af7640 1 -- 172.21.15.97:0/3581616709 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce0032440 con 0x7f7cf006ebd0 2024-09-13T18:39:26.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.854+0000 7f7cf4af7640 1 -- 172.21.15.97:0/3581616709 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce002aea0 con 0x7f7cf006ebd0 2024-09-13T18:39:26.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.854+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/3581616709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cf006ebd0 msgr2=0x7f7cf009a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:26.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.854+0000 7f7cf7d5d640 1 --2- 172.21.15.97:0/3581616709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cf006ebd0 0x7f7cf009a560 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0009970 tx=0x7f7ce00091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:26.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.854+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/3581616709 shutdown_connections 2024-09-13T18:39:26.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.854+0000 7f7cf7d5d640 1 --2- 172.21.15.97:0/3581616709 >> v2:172.21.15.97:3300/0 conn(0x7f7cf009aaa0 0x7f7cf009af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:26.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.854+0000 7f7cf7d5d640 1 --2- 172.21.15.97:0/3581616709 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cf006ebd0 0x7f7cf009a560 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:26.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.854+0000 7f7cf7d5d640 1 --2- 172.21.15.97:0/3581616709 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7cf009bf60 0x7f7cf006e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:26.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.854+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/3581616709 >> 172.21.15.97:0/3581616709 conn(0x7f7cf009f5e0 msgr2=0x7f7cf009b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:26.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.854+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/3581616709 shutdown_connections 2024-09-13T18:39:26.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.854+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/3581616709 wait complete. 2024-09-13T18:39:26.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.855+0000 7f7cf7d5d640 1 Processor -- start 2024-09-13T18:39:26.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.855+0000 7f7cf7d5d640 1 -- start start 2024-09-13T18:39:26.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.855+0000 7f7cf7d5d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cf006ebd0 0x7f7cf013c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:26.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.855+0000 7f7cf7d5d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7cf009aaa0 0x7f7cf013ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:26.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.855+0000 7f7cf7d5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cf009bf60 0x7f7cf011c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:26.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf7d5d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf006d920 con 0x7f7cf006ebd0 2024-09-13T18:39:26.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf7d5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf00989a0 con 0x7f7cf009bf60 2024-09-13T18:39:26.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf7d5d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf01201a0 con 0x7f7cf009aaa0 2024-09-13T18:39:26.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf5af9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cf006ebd0 0x7f7cf013c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:26.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf52f8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7cf009aaa0 0x7f7cf013ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:26.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf5af9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cf006ebd0 0x7f7cf013c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38048/0 (socket says 172.21.15.97:38048) 2024-09-13T18:39:26.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf5af9640 1 -- 172.21.15.97:0/249631236 learned_addr learned my addr 172.21.15.97:0/249631236 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:26.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf62fa640 1 --2- 172.21.15.97:0/249631236 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cf009bf60 0x7f7cf011c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:26.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf5af9640 1 -- 172.21.15.97:0/249631236 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7cf009aaa0 msgr2=0x7f7cf013ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:26.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf5af9640 1 --2- 172.21.15.97:0/249631236 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7cf009aaa0 0x7f7cf013ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:26.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf5af9640 1 -- 172.21.15.97:0/249631236 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cf009bf60 msgr2=0x7f7cf011c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:26.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf5af9640 1 --2- 172.21.15.97:0/249631236 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cf009bf60 0x7f7cf011c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:26.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf5af9640 1 -- 172.21.15.97:0/249631236 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce8009a20 con 0x7f7cf006ebd0 2024-09-13T18:39:26.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf5af9640 1 --2- 172.21.15.97:0/249631236 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cf006ebd0 0x7f7cf013c900 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00ea20 tx=0x7f7cec0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:26.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7ce5ffb640 1 -- 172.21.15.97:0/249631236 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec00c940 con 0x7f7cf006ebd0 2024-09-13T18:39:26.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7ce5ffb640 1 -- 172.21.15.97:0/249631236 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec00caa0 con 0x7f7cf006ebd0 2024-09-13T18:39:26.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/249631236 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce0009450 con 0x7f7cf006ebd0 2024-09-13T18:39:26.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7ce5ffb640 1 -- 172.21.15.97:0/249631236 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec00ce20 con 0x7f7cf006ebd0 2024-09-13T18:39:26.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.856+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/249631236 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf011e300 con 0x7f7cf006ebd0 2024-09-13T18:39:26.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.857+0000 7f7ce5ffb640 1 -- 172.21.15.97:0/249631236 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f7cec013680 con 0x7f7cf006ebd0 2024-09-13T18:39:26.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.857+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/249631236 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf0064000 con 0x7f7cf006ebd0 2024-09-13T18:39:26.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.857+0000 7f7ce5ffb640 1 -- 172.21.15.97:0/249631236 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3660+0+0 (secure 0 0 0) 0x7f7cec0422d0 con 0x7f7cf006ebd0 2024-09-13T18:39:26.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:26.862+0000 7f7ce5ffb640 1 -- 172.21.15.97:0/249631236 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f7cec0236b0 con 0x7f7cf006ebd0 2024-09-13T18:39:27.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:27.044+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/249631236 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7cf0067a60 con 0x7f7cf006ebd0 2024-09-13T18:39:27.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:27.044+0000 7f7ce5ffb640 1 -- 172.21.15.97:0/249631236 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v5) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7cec021020 con 0x7f7cf006ebd0 2024-09-13T18:39:27.047 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:39:27.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:27.046+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/249631236 >> v1:172.21.15.97:6816/34603 conn(0x7f7cd4031160 legacy=0x7f7cd4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:27.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:27.046+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/249631236 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cf006ebd0 msgr2=0x7f7cf013c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:27.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:27.046+0000 7f7cf7d5d640 1 --2- 172.21.15.97:0/249631236 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cf006ebd0 0x7f7cf013c900 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00ea20 tx=0x7f7cec0090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:27.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:27.046+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/249631236 shutdown_connections 2024-09-13T18:39:27.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:27.046+0000 7f7cf7d5d640 1 --2- 172.21.15.97:0/249631236 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7cf009bf60 0x7f7cf011c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:27.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:27.046+0000 7f7cf7d5d640 1 --2- 172.21.15.97:0/249631236 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7cf009aaa0 0x7f7cf013ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:27.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:27.046+0000 7f7cf7d5d640 1 --2- 172.21.15.97:0/249631236 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cf006ebd0 0x7f7cf013c900 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:27.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:27.046+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/249631236 >> 172.21.15.97:0/249631236 conn(0x7f7cf009f5e0 msgr2=0x7f7cf006c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:27.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:27.046+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/249631236 shutdown_connections 2024-09-13T18:39:27.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:27.046+0000 7f7cf7d5d640 1 -- 172.21.15.97:0/249631236 wait complete. 2024-09-13T18:39:27.059 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:39:27.059 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:39:27.059 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-09-13T18:39:27.059 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:39:27.059 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:39:27.060 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:39:27.060 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:39:27.060 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:39:27.060 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:39:27.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:27.060 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-09-13T18:39:27.076 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:39:27.076 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:39:27.076 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:39:27.077 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:39:27.077 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-09-13T18:39:27.077 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:39:27.077 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:39:27.077 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:39:27.077 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-09-13T18:39:27.077 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:39:27.077 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:39:27.077 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-09-13T18:39:27.077 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:39:27.077 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:39:27.077 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:39:27.078 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:39:27.078 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:39:27.078 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42821sec preferred_lft 42821sec 2024-09-13T18:39:27.078 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2024-09-13T18:39:27.078 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:39:27.078 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:39:27.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:27.079 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-09-13T18:39:27.079 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T18:39:27.079 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:39:27.079 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2024-09-13T18:39:27.079 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2024-09-13T18:39:27.079 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:39:27.079 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T18:39:27.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:27.246 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:39:27.269 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-09-13T18:39:27.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:27.271 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-09-13T18:39:27.337 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-09-13T18:39:27.338 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:39:27.338 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:39:27.338 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:39:27.338 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:39:27.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:27.338 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-09-13T18:39:27.339 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T18:39:27.339 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:39:27.339 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:39:27.339 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:39:27.339 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T18:39:27.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:27.593 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-13T18:39:27.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:27.609 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-09-13T18:39:27.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:27.664 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-09-13T18:39:27.664 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T18:39:27.664 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:39:27.664 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:39:27.664 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T18:39:27.743 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:39:27.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:27.743 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-09-13T18:39:27.743 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T18:39:27.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:39:27.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:39:27.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:39:27.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:39:27.744 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:39:27.744 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T18:39:27.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:27.873 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-09-13T18:39:27.873 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T18:39:27.873 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2024-09-13T18:39:27.873 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:39:27.873 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T18:39:27.910 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:39:27.910 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:39:27.910 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:39:27.970 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:39:27.970 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:39:27.970 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:39:28.024 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-09-13T18:39:28.090 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:39:28.090 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:39:28.153 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:39:28.154 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:39:28.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:28.155 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-09-13T18:39:28.210 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:39:28.210 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:39:28.253 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-09-13T18:39:28.277 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:39:28.277 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:39:28.343 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:39:28.345 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:39:28.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:28.345 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-09-13T18:39:28.355 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi142.stderr:2024-09-13T18:39:28.353+0000 7fd5db0d1300 -1 init, newargv = 0x558c058afa10 newargc=15 2024-09-13T18:39:28.355 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi142.stderr:ceph-fuse[28917]: starting ceph client 2024-09-13T18:39:28.360 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi142.stderr:ceph-fuse[28917]: starting fuse 2024-09-13T18:39:28.370 INFO:teuthology.orchestra.run.smithi142.stdout:41 2024-09-13T18:39:28.370 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-13T18:39:28.370 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:39:28.370 DEBUG:teuthology.orchestra.run.smithi142:> import glob 2024-09-13T18:39:28.370 DEBUG:teuthology.orchestra.run.smithi142:> import re 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> import os 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> def _find_admin_socket(client_name): 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> files = glob.glob(asok_path) 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> # Given a non-glob path, it better be there 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> if "*" not in asok_path: 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> assert(len(files) == 1) 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> return files[0] 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> 2024-09-13T18:39:28.371 DEBUG:teuthology.orchestra.run.smithi142:> for f in files: 2024-09-13T18:39:28.372 DEBUG:teuthology.orchestra.run.smithi142:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:39:28.372 DEBUG:teuthology.orchestra.run.smithi142:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:39:28.372 DEBUG:teuthology.orchestra.run.smithi142:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:39:28.372 DEBUG:teuthology.orchestra.run.smithi142:> contents = proc_f.read() 2024-09-13T18:39:28.372 DEBUG:teuthology.orchestra.run.smithi142:> if mountpoint in contents: 2024-09-13T18:39:28.372 DEBUG:teuthology.orchestra.run.smithi142:> return f 2024-09-13T18:39:28.372 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:39:28.372 DEBUG:teuthology.orchestra.run.smithi142:> 2024-09-13T18:39:28.372 DEBUG:teuthology.orchestra.run.smithi142:> print(_find_admin_socket("client.0")) 2024-09-13T18:39:28.372 DEBUG:teuthology.orchestra.run.smithi142:> ' 2024-09-13T18:39:28.483 INFO:teuthology.orchestra.run.smithi142.stdout:/var/run/ceph/ceph-client.0.28917.asok 2024-09-13T18:39:28.670 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.28917.asok 2024-09-13T18:39:28.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:28.671 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.28917.asok status 2024-09-13T18:39:28.799 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-09-13T18:39:28.799 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": { 2024-09-13T18:39:28.799 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_sha1": "eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b", 2024-09-13T18:39:28.799 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)", 2024-09-13T18:39:28.799 INFO:teuthology.orchestra.run.smithi142.stdout: "entity_id": "0", 2024-09-13T18:39:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "hostname": "smithi142", 2024-09-13T18:39:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:39:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "pid": "28917", 2024-09-13T18:39:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "root": "/" 2024-09-13T18:39:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-13T18:39:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_count": 0, 2024-09-13T18:39:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_pinned_count": 0, 2024-09-13T18:39:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 4659, 2024-09-13T18:39:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "inst": { 2024-09-13T18:39:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "name": { 2024-09-13T18:39:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "client", 2024-09-13T18:39:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "num": 4659 2024-09-13T18:39:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-13T18:39:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2024-09-13T18:39:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2024-09-13T18:39:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:0", 2024-09-13T18:39:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 3391610936 2024-09-13T18:39:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-13T18:39:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-13T18:39:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2024-09-13T18:39:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2024-09-13T18:39:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:0", 2024-09-13T18:39:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 3391610936 2024-09-13T18:39:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-13T18:39:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "inst_str": "client.4659 172.21.15.142:0/3391610936", 2024-09-13T18:39:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "addr_str": "172.21.15.142:0/3391610936", 2024-09-13T18:39:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "inode_count": 1, 2024-09-13T18:39:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_epoch": 5, 2024-09-13T18:39:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch": 21, 2024-09-13T18:39:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:39:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklisted": false, 2024-09-13T18:39:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs" 2024-09-13T18:39:28.802 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-09-13T18:39:28.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:28.807 DEBUG:teuthology.orchestra.run.smithi142:> stat --file-system '--printf=%T 2024-09-13T18:39:28.807 DEBUG:teuthology.orchestra.run.smithi142:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:39:28.823 INFO:teuthology.orchestra.run.smithi142.stdout:fuseblk 2024-09-13T18:39:28.823 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:39:28.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:28.823 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:39:28.888 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T18:39:28.898 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T18:39:28.898 INFO:tasks.ceph_fuse:config is {'client.0': {'mounted': False}} 2024-09-13T18:39:28.898 INFO:tasks.ceph_fuse:client.0 config is {'mounted': False} 2024-09-13T18:39:28.898 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:39:28.899 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:39:28.944 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:39:28.944 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:39:28.999 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:29.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.101+0000 7f90ca19d640 1 Processor -- start 2024-09-13T18:39:29.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.101+0000 7f90ca19d640 1 -- start start 2024-09-13T18:39:29.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90ca19d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f90c4097690 0x7f90c4131350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90ca19d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f90c40969d0 0x7f90c41338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90ca19d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c406a190 con 0x7f90c409dfb0 2024-09-13T18:39:29.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90ca19d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c409e380 con 0x7f90c40969d0 2024-09-13T18:39:29.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90ca19d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4098870 con 0x7f90c4097690 2024-09-13T18:39:29.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90c3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f90c40969d0 0x7f90c41338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90c2ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f90c4097690 0x7f90c4131350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90c37fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f90c409dfb0 0x7f90c4096f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53298/0 (socket says 172.21.15.97:53298) 2024-09-13T18:39:29.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90c37fe640 1 -- 172.21.15.97:0/3116402491 learned_addr learned my addr 172.21.15.97:0/3116402491 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:29.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90c2ffd640 1 -- 172.21.15.97:0/3116402491 >> v2:172.21.15.97:3300/0 conn(0x7f90c40969d0 msgr2=0x7f90c41338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:29.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90c2ffd640 1 --2- 172.21.15.97:0/3116402491 >> v2:172.21.15.97:3300/0 conn(0x7f90c40969d0 0x7f90c41338a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90c2ffd640 1 -- 172.21.15.97:0/3116402491 >> v1:172.21.15.97:6789/0 conn(0x7f90c409dfb0 legacy=0x7f90c4096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90c2ffd640 1 -- 172.21.15.97:0/3116402491 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c4098e10 con 0x7f90c4097690 2024-09-13T18:39:29.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90c27fc640 1 -- 172.21.15.97:0/3116402491 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575881743 0 0) 0x7f90c406a190 con 0x7f90c409dfb0 2024-09-13T18:39:29.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.102+0000 7f90c3fff640 1 --2- 172.21.15.97:0/3116402491 >> v2:172.21.15.97:3300/0 conn(0x7f90c40969d0 0x7f90c41338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:29.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.103+0000 7f90c2ffd640 1 --2- 172.21.15.97:0/3116402491 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f90c4097690 0x7f90c4131350 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f90b8009850 tx=0x7f90b80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee7ec99351d085e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:29.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.103+0000 7f90c27fc640 1 -- 172.21.15.97:0/3116402491 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b802ac80 con 0x7f90c4097690 2024-09-13T18:39:29.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.103+0000 7f90c27fc640 1 -- 172.21.15.97:0/3116402491 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b802ade0 con 0x7f90c4097690 2024-09-13T18:39:29.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.103+0000 7f90c27fc640 1 -- 172.21.15.97:0/3116402491 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8032670 con 0x7f90c4097690 2024-09-13T18:39:29.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.104+0000 7f90ca19d640 1 -- 172.21.15.97:0/3116402491 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f90c4097690 msgr2=0x7f90c4131350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.104+0000 7f90ca19d640 1 --2- 172.21.15.97:0/3116402491 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f90c4097690 0x7f90c4131350 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f90b8009850 tx=0x7f90b80090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.104+0000 7f90ca19d640 1 -- 172.21.15.97:0/3116402491 shutdown_connections 2024-09-13T18:39:29.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.104+0000 7f90ca19d640 1 --2- 172.21.15.97:0/3116402491 >> v2:172.21.15.97:3300/0 conn(0x7f90c40969d0 0x7f90c41338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.104+0000 7f90ca19d640 1 --2- 172.21.15.97:0/3116402491 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f90c4097690 0x7f90c4131350 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.104+0000 7f90ca19d640 1 -- 172.21.15.97:0/3116402491 >> 172.21.15.97:0/3116402491 conn(0x7f90c409b200 msgr2=0x7f90c409b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:29.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.104+0000 7f90ca19d640 1 -- 172.21.15.97:0/3116402491 shutdown_connections 2024-09-13T18:39:29.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.104+0000 7f90ca19d640 1 -- 172.21.15.97:0/3116402491 wait complete. 2024-09-13T18:39:29.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.105+0000 7f90ca19d640 1 Processor -- start 2024-09-13T18:39:29.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.105+0000 7f90ca19d640 1 -- start start 2024-09-13T18:39:29.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.105+0000 7f90ca19d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90c40969d0 0x7f90c412c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.105+0000 7f90ca19d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f90c4097690 0x7f90c409cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.105+0000 7f90ca19d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90c409dfb0 0x7f90c409d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.105+0000 7f90ca19d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4118c10 con 0x7f90c409dfb0 2024-09-13T18:39:29.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.105+0000 7f90ca19d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4118df0 con 0x7f90c40969d0 2024-09-13T18:39:29.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.105+0000 7f90ca19d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4117700 con 0x7f90c4097690 2024-09-13T18:39:29.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.105+0000 7f90c37fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90c40969d0 0x7f90c412c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.105+0000 7f90c3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90c409dfb0 0x7f90c409d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.105+0000 7f90c2ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f90c4097690 0x7f90c409cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.105+0000 7f90c37fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90c40969d0 0x7f90c412c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35466/0 (socket says 172.21.15.97:35466) 2024-09-13T18:39:29.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.105+0000 7f90c37fe640 1 -- 172.21.15.97:0/2173729944 learned_addr learned my addr 172.21.15.97:0/2173729944 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:29.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.106+0000 7f90c3fff640 1 -- 172.21.15.97:0/2173729944 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f90c4097690 msgr2=0x7f90c409cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.106+0000 7f90c3fff640 1 --2- 172.21.15.97:0/2173729944 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f90c4097690 0x7f90c409cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.106+0000 7f90c3fff640 1 -- 172.21.15.97:0/2173729944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90c40969d0 msgr2=0x7f90c412c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.106+0000 7f90c3fff640 1 --2- 172.21.15.97:0/2173729944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90c40969d0 0x7f90c412c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.106+0000 7f90c3fff640 1 -- 172.21.15.97:0/2173729944 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc009a20 con 0x7f90c409dfb0 2024-09-13T18:39:29.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.106+0000 7f90c37fe640 1 --2- 172.21.15.97:0/2173729944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90c40969d0 0x7f90c412c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:29.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.106+0000 7f90c3fff640 1 --2- 172.21.15.97:0/2173729944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90c409dfb0 0x7f90c409d3e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009f10 tx=0x7f90bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:29.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.106+0000 7f90ab7fe640 1 -- 172.21.15.97:0/2173729944 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc00cdb0 con 0x7f90c409dfb0 2024-09-13T18:39:29.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.106+0000 7f90ab7fe640 1 -- 172.21.15.97:0/2173729944 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc00f040 con 0x7f90c409dfb0 2024-09-13T18:39:29.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.106+0000 7f90ab7fe640 1 -- 172.21.15.97:0/2173729944 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0146d0 con 0x7f90c409dfb0 2024-09-13T18:39:29.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.106+0000 7f90ca19d640 1 -- 172.21.15.97:0/2173729944 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b8009390 con 0x7f90c409dfb0 2024-09-13T18:39:29.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.106+0000 7f90ca19d640 1 -- 172.21.15.97:0/2173729944 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c41171c0 con 0x7f90c409dfb0 2024-09-13T18:39:29.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.107+0000 7f90ab7fe640 1 -- 172.21.15.97:0/2173729944 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f90bc003020 con 0x7f90c409dfb0 2024-09-13T18:39:29.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.107+0000 7f90ab7fe640 1 -- 172.21.15.97:0/2173729944 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3660+0+0 (secure 0 0 0) 0x7f90bc042a30 con 0x7f90c409dfb0 2024-09-13T18:39:29.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.107+0000 7f90ca19d640 1 -- 172.21.15.97:0/2173729944 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c4118f30 con 0x7f90c409dfb0 2024-09-13T18:39:29.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.112+0000 7f90ab7fe640 1 -- 172.21.15.97:0/2173729944 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f90c4118f30 con 0x7f90c409dfb0 2024-09-13T18:39:29.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.263+0000 7f90ca19d640 1 -- 172.21.15.97:0/2173729944 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90c4118f30 con 0x7f90c409dfb0 2024-09-13T18:39:29.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.264+0000 7f90ab7fe640 1 -- 172.21.15.97:0/2173729944 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+11298 (secure 0 0 0) 0x7f90c4118f30 con 0x7f90c409dfb0 2024-09-13T18:39:29.269 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:29.269 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":21,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:26.605080+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:29.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.266+0000 7f90ca19d640 1 -- 172.21.15.97:0/2173729944 >> v1:172.21.15.97:6816/34603 conn(0x7f90b0031160 legacy=0x7f90b0033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.266+0000 7f90ca19d640 1 -- 172.21.15.97:0/2173729944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90c409dfb0 msgr2=0x7f90c409d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.266+0000 7f90ca19d640 1 --2- 172.21.15.97:0/2173729944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90c409dfb0 0x7f90c409d3e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009f10 tx=0x7f90bc00b040 comp rx=0 tx=0).stop 2024-09-13T18:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.266+0000 7f90ca19d640 1 -- 172.21.15.97:0/2173729944 shutdown_connections 2024-09-13T18:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.266+0000 7f90ca19d640 1 --2- 172.21.15.97:0/2173729944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f90c409dfb0 0x7f90c409d3e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.266+0000 7f90ca19d640 1 --2- 172.21.15.97:0/2173729944 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f90c4097690 0x7f90c409cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.266+0000 7f90ca19d640 1 --2- 172.21.15.97:0/2173729944 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f90c40969d0 0x7f90c412c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.266+0000 7f90ca19d640 1 -- 172.21.15.97:0/2173729944 >> 172.21.15.97:0/2173729944 conn(0x7f90c409b200 msgr2=0x7f90c409a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.266+0000 7f90ca19d640 1 -- 172.21.15.97:0/2173729944 shutdown_connections 2024-09-13T18:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.266+0000 7f90ca19d640 1 -- 172.21.15.97:0/2173729944 wait complete. 2024-09-13T18:39:29.279 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:39:01.375967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T18:39:05.732412+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:39:12.014248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:39:12.844264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:39:29.280 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:39:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.375+0000 7f475791d640 1 Processor -- start 2024-09-13T18:39:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.375+0000 7f475791d640 1 -- start start 2024-09-13T18:39:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.375+0000 7f475791d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47500688c0 0x7f475009d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.375+0000 7f475791d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f475009d2c0 0x7f475009dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.375+0000 7f475791d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f475012f410 0x7f475012f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.375+0000 7f475791d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4750068c90 con 0x7f475012f410 2024-09-13T18:39:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.375+0000 7f475791d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47500975a0 con 0x7f47500688c0 2024-09-13T18:39:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.375+0000 7f475791d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4750069200 con 0x7f475009d2c0 2024-09-13T18:39:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.375+0000 7f47556b9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47500688c0 0x7f475009d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.375+0000 7f4754eb8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f475009d2c0 0x7f475009dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.375+0000 7f47556b9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47500688c0 0x7f475009d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35470/0 (socket says 172.21.15.97:35470) 2024-09-13T18:39:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.375+0000 7f47556b9640 1 -- 172.21.15.97:0/988819163 learned_addr learned my addr 172.21.15.97:0/988819163 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.375+0000 7f4755eba640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f475012f410 0x7f475012f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.376+0000 7f4754eb8640 1 -- 172.21.15.97:0/988819163 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47500688c0 msgr2=0x7f475009d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.376+0000 7f4754eb8640 1 --2- 172.21.15.97:0/988819163 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47500688c0 0x7f475009d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.376+0000 7f4754eb8640 1 -- 172.21.15.97:0/988819163 >> v2:172.21.15.97:3300/0 conn(0x7f475012f410 msgr2=0x7f475012f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.376+0000 7f4754eb8640 1 --2- 172.21.15.97:0/988819163 >> v2:172.21.15.97:3300/0 conn(0x7f475012f410 0x7f475012f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.376+0000 7f4754eb8640 1 -- 172.21.15.97:0/988819163 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475009ceb0 con 0x7f475009d2c0 2024-09-13T18:39:29.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.376+0000 7f47556b9640 1 --2- 172.21.15.97:0/988819163 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47500688c0 0x7f475009d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:29.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.376+0000 7f4755eba640 1 --2- 172.21.15.97:0/988819163 >> v2:172.21.15.97:3300/0 conn(0x7f475012f410 0x7f475012f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:29.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.376+0000 7f4754eb8640 1 --2- 172.21.15.97:0/988819163 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f475009d2c0 0x7f475009dd00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4740009880 tx=0x7f47400090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a0682959ab646c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:29.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.377+0000 7f4747fff640 1 -- 172.21.15.97:0/988819163 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474002abc0 con 0x7f475009d2c0 2024-09-13T18:39:29.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.377+0000 7f4747fff640 1 -- 172.21.15.97:0/988819163 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474002ad20 con 0x7f475009d2c0 2024-09-13T18:39:29.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.377+0000 7f4747fff640 1 -- 172.21.15.97:0/988819163 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740032670 con 0x7f475009d2c0 2024-09-13T18:39:29.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.377+0000 7f475791d640 1 -- 172.21.15.97:0/988819163 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f475009d2c0 msgr2=0x7f475009dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.377+0000 7f475791d640 1 --2- 172.21.15.97:0/988819163 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f475009d2c0 0x7f475009dd00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4740009880 tx=0x7f47400090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.377+0000 7f475791d640 1 -- 172.21.15.97:0/988819163 shutdown_connections 2024-09-13T18:39:29.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.377+0000 7f475791d640 1 --2- 172.21.15.97:0/988819163 >> v2:172.21.15.97:3300/0 conn(0x7f475012f410 0x7f475012f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.377+0000 7f475791d640 1 --2- 172.21.15.97:0/988819163 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f475009d2c0 0x7f475009dd00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.377+0000 7f475791d640 1 --2- 172.21.15.97:0/988819163 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f47500688c0 0x7f475009d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.377+0000 7f475791d640 1 -- 172.21.15.97:0/988819163 >> 172.21.15.97:0/988819163 conn(0x7f475006f310 msgr2=0x7f47500a29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:29.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.377+0000 7f475791d640 1 -- 172.21.15.97:0/988819163 shutdown_connections 2024-09-13T18:39:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.377+0000 7f475791d640 1 -- 172.21.15.97:0/988819163 wait complete. 2024-09-13T18:39:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.378+0000 7f475791d640 1 Processor -- start 2024-09-13T18:39:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.378+0000 7f475791d640 1 -- start start 2024-09-13T18:39:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f475791d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47500688c0 0x7f475012ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f475791d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f475009d2c0 0x7f475011ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f475791d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f475012f410 0x7f475011b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f475791d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475011cb50 con 0x7f47500688c0 2024-09-13T18:39:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f475791d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475011c790 con 0x7f475009d2c0 2024-09-13T18:39:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f475791d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f475011d520 con 0x7f475012f410 2024-09-13T18:39:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f47556b9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47500688c0 0x7f475012ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f47556b9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47500688c0 0x7f475012ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:52594/0 (socket says 172.21.15.97:52594) 2024-09-13T18:39:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f47556b9640 1 -- 172.21.15.97:0/4213364686 learned_addr learned my addr 172.21.15.97:0/4213364686 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f4754eb8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f475009d2c0 0x7f475011ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f4755eba640 1 --2- 172.21.15.97:0/4213364686 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f475012f410 0x7f475011b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f47556b9640 1 -- 172.21.15.97:0/4213364686 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f475012f410 msgr2=0x7f475011b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f47556b9640 1 --2- 172.21.15.97:0/4213364686 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f475012f410 0x7f475011b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f47556b9640 1 -- 172.21.15.97:0/4213364686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f475009d2c0 msgr2=0x7f475011ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f47556b9640 1 --2- 172.21.15.97:0/4213364686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f475009d2c0 0x7f475011ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f47556b9640 1 -- 172.21.15.97:0/4213364686 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c009450 con 0x7f47500688c0 2024-09-13T18:39:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f4754eb8640 1 --2- 172.21.15.97:0/4213364686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f475009d2c0 0x7f475011ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f47556b9640 1 --2- 172.21.15.97:0/4213364686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47500688c0 0x7f475012ea80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f474c00ecb0 tx=0x7f474c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f47457fa640 1 -- 172.21.15.97:0/4213364686 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c009730 con 0x7f47500688c0 2024-09-13T18:39:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f47457fa640 1 -- 172.21.15.97:0/4213364686 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c00cb00 con 0x7f47500688c0 2024-09-13T18:39:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f47457fa640 1 -- 172.21.15.97:0/4213364686 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c00cea0 con 0x7f47500688c0 2024-09-13T18:39:29.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f475791d640 1 -- 172.21.15.97:0/4213364686 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4748009a20 con 0x7f47500688c0 2024-09-13T18:39:29.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.379+0000 7f475791d640 1 -- 172.21.15.97:0/4213364686 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4740009390 con 0x7f47500688c0 2024-09-13T18:39:29.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.380+0000 7f47457fa640 1 -- 172.21.15.97:0/4213364686 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f474c013680 con 0x7f47500688c0 2024-09-13T18:39:29.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.380+0000 7f47457fa640 1 -- 172.21.15.97:0/4213364686 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3660+0+0 (secure 0 0 0) 0x7f474c042320 con 0x7f47500688c0 2024-09-13T18:39:29.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.380+0000 7f475791d640 1 -- 172.21.15.97:0/4213364686 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475009e8a0 con 0x7f47500688c0 2024-09-13T18:39:29.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.384+0000 7f47457fa640 1 -- 172.21.15.97:0/4213364686 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f474c021020 con 0x7f47500688c0 2024-09-13T18:39:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.535+0000 7f475791d640 1 -- 172.21.15.97:0/4213364686 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47500714b0 con 0x7f47500688c0 2024-09-13T18:39:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.536+0000 7f47457fa640 1 -- 172.21.15.97:0/4213364686 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f474c023ad0 con 0x7f47500688c0 2024-09-13T18:39:29.538 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2024-09-13T18:39:29.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.537+0000 7f475791d640 1 -- 172.21.15.97:0/4213364686 >> v1:172.21.15.97:6816/34603 conn(0x7f4734031160 legacy=0x7f4734033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.537+0000 7f475791d640 1 -- 172.21.15.97:0/4213364686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47500688c0 msgr2=0x7f475012ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.537+0000 7f475791d640 1 --2- 172.21.15.97:0/4213364686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47500688c0 0x7f475012ea80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f474c00ecb0 tx=0x7f474c0091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.537+0000 7f475791d640 1 -- 172.21.15.97:0/4213364686 shutdown_connections 2024-09-13T18:39:29.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.537+0000 7f475791d640 1 --2- 172.21.15.97:0/4213364686 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f475012f410 0x7f475011b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.537+0000 7f475791d640 1 --2- 172.21.15.97:0/4213364686 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f475009d2c0 0x7f475011ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.537+0000 7f475791d640 1 --2- 172.21.15.97:0/4213364686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47500688c0 0x7f475012ea80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.537+0000 7f475791d640 1 -- 172.21.15.97:0/4213364686 >> 172.21.15.97:0/4213364686 conn(0x7f475006f310 msgr2=0x7f4750132520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:29.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.537+0000 7f475791d640 1 -- 172.21.15.97:0/4213364686 shutdown_connections 2024-09-13T18:39:29.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.537+0000 7f475791d640 1 -- 172.21.15.97:0/4213364686 wait complete. 2024-09-13T18:39:29.550 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-13T18:39:29.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.647+0000 7f5a9c89f640 1 Processor -- start 2024-09-13T18:39:29.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.647+0000 7f5a9c89f640 1 -- start start 2024-09-13T18:39:29.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a9c89f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a980965d0 0x7f5a9809af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a9c89f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5a98135030 0x7f5a98137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a9c89f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9805df70 con 0x7f5a98097530 2024-09-13T18:39:29.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a9c89f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a98095950 con 0x7f5a98135030 2024-09-13T18:39:29.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a9c89f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98096a90 con 0x7f5a980965d0 2024-09-13T18:39:29.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a96d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5a98135030 0x7f5a98137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a95d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a980965d0 0x7f5a9809af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a9659c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f5a98097530 0x7f5a9809a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53314/0 (socket says 172.21.15.97:53314) 2024-09-13T18:39:29.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a9659c640 1 -- 172.21.15.97:0/2979480004 learned_addr learned my addr 172.21.15.97:0/2979480004 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:29.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a96d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5a98135030 0x7f5a98137410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:52604/0 (socket says 172.21.15.97:52604) 2024-09-13T18:39:29.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a95d9b640 1 -- 172.21.15.97:0/2979480004 >> v2:172.21.15.97:3300/0 conn(0x7f5a98135030 msgr2=0x7f5a98137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:29.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a95d9b640 1 --2- 172.21.15.97:0/2979480004 >> v2:172.21.15.97:3300/0 conn(0x7f5a98135030 0x7f5a98137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a95d9b640 1 -- 172.21.15.97:0/2979480004 >> v1:172.21.15.97:6789/0 conn(0x7f5a98097530 legacy=0x7f5a9809a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a95d9b640 1 -- 172.21.15.97:0/2979480004 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a98097900 con 0x7f5a980965d0 2024-09-13T18:39:29.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.648+0000 7f5a96d9d640 1 --2- 172.21.15.97:0/2979480004 >> v2:172.21.15.97:3300/0 conn(0x7f5a98135030 0x7f5a98137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:29.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.649+0000 7f5a95d9b640 1 --2- 172.21.15.97:0/2979480004 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a980965d0 0x7f5a9809af80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009880 tx=0x7f5a8c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96df9994083b8715 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:29.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.649+0000 7f5a9559a640 1 -- 172.21.15.97:0/2979480004 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c02ac50 con 0x7f5a980965d0 2024-09-13T18:39:29.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.649+0000 7f5a9559a640 1 -- 172.21.15.97:0/2979480004 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c02adb0 con 0x7f5a980965d0 2024-09-13T18:39:29.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.649+0000 7f5a9559a640 1 -- 172.21.15.97:0/2979480004 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c032670 con 0x7f5a980965d0 2024-09-13T18:39:29.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.649+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2979480004 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a980965d0 msgr2=0x7f5a9809af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.649+0000 7f5a9c89f640 1 --2- 172.21.15.97:0/2979480004 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a980965d0 0x7f5a9809af80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009880 tx=0x7f5a8c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.649+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2979480004 shutdown_connections 2024-09-13T18:39:29.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.649+0000 7f5a9c89f640 1 --2- 172.21.15.97:0/2979480004 >> v2:172.21.15.97:3300/0 conn(0x7f5a98135030 0x7f5a98137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.649+0000 7f5a9c89f640 1 --2- 172.21.15.97:0/2979480004 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a980965d0 0x7f5a9809af80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.649+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2979480004 >> 172.21.15.97:0/2979480004 conn(0x7f5a9809f910 msgr2=0x7f5a9809b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:29.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.649+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2979480004 shutdown_connections 2024-09-13T18:39:29.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.650+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2979480004 wait complete. 2024-09-13T18:39:29.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.650+0000 7f5a9c89f640 1 Processor -- start 2024-09-13T18:39:29.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.650+0000 7f5a9c89f640 1 -- start start 2024-09-13T18:39:29.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9c89f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a980965d0 0x7f5a98134040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9c89f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a98097530 0x7f5a98134580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9c89f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5a98135030 0x7f5a98134ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9c89f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98091860 con 0x7f5a980965d0 2024-09-13T18:39:29.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9c89f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98093460 con 0x7f5a98097530 2024-09-13T18:39:29.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9c89f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9806f050 con 0x7f5a98135030 2024-09-13T18:39:29.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a980965d0 0x7f5a98134040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a980965d0 0x7f5a98134040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:52610/0 (socket says 172.21.15.97:52610) 2024-09-13T18:39:29.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a96d9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5a98135030 0x7f5a98134ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9659c640 1 -- 172.21.15.97:0/2376924313 learned_addr learned my addr 172.21.15.97:0/2376924313 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:29.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a95d9b640 1 --2- 172.21.15.97:0/2376924313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a98097530 0x7f5a98134580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9659c640 1 -- 172.21.15.97:0/2376924313 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5a98135030 msgr2=0x7f5a98134ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9659c640 1 --2- 172.21.15.97:0/2376924313 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5a98135030 0x7f5a98134ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9659c640 1 -- 172.21.15.97:0/2376924313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a98097530 msgr2=0x7f5a98134580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9659c640 1 --2- 172.21.15.97:0/2376924313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a98097530 0x7f5a98134580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9659c640 1 -- 172.21.15.97:0/2376924313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90009a20 con 0x7f5a980965d0 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a95d9b640 1 --2- 172.21.15.97:0/2376924313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a98097530 0x7f5a98134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9659c640 1 --2- 172.21.15.97:0/2376924313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a980965d0 0x7f5a98134040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800c590 tx=0x7f5a88007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a867fc640 1 -- 172.21.15.97:0/2376924313 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88005aa0 con 0x7f5a980965d0 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a867fc640 1 -- 172.21.15.97:0/2376924313 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a88005c20 con 0x7f5a980965d0 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a867fc640 1 -- 172.21.15.97:0/2376924313 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a880070f0 con 0x7f5a980965d0 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2376924313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c009390 con 0x7f5a980965d0 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.651+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2376924313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a98093df0 con 0x7f5a980965d0 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.652+0000 7f5a867fc640 1 -- 172.21.15.97:0/2376924313 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f5a88007540 con 0x7f5a980965d0 2024-09-13T18:39:29.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.652+0000 7f5a867fc640 1 -- 172.21.15.97:0/2376924313 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3660+0+0 (secure 0 0 0) 0x7f5a88041320 con 0x7f5a980965d0 2024-09-13T18:39:29.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.652+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2376924313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a980949d0 con 0x7f5a980965d0 2024-09-13T18:39:29.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.657+0000 7f5a867fc640 1 -- 172.21.15.97:0/2376924313 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f5a88004b00 con 0x7f5a980965d0 2024-09-13T18:39:29.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.805+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2376924313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5a98091f50 con 0x7f5a980965d0 2024-09-13T18:39:29.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.806+0000 7f5a867fc640 1 -- 172.21.15.97:0/2376924313 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5a88010720 con 0x7f5a980965d0 2024-09-13T18:39:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 8 2024-09-13T18:39:29.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.807+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2376924313 >> v1:172.21.15.97:6816/34603 conn(0x7f5a78031160 legacy=0x7f5a78033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.807+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2376924313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a980965d0 msgr2=0x7f5a98134040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.807+0000 7f5a9c89f640 1 --2- 172.21.15.97:0/2376924313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a980965d0 0x7f5a98134040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800c590 tx=0x7f5a88007ee0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.808+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2376924313 shutdown_connections 2024-09-13T18:39:29.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.808+0000 7f5a9c89f640 1 --2- 172.21.15.97:0/2376924313 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5a98135030 0x7f5a98134ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.808+0000 7f5a9c89f640 1 --2- 172.21.15.97:0/2376924313 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5a98097530 0x7f5a98134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.808+0000 7f5a9c89f640 1 --2- 172.21.15.97:0/2376924313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a980965d0 0x7f5a98134040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.808+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2376924313 >> 172.21.15.97:0/2376924313 conn(0x7f5a9809f910 msgr2=0x7f5a98099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:29.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.808+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2376924313 shutdown_connections 2024-09-13T18:39:29.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.808+0000 7f5a9c89f640 1 -- 172.21.15.97:0/2376924313 wait complete. 2024-09-13T18:39:29.821 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:39:29.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.914+0000 7f0622f09640 1 Processor -- start 2024-09-13T18:39:29.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.914+0000 7f0622f09640 1 -- start start 2024-09-13T18:39:29.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.914+0000 7f0622f09640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f061c09d0d0 0x7f061c09d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.914+0000 7f0622f09640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061c09d9e0 0x7f061c09de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.914+0000 7f0622f09640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f061c12ff00 0x7f061c1322e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.914+0000 7f0622f09640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c096f90 con 0x7f061c12ff00 2024-09-13T18:39:29.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.914+0000 7f0622f09640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c098440 con 0x7f061c09d9e0 2024-09-13T18:39:29.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.914+0000 7f0622f09640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f061c06ec20 con 0x7f061c09d0d0 2024-09-13T18:39:29.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.915+0000 7f0620ca5640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f061c09d0d0 0x7f061c09d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.915+0000 7f061bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061c09d9e0 0x7f061c09de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.915+0000 7f06214a6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f061c12ff00 0x7f061c1322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.915+0000 7f0620ca5640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f061c09d0d0 0x7f061c09d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:43392/0 (socket says 172.21.15.97:43392) 2024-09-13T18:39:29.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.915+0000 7f061bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061c09d9e0 0x7f061c09de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35518/0 (socket says 172.21.15.97:35518) 2024-09-13T18:39:29.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.915+0000 7f0620ca5640 1 -- 172.21.15.97:0/821050893 learned_addr learned my addr 172.21.15.97:0/821050893 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:29.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.915+0000 7f06214a6640 1 -- 172.21.15.97:0/821050893 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f061c09d0d0 msgr2=0x7f061c09d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:29.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.915+0000 7f06214a6640 1 --2- 172.21.15.97:0/821050893 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f061c09d0d0 0x7f061c09d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.915+0000 7f06214a6640 1 -- 172.21.15.97:0/821050893 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061c09d9e0 msgr2=0x7f061c09de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:29.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.915+0000 7f06214a6640 1 --2- 172.21.15.97:0/821050893 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061c09d9e0 0x7f061c09de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.915+0000 7f06214a6640 1 -- 172.21.15.97:0/821050893 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c097960 con 0x7f061c12ff00 2024-09-13T18:39:29.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.915+0000 7f061bfff640 1 --2- 172.21.15.97:0/821050893 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061c09d9e0 0x7f061c09de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.916+0000 7f06214a6640 1 --2- 172.21.15.97:0/821050893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f061c12ff00 0x7f061c1322e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0614009e60 tx=0x7f0614009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48b153f3c171dc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.916+0000 7f061b7fe640 1 -- 172.21.15.97:0/821050893 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614007550 con 0x7f061c12ff00 2024-09-13T18:39:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.916+0000 7f061b7fe640 1 -- 172.21.15.97:0/821050893 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061402d050 con 0x7f061c12ff00 2024-09-13T18:39:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.916+0000 7f061b7fe640 1 -- 172.21.15.97:0/821050893 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614007920 con 0x7f061c12ff00 2024-09-13T18:39:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.916+0000 7f0622f09640 1 -- 172.21.15.97:0/821050893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f061c12ff00 msgr2=0x7f061c1322e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.916+0000 7f0622f09640 1 --2- 172.21.15.97:0/821050893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f061c12ff00 0x7f061c1322e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0614009e60 tx=0x7f0614009780 comp rx=0 tx=0).stop 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.916+0000 7f0622f09640 1 -- 172.21.15.97:0/821050893 shutdown_connections 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.916+0000 7f0622f09640 1 --2- 172.21.15.97:0/821050893 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f061c12ff00 0x7f061c1322e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.916+0000 7f0622f09640 1 --2- 172.21.15.97:0/821050893 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061c09d9e0 0x7f061c09de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.916+0000 7f0622f09640 1 --2- 172.21.15.97:0/821050893 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f061c09d0d0 0x7f061c09d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.916+0000 7f0622f09640 1 -- 172.21.15.97:0/821050893 >> 172.21.15.97:0/821050893 conn(0x7f061c09b200 msgr2=0x7f061c09b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.916+0000 7f0622f09640 1 -- 172.21.15.97:0/821050893 shutdown_connections 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.916+0000 7f0622f09640 1 -- 172.21.15.97:0/821050893 wait complete. 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.917+0000 7f0622f09640 1 Processor -- start 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.917+0000 7f0622f09640 1 -- start start 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0622f09640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f061c09d0d0 0x7f061c11e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0622f09640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f061c09d9e0 0x7f061c11ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0622f09640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061c12ff00 0x7f061c11b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0622f09640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c11d900 con 0x7f061c09d9e0 2024-09-13T18:39:29.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0622f09640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c09a4b0 con 0x7f061c12ff00 2024-09-13T18:39:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0622f09640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f061c11c780 con 0x7f061c09d0d0 2024-09-13T18:39:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0620ca5640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f061c09d0d0 0x7f061c11e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f061bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f061c09d9e0 0x7f061c11ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0620ca5640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f061c09d0d0 0x7f061c11e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:43402/0 (socket says 172.21.15.97:43402) 2024-09-13T18:39:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f06214a6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061c12ff00 0x7f061c11b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0620ca5640 1 -- 172.21.15.97:0/1244817303 learned_addr learned my addr 172.21.15.97:0/1244817303 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0620ca5640 1 -- 172.21.15.97:0/1244817303 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061c12ff00 msgr2=0x7f061c11b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0620ca5640 1 --2- 172.21.15.97:0/1244817303 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061c12ff00 0x7f061c11b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0620ca5640 1 -- 172.21.15.97:0/1244817303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f061c09d9e0 msgr2=0x7f061c11ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0620ca5640 1 --2- 172.21.15.97:0/1244817303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f061c09d9e0 0x7f061c11ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:29.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0620ca5640 1 -- 172.21.15.97:0/1244817303 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0608009390 con 0x7f061c09d0d0 2024-09-13T18:39:29.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f061bfff640 1 --2- 172.21.15.97:0/1244817303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f061c09d9e0 0x7f061c11ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:29.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0620ca5640 1 --2- 172.21.15.97:0/1244817303 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f061c09d0d0 0x7f061c11e3a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0610012d60 tx=0x7f061000f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:29.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0618ff9640 1 -- 172.21.15.97:0/1244817303 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610012e60 con 0x7f061c09d0d0 2024-09-13T18:39:29.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0618ff9640 1 -- 172.21.15.97:0/1244817303 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0610013040 con 0x7f061c09d0d0 2024-09-13T18:39:29.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0622f09640 1 -- 172.21.15.97:0/1244817303 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0614009a20 con 0x7f061c09d0d0 2024-09-13T18:39:29.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0618ff9640 1 -- 172.21.15.97:0/1244817303 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610018480 con 0x7f061c09d0d0 2024-09-13T18:39:29.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.918+0000 7f0622f09640 1 -- 172.21.15.97:0/1244817303 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061c11a9c0 con 0x7f061c09d0d0 2024-09-13T18:39:29.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.919+0000 7f0618ff9640 1 -- 172.21.15.97:0/1244817303 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f06100187f0 con 0x7f061c09d0d0 2024-09-13T18:39:29.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.919+0000 7f0618ff9640 1 -- 172.21.15.97:0/1244817303 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3660+0+0 (secure 0 0 0) 0x7f0610046590 con 0x7f061c09d0d0 2024-09-13T18:39:29.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.920+0000 7f0622f09640 1 -- 172.21.15.97:0/1244817303 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061c064000 con 0x7f061c09d0d0 2024-09-13T18:39:29.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:29.924+0000 7f0618ff9640 1 -- 172.21.15.97:0/1244817303 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f0610021400 con 0x7f061c09d0d0 2024-09-13T18:39:30.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.077+0000 7f0622f09640 1 -- 172.21.15.97:0/1244817303 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f061c06dd90 con 0x7f061c09d0d0 2024-09-13T18:39:30.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.078+0000 7f0618ff9640 1 -- 172.21.15.97:0/1244817303 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0610016e60 con 0x7f061c09d0d0 2024-09-13T18:39:30.081 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2024-09-13T18:39:30.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.080+0000 7f0622f09640 1 -- 172.21.15.97:0/1244817303 >> v1:172.21.15.97:6816/34603 conn(0x7f0600031160 legacy=0x7f0600033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.080+0000 7f0622f09640 1 -- 172.21.15.97:0/1244817303 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f061c09d0d0 msgr2=0x7f061c11e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.080+0000 7f0622f09640 1 --2- 172.21.15.97:0/1244817303 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f061c09d0d0 0x7f061c11e3a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0610012d60 tx=0x7f061000f040 comp rx=0 tx=0).stop 2024-09-13T18:39:30.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.080+0000 7f0622f09640 1 -- 172.21.15.97:0/1244817303 shutdown_connections 2024-09-13T18:39:30.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.080+0000 7f0622f09640 1 --2- 172.21.15.97:0/1244817303 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f061c12ff00 0x7f061c11b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.080+0000 7f0622f09640 1 --2- 172.21.15.97:0/1244817303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f061c09d9e0 0x7f061c11ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.080+0000 7f0622f09640 1 --2- 172.21.15.97:0/1244817303 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f061c09d0d0 0x7f061c11e3a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.080+0000 7f0622f09640 1 -- 172.21.15.97:0/1244817303 >> 172.21.15.97:0/1244817303 conn(0x7f061c09b200 msgr2=0x7f061c06c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:30.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.080+0000 7f0622f09640 1 -- 172.21.15.97:0/1244817303 shutdown_connections 2024-09-13T18:39:30.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.080+0000 7f0622f09640 1 -- 172.21.15.97:0/1244817303 wait complete. 2024-09-13T18:39:30.093 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:39:30.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.186+0000 7f5bf928b640 1 Processor -- start 2024-09-13T18:39:30.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.186+0000 7f5bf928b640 1 -- start start 2024-09-13T18:39:30.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf928b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5bf409a870 0x7f5bf409ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf928b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5bf409b180 0x7f5bf4095030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf928b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf4095570 0x7f5bf40959e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf928b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf4069fe0 con 0x7f5bf409b180 2024-09-13T18:39:30.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf928b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf406d330 con 0x7f5bf4095570 2024-09-13T18:39:30.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf928b640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf406df40 con 0x7f5bf409a870 2024-09-13T18:39:30.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf2ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5bf409a870 0x7f5bf409ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf27fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5bf409b180 0x7f5bf4095030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf2ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5bf409a870 0x7f5bf409ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:43404/0 (socket says 172.21.15.97:43404) 2024-09-13T18:39:30.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf27fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5bf409b180 0x7f5bf4095030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:52644/0 (socket says 172.21.15.97:52644) 2024-09-13T18:39:30.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf2ffd640 1 -- 172.21.15.97:0/334725018 learned_addr learned my addr 172.21.15.97:0/334725018 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:30.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf37fe640 1 --2- 172.21.15.97:0/334725018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf4095570 0x7f5bf40959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf27fc640 1 -- 172.21.15.97:0/334725018 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5bf409a870 msgr2=0x7f5bf409ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:30.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf27fc640 1 --2- 172.21.15.97:0/334725018 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5bf409a870 0x7f5bf409ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf27fc640 1 -- 172.21.15.97:0/334725018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf4095570 msgr2=0x7f5bf40959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:30.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf27fc640 1 --2- 172.21.15.97:0/334725018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf4095570 0x7f5bf40959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf27fc640 1 -- 172.21.15.97:0/334725018 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf406c640 con 0x7f5bf409b180 2024-09-13T18:39:30.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf2ffd640 1 --2- 172.21.15.97:0/334725018 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5bf409a870 0x7f5bf409ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.187+0000 7f5bf37fe640 1 --2- 172.21.15.97:0/334725018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf4095570 0x7f5bf40959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.188+0000 7f5bf27fc640 1 --2- 172.21.15.97:0/334725018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf409b180 0x7f5bf4095030 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009850 tx=0x7f5be80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a04f4864e904131 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.188+0000 7f5bf1ffb640 1 -- 172.21.15.97:0/334725018 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be802ac50 con 0x7f5bf409b180 2024-09-13T18:39:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.188+0000 7f5bf1ffb640 1 -- 172.21.15.97:0/334725018 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be802adb0 con 0x7f5bf409b180 2024-09-13T18:39:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.188+0000 7f5bf1ffb640 1 -- 172.21.15.97:0/334725018 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8032670 con 0x7f5bf409b180 2024-09-13T18:39:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.189+0000 7f5bf928b640 1 -- 172.21.15.97:0/334725018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf409b180 msgr2=0x7f5bf4095030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.189+0000 7f5bf928b640 1 --2- 172.21.15.97:0/334725018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf409b180 0x7f5bf4095030 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009850 tx=0x7f5be80090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.189+0000 7f5bf928b640 1 -- 172.21.15.97:0/334725018 shutdown_connections 2024-09-13T18:39:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.189+0000 7f5bf928b640 1 --2- 172.21.15.97:0/334725018 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf4095570 0x7f5bf40959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.189+0000 7f5bf928b640 1 --2- 172.21.15.97:0/334725018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf409b180 0x7f5bf4095030 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.189+0000 7f5bf928b640 1 --2- 172.21.15.97:0/334725018 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5bf409a870 0x7f5bf409ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.189+0000 7f5bf928b640 1 -- 172.21.15.97:0/334725018 >> 172.21.15.97:0/334725018 conn(0x7f5bf409f910 msgr2=0x7f5bf409b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:30.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.189+0000 7f5bf928b640 1 -- 172.21.15.97:0/334725018 shutdown_connections 2024-09-13T18:39:30.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.189+0000 7f5bf928b640 1 -- 172.21.15.97:0/334725018 wait complete. 2024-09-13T18:39:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf928b640 1 Processor -- start 2024-09-13T18:39:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf928b640 1 -- start start 2024-09-13T18:39:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf928b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf4095570 0x7f5bf412daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf928b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5bf409a870 0x7f5bf4127b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf928b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf409b180 0x7f5bf4128070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf928b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf412af80 con 0x7f5bf409b180 2024-09-13T18:39:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf928b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf412a2b0 con 0x7f5bf4095570 2024-09-13T18:39:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf928b640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4126ea0 con 0x7f5bf409a870 2024-09-13T18:39:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf27fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5bf409a870 0x7f5bf4127b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf2ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf4095570 0x7f5bf412daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf27fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5bf409a870 0x7f5bf4127b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:43412/0 (socket says 172.21.15.97:43412) 2024-09-13T18:39:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf27fc640 1 -- 172.21.15.97:0/3594581178 learned_addr learned my addr 172.21.15.97:0/3594581178 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf37fe640 1 --2- 172.21.15.97:0/3594581178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf409b180 0x7f5bf4128070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf2ffd640 1 -- 172.21.15.97:0/3594581178 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5bf409a870 msgr2=0x7f5bf4127b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf2ffd640 1 --2- 172.21.15.97:0/3594581178 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5bf409a870 0x7f5bf4127b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf2ffd640 1 -- 172.21.15.97:0/3594581178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf409b180 msgr2=0x7f5bf4128070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf2ffd640 1 --2- 172.21.15.97:0/3594581178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf409b180 0x7f5bf4128070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf2ffd640 1 -- 172.21.15.97:0/3594581178 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec009390 con 0x7f5bf4095570 2024-09-13T18:39:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.190+0000 7f5bf37fe640 1 --2- 172.21.15.97:0/3594581178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf409b180 0x7f5bf4128070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.191+0000 7f5bf2ffd640 1 --2- 172.21.15.97:0/3594581178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf4095570 0x7f5bf412daa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009fd0 tx=0x7f5be400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.191+0000 7f5bdaffd640 1 -- 172.21.15.97:0/3594581178 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400cba0 con 0x7f5bf4095570 2024-09-13T18:39:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.191+0000 7f5bdaffd640 1 -- 172.21.15.97:0/3594581178 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be400f040 con 0x7f5bf4095570 2024-09-13T18:39:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.191+0000 7f5bf928b640 1 -- 172.21.15.97:0/3594581178 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be4009ae0 con 0x7f5bf4095570 2024-09-13T18:39:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.191+0000 7f5bdaffd640 1 -- 172.21.15.97:0/3594581178 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4014480 con 0x7f5bf4095570 2024-09-13T18:39:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.191+0000 7f5bf928b640 1 -- 172.21.15.97:0/3594581178 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be8009390 con 0x7f5bf4095570 2024-09-13T18:39:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.191+0000 7f5bdaffd640 1 -- 172.21.15.97:0/3594581178 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f5be40148b0 con 0x7f5bf4095570 2024-09-13T18:39:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.192+0000 7f5bdaffd640 1 -- 172.21.15.97:0/3594581178 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3660+0+0 (secure 0 0 0) 0x7f5be4042430 con 0x7f5bf4095570 2024-09-13T18:39:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.192+0000 7f5bf928b640 1 -- 172.21.15.97:0/3594581178 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf40714b0 con 0x7f5bf4095570 2024-09-13T18:39:30.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.196+0000 7f5bdaffd640 1 -- 172.21.15.97:0/3594581178 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f5be401d400 con 0x7f5bf4095570 2024-09-13T18:39:30.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.347+0000 7f5bf928b640 1 -- 172.21.15.97:0/3594581178 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5bf409d010 con 0x7f5bf4095570 2024-09-13T18:39:30.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.347+0000 7f5bdaffd640 1 -- 172.21.15.97:0/3594581178 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5be401c3b0 con 0x7f5bf4095570 2024-09-13T18:39:30.350 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2024-09-13T18:39:30.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.349+0000 7f5bf928b640 1 -- 172.21.15.97:0/3594581178 >> v1:172.21.15.97:6816/34603 conn(0x7f5be0031160 legacy=0x7f5be0033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.349+0000 7f5bf928b640 1 -- 172.21.15.97:0/3594581178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf4095570 msgr2=0x7f5bf412daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.349+0000 7f5bf928b640 1 --2- 172.21.15.97:0/3594581178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf4095570 0x7f5bf412daa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009fd0 tx=0x7f5be400b040 comp rx=0 tx=0).stop 2024-09-13T18:39:30.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.349+0000 7f5bf928b640 1 -- 172.21.15.97:0/3594581178 shutdown_connections 2024-09-13T18:39:30.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.349+0000 7f5bf928b640 1 --2- 172.21.15.97:0/3594581178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5bf409b180 0x7f5bf4128070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.349+0000 7f5bf928b640 1 --2- 172.21.15.97:0/3594581178 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5bf409a870 0x7f5bf4127b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.349+0000 7f5bf928b640 1 --2- 172.21.15.97:0/3594581178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5bf4095570 0x7f5bf412daa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.349+0000 7f5bf928b640 1 -- 172.21.15.97:0/3594581178 >> 172.21.15.97:0/3594581178 conn(0x7f5bf409f910 msgr2=0x7f5bf4099860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:30.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.349+0000 7f5bf928b640 1 -- 172.21.15.97:0/3594581178 shutdown_connections 2024-09-13T18:39:30.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.349+0000 7f5bf928b640 1 -- 172.21.15.97:0/3594581178 wait complete. 2024-09-13T18:39:30.362 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:39:30.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.453+0000 7fafcbb9d640 1 Processor -- start 2024-09-13T18:39:30.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.453+0000 7fafcbb9d640 1 -- start start 2024-09-13T18:39:30.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.453+0000 7fafcbb9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fafc40a32b0 0x7fafc412f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.453+0000 7fafcbb9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc4069080 0x7fafc4137770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.453+0000 7fafcbb9d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc4096b70 con 0x7fafc412fed0 2024-09-13T18:39:30.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.453+0000 7fafcbb9d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc41302f0 con 0x7fafc40a32b0 2024-09-13T18:39:30.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.453+0000 7fafcbb9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40a3680 con 0x7fafc4069080 2024-09-13T18:39:30.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.453+0000 7fafc9939640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fafc40a32b0 0x7fafc412f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.453+0000 7fafca13a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc4069080 0x7fafc4137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.453+0000 7fafca13a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc4069080 0x7fafc4137770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35536/0 (socket says 172.21.15.97:35536) 2024-09-13T18:39:30.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.453+0000 7fafc9939640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fafc40a32b0 0x7fafc412f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:52666/0 (socket says 172.21.15.97:52666) 2024-09-13T18:39:30.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.453+0000 7fafca13a640 1 -- 172.21.15.97:0/1270698942 learned_addr learned my addr 172.21.15.97:0/1270698942 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.453+0000 7fafc9138640 1 --1- 172.21.15.97:0/1270698942 >> v1:172.21.15.97:6789/0 conn(0x7fafc412fed0 0x7fafc4068970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53316/0 (socket says 172.21.15.97:53316) 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.454+0000 7fafc9939640 1 -- 172.21.15.97:0/1270698942 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc4069080 msgr2=0x7fafc4137770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.454+0000 7fafc9939640 1 --2- 172.21.15.97:0/1270698942 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc4069080 0x7fafc4137770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.454+0000 7fafc9939640 1 -- 172.21.15.97:0/1270698942 >> v1:172.21.15.97:6789/0 conn(0x7fafc412fed0 legacy=0x7fafc4068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.454+0000 7fafc8937640 1 -- 172.21.15.97:0/1270698942 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64301877 0 0) 0x7fafc4096b70 con 0x7fafc412fed0 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.454+0000 7fafc9939640 1 -- 172.21.15.97:0/1270698942 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4097460 con 0x7fafc40a32b0 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.454+0000 7fafca13a640 1 --2- 172.21.15.97:0/1270698942 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc4069080 0x7fafc4137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.454+0000 7fafc9939640 1 --2- 172.21.15.97:0/1270698942 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafc40a32b0 0x7fafc412f990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009850 tx=0x7fafc00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63628155a2a9d167 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.455+0000 7fafc8937640 1 -- 172.21.15.97:0/1270698942 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc002ad00 con 0x7fafc40a32b0 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.455+0000 7fafc8937640 1 -- 172.21.15.97:0/1270698942 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc002ae60 con 0x7fafc40a32b0 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.455+0000 7fafc8937640 1 -- 172.21.15.97:0/1270698942 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0032670 con 0x7fafc40a32b0 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.455+0000 7fafcbb9d640 1 -- 172.21.15.97:0/1270698942 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafc40a32b0 msgr2=0x7fafc412f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.455+0000 7fafcbb9d640 1 --2- 172.21.15.97:0/1270698942 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafc40a32b0 0x7fafc412f990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009850 tx=0x7fafc00090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.455+0000 7fafcbb9d640 1 -- 172.21.15.97:0/1270698942 shutdown_connections 2024-09-13T18:39:30.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.455+0000 7fafcbb9d640 1 --2- 172.21.15.97:0/1270698942 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc4069080 0x7fafc4137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.455+0000 7fafcbb9d640 1 --2- 172.21.15.97:0/1270698942 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafc40a32b0 0x7fafc412f990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.455+0000 7fafcbb9d640 1 -- 172.21.15.97:0/1270698942 >> 172.21.15.97:0/1270698942 conn(0x7fafc406eef0 msgr2=0x7fafc40a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:30.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.455+0000 7fafcbb9d640 1 -- 172.21.15.97:0/1270698942 shutdown_connections 2024-09-13T18:39:30.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.455+0000 7fafcbb9d640 1 -- 172.21.15.97:0/1270698942 wait complete. 2024-09-13T18:39:30.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafcbb9d640 1 Processor -- start 2024-09-13T18:39:30.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafcbb9d640 1 -- start start 2024-09-13T18:39:30.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafcbb9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafc4069080 0x7fafc413eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafcbb9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fafc40a32b0 0x7fafc413eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafcbb9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc412fed0 0x7fafc41190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafcbb9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc411abe0 con 0x7fafc4069080 2024-09-13T18:39:30.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafcbb9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40a2640 con 0x7fafc412fed0 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafcbb9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafc409e710 con 0x7fafc40a32b0 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafc9939640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafc4069080 0x7fafc413eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafca13a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc412fed0 0x7fafc41190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafc9138640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fafc40a32b0 0x7fafc413eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafc9939640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafc4069080 0x7fafc413eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:52678/0 (socket says 172.21.15.97:52678) 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafc9939640 1 -- 172.21.15.97:0/3683584764 learned_addr learned my addr 172.21.15.97:0/3683584764 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.456+0000 7fafca13a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc412fed0 0x7fafc41190b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35546/0 (socket says 172.21.15.97:35546) 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.457+0000 7fafc9939640 1 -- 172.21.15.97:0/3683584764 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fafc40a32b0 msgr2=0x7fafc413eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.457+0000 7fafc9939640 1 --2- 172.21.15.97:0/3683584764 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fafc40a32b0 0x7fafc413eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.457+0000 7fafc9939640 1 -- 172.21.15.97:0/3683584764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc412fed0 msgr2=0x7fafc41190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.457+0000 7fafc9939640 1 --2- 172.21.15.97:0/3683584764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc412fed0 0x7fafc41190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.457+0000 7fafc9939640 1 -- 172.21.15.97:0/3683584764 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc009ae0 con 0x7fafc4069080 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.457+0000 7fafca13a640 1 --2- 172.21.15.97:0/3683584764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc412fed0 0x7fafc41190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.457+0000 7fafc9138640 1 --2- 172.21.15.97:0/3683584764 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fafc40a32b0 0x7fafc413eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:30.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.457+0000 7fafc9939640 1 --2- 172.21.15.97:0/3683584764 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafc4069080 0x7fafc413eab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fafc002a630 tx=0x7fafc0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.457+0000 7fafb9ffb640 1 -- 172.21.15.97:0/3683584764 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0031700 con 0x7fafc4069080 2024-09-13T18:39:30.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.457+0000 7fafb9ffb640 1 -- 172.21.15.97:0/3683584764 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc0031860 con 0x7fafc4069080 2024-09-13T18:39:30.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.457+0000 7fafb9ffb640 1 -- 172.21.15.97:0/3683584764 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0031c20 con 0x7fafc4069080 2024-09-13T18:39:30.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.457+0000 7fafcbb9d640 1 -- 172.21.15.97:0/3683584764 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc0009390 con 0x7fafc4069080 2024-09-13T18:39:30.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.457+0000 7fafcbb9d640 1 -- 172.21.15.97:0/3683584764 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc409bf90 con 0x7fafc4069080 2024-09-13T18:39:30.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.458+0000 7fafb9ffb640 1 -- 172.21.15.97:0/3683584764 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fafc0039040 con 0x7fafc4069080 2024-09-13T18:39:30.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.458+0000 7fafb9ffb640 1 -- 172.21.15.97:0/3683584764 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3660+0+0 (secure 0 0 0) 0x7fafc0041030 con 0x7fafc4069080 2024-09-13T18:39:30.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.458+0000 7fafcbb9d640 1 -- 172.21.15.97:0/3683584764 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc4064000 con 0x7fafc4069080 2024-09-13T18:39:30.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.463+0000 7fafb9ffb640 1 -- 172.21.15.97:0/3683584764 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fafc0037080 con 0x7fafc4069080 2024-09-13T18:39:30.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.632+0000 7fafcbb9d640 1 -- 172.21.15.97:0/3683584764 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fafc405e0b0 con 0x7fafc4069080 2024-09-13T18:39:30.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.632+0000 7fafb9ffb640 1 -- 172.21.15.97:0/3683584764 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fafc004b070 con 0x7fafc4069080 2024-09-13T18:39:30.635 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2024-09-13T18:39:30.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.635+0000 7fafcbb9d640 1 -- 172.21.15.97:0/3683584764 >> v1:172.21.15.97:6816/34603 conn(0x7fafa8031160 legacy=0x7fafa8033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.635+0000 7fafcbb9d640 1 -- 172.21.15.97:0/3683584764 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafc4069080 msgr2=0x7fafc413eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.635+0000 7fafcbb9d640 1 --2- 172.21.15.97:0/3683584764 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafc4069080 0x7fafc413eab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fafc002a630 tx=0x7fafc0032000 comp rx=0 tx=0).stop 2024-09-13T18:39:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.635+0000 7fafcbb9d640 1 -- 172.21.15.97:0/3683584764 shutdown_connections 2024-09-13T18:39:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.635+0000 7fafcbb9d640 1 --2- 172.21.15.97:0/3683584764 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fafc412fed0 0x7fafc41190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.635+0000 7fafcbb9d640 1 --2- 172.21.15.97:0/3683584764 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fafc40a32b0 0x7fafc413eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.635+0000 7fafcbb9d640 1 --2- 172.21.15.97:0/3683584764 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fafc4069080 0x7fafc413eab0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.635+0000 7fafcbb9d640 1 -- 172.21.15.97:0/3683584764 >> 172.21.15.97:0/3683584764 conn(0x7fafc406eef0 msgr2=0x7fafc4132530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.635+0000 7fafcbb9d640 1 -- 172.21.15.97:0/3683584764 shutdown_connections 2024-09-13T18:39:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.635+0000 7fafcbb9d640 1 -- 172.21.15.97:0/3683584764 wait complete. 2024-09-13T18:39:30.648 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:39:30.648 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:39:30.667 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:30.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f775d640 1 Processor -- start 2024-09-13T18:39:30.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f775d640 1 -- start start 2024-09-13T18:39:30.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f775d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6f009dfb0 0x7fe6f0096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f775d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6f00969d0 0x7fe6f00974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f775d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f012bf70 0x7fe6f012c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f775d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f009e380 con 0x7fe6f009dfb0 2024-09-13T18:39:30.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f775d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f006a190 con 0x7fe6f00969d0 2024-09-13T18:39:30.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f775d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0098870 con 0x7fe6f012bf70 2024-09-13T18:39:30.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f4cf8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6f00969d0 0x7fe6f00974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f5cfa640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f012bf70 0x7fe6f012c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f54f9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6f009dfb0 0x7fe6f0096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f5cfa640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f012bf70 0x7fe6f012c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:43420/0 (socket says 172.21.15.97:43420) 2024-09-13T18:39:30.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f4cf8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6f00969d0 0x7fe6f00974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35550/0 (socket says 172.21.15.97:35550) 2024-09-13T18:39:30.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f5cfa640 1 -- 172.21.15.97:0/969614805 learned_addr learned my addr 172.21.15.97:0/969614805 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.757+0000 7fe6f54f9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6f009dfb0 0x7fe6f0096f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:52680/0 (socket says 172.21.15.97:52680) 2024-09-13T18:39:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.758+0000 7fe6f54f9640 1 -- 172.21.15.97:0/969614805 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f012bf70 msgr2=0x7fe6f012c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.758+0000 7fe6f54f9640 1 --2- 172.21.15.97:0/969614805 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f012bf70 0x7fe6f012c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.758+0000 7fe6f54f9640 1 -- 172.21.15.97:0/969614805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6f00969d0 msgr2=0x7fe6f00974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.758+0000 7fe6f54f9640 1 --2- 172.21.15.97:0/969614805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6f00969d0 0x7fe6f00974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.758+0000 7fe6f54f9640 1 -- 172.21.15.97:0/969614805 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0098e10 con 0x7fe6f009dfb0 2024-09-13T18:39:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.758+0000 7fe6f5cfa640 1 --2- 172.21.15.97:0/969614805 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f012bf70 0x7fe6f012c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.758+0000 7fe6f4cf8640 1 --2- 172.21.15.97:0/969614805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6f00969d0 0x7fe6f00974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:30.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.758+0000 7fe6f54f9640 1 --2- 172.21.15.97:0/969614805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f009dfb0 0x7fe6f0096f80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009850 tx=0x7fe6e80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d5c1631fc2e5e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.758+0000 7fe6effff640 1 -- 172.21.15.97:0/969614805 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e802ac50 con 0x7fe6f009dfb0 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.758+0000 7fe6effff640 1 -- 172.21.15.97:0/969614805 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e802adb0 con 0x7fe6f009dfb0 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.759+0000 7fe6effff640 1 -- 172.21.15.97:0/969614805 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8032670 con 0x7fe6f009dfb0 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.759+0000 7fe6f775d640 1 -- 172.21.15.97:0/969614805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f009dfb0 msgr2=0x7fe6f0096f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.759+0000 7fe6f775d640 1 --2- 172.21.15.97:0/969614805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f009dfb0 0x7fe6f0096f80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009850 tx=0x7fe6e80090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.759+0000 7fe6f775d640 1 -- 172.21.15.97:0/969614805 shutdown_connections 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.759+0000 7fe6f775d640 1 --2- 172.21.15.97:0/969614805 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f012bf70 0x7fe6f012c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.759+0000 7fe6f775d640 1 --2- 172.21.15.97:0/969614805 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6f00969d0 0x7fe6f00974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.759+0000 7fe6f775d640 1 --2- 172.21.15.97:0/969614805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f009dfb0 0x7fe6f0096f80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.759+0000 7fe6f775d640 1 -- 172.21.15.97:0/969614805 >> 172.21.15.97:0/969614805 conn(0x7fe6f009b200 msgr2=0x7fe6f009b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.759+0000 7fe6f775d640 1 -- 172.21.15.97:0/969614805 shutdown_connections 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.759+0000 7fe6f775d640 1 -- 172.21.15.97:0/969614805 wait complete. 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.760+0000 7fe6f775d640 1 Processor -- start 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.760+0000 7fe6f775d640 1 -- start start 2024-09-13T18:39:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.760+0000 7fe6f775d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f00969d0 0x7fe6f013e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.760+0000 7fe6f775d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f009dfb0 0x7fe6f013ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.760+0000 7fe6f775d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6f012bf70 0x7fe6f013f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.760+0000 7fe6f775d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f011f910 con 0x7fe6f00969d0 2024-09-13T18:39:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.760+0000 7fe6f775d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f009aa20 con 0x7fe6f012bf70 2024-09-13T18:39:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.760+0000 7fe6f775d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0097e10 con 0x7fe6f009dfb0 2024-09-13T18:39:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f4cf8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f009dfb0 0x7fe6f013ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f54f9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f00969d0 0x7fe6f013e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f4cf8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f009dfb0 0x7fe6f013ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:43424/0 (socket says 172.21.15.97:43424) 2024-09-13T18:39:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f4cf8640 1 -- 172.21.15.97:0/1199637637 learned_addr learned my addr 172.21.15.97:0/1199637637 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f5cfa640 1 --2- 172.21.15.97:0/1199637637 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6f012bf70 0x7fe6f013f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f4cf8640 1 -- 172.21.15.97:0/1199637637 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6f012bf70 msgr2=0x7fe6f013f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f4cf8640 1 --2- 172.21.15.97:0/1199637637 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6f012bf70 0x7fe6f013f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f4cf8640 1 -- 172.21.15.97:0/1199637637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f00969d0 msgr2=0x7fe6f013e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f4cf8640 1 --2- 172.21.15.97:0/1199637637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f00969d0 0x7fe6f013e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f4cf8640 1 -- 172.21.15.97:0/1199637637 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e4009390 con 0x7fe6f009dfb0 2024-09-13T18:39:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f5cfa640 1 --2- 172.21.15.97:0/1199637637 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6f012bf70 0x7fe6f013f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f4cf8640 1 --2- 172.21.15.97:0/1199637637 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f009dfb0 0x7fe6f013ee10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400ec80 tx=0x7fe6e40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6ed7fa640 1 -- 172.21.15.97:0/1199637637 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e400eec0 con 0x7fe6f009dfb0 2024-09-13T18:39:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6ed7fa640 1 -- 172.21.15.97:0/1199637637 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e400cbc0 con 0x7fe6f009dfb0 2024-09-13T18:39:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f775d640 1 -- 172.21.15.97:0/1199637637 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e0009ae0 con 0x7fe6f009dfb0 2024-09-13T18:39:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6ed7fa640 1 -- 172.21.15.97:0/1199637637 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4013470 con 0x7fe6f009dfb0 2024-09-13T18:39:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.761+0000 7fe6f775d640 1 -- 172.21.15.97:0/1199637637 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e8009390 con 0x7fe6f009dfb0 2024-09-13T18:39:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.762+0000 7fe6ed7fa640 1 -- 172.21.15.97:0/1199637637 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fe6e40137e0 con 0x7fe6f009dfb0 2024-09-13T18:39:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.762+0000 7fe6ed7fa640 1 -- 172.21.15.97:0/1199637637 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3660+0+0 (secure 0 0 0) 0x7fe6e4042530 con 0x7fe6f009dfb0 2024-09-13T18:39:30.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.762+0000 7fe6f775d640 1 -- 172.21.15.97:0/1199637637 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f0064000 con 0x7fe6f009dfb0 2024-09-13T18:39:30.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.767+0000 7fe6ed7fa640 1 -- 172.21.15.97:0/1199637637 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fe6e4023ad0 con 0x7fe6f009dfb0 2024-09-13T18:39:30.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.918+0000 7fe6f775d640 1 -- 172.21.15.97:0/1199637637 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6f0067670 con 0x7fe6f009dfb0 2024-09-13T18:39:30.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.918+0000 7fe6ed7fa640 1 -- 172.21.15.97:0/1199637637 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+11298 (secure 0 0 0) 0x7fe6e402b090 con 0x7fe6f009dfb0 2024-09-13T18:39:30.921 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:39:30.921 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":21,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:26.605080+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:30.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.920+0000 7fe6f775d640 1 -- 172.21.15.97:0/1199637637 >> v1:172.21.15.97:6816/34603 conn(0x7fe6dc031160 legacy=0x7fe6dc033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.920+0000 7fe6f775d640 1 -- 172.21.15.97:0/1199637637 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f009dfb0 msgr2=0x7fe6f013ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.920+0000 7fe6f775d640 1 --2- 172.21.15.97:0/1199637637 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f009dfb0 0x7fe6f013ee10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400ec80 tx=0x7fe6e40090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.920+0000 7fe6f775d640 1 -- 172.21.15.97:0/1199637637 shutdown_connections 2024-09-13T18:39:30.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.920+0000 7fe6f775d640 1 --2- 172.21.15.97:0/1199637637 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe6f012bf70 0x7fe6f013f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.920+0000 7fe6f775d640 1 --2- 172.21.15.97:0/1199637637 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe6f009dfb0 0x7fe6f013ee10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.920+0000 7fe6f775d640 1 --2- 172.21.15.97:0/1199637637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6f00969d0 0x7fe6f013e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.920+0000 7fe6f775d640 1 -- 172.21.15.97:0/1199637637 >> 172.21.15.97:0/1199637637 conn(0x7fe6f009b200 msgr2=0x7fe6f006b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:30.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.920+0000 7fe6f775d640 1 -- 172.21.15.97:0/1199637637 shutdown_connections 2024-09-13T18:39:30.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:30.920+0000 7fe6f775d640 1 -- 172.21.15.97:0/1199637637 wait complete. 2024-09-13T18:39:30.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:39:01.375967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T18:39:05.732412+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:39:12.014248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:39:12.844264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:39:30.934 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:39:31.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.027+0000 7f8a8083f640 1 Processor -- start 2024-09-13T18:39:31.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.027+0000 7f8a8083f640 1 -- start start 2024-09-13T18:39:31.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.027+0000 7f8a8083f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8a7c09a580 0x7f8a7c096ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.027+0000 7f8a8083f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 0x7f8a7c097480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.027+0000 7f8a8083f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8a7c0979c0 0x7f8a7c12d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.027+0000 7f8a8083f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7c09a950 con 0x7f8a7c09a580 2024-09-13T18:39:31.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.027+0000 7f8a8083f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c06a4a0 con 0x7f8a7c0970b0 2024-09-13T18:39:31.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.027+0000 7f8a8083f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c06b330 con 0x7f8a7c0979c0 2024-09-13T18:39:31.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a7a59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8a7c09a580 0x7f8a7c096ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a7ad9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8a7c0979c0 0x7f8a7c12d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a73fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 0x7f8a7c097480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a7a59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8a7c09a580 0x7f8a7c096ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:52690/0 (socket says 172.21.15.97:52690) 2024-09-13T18:39:31.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a7ad9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8a7c0979c0 0x7f8a7c12d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:43432/0 (socket says 172.21.15.97:43432) 2024-09-13T18:39:31.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a7a59c640 1 -- 172.21.15.97:0/2215804085 learned_addr learned my addr 172.21.15.97:0/2215804085 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:31.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a73fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 0x7f8a7c097480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35570/0 (socket says 172.21.15.97:35570) 2024-09-13T18:39:31.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a73fff640 1 -- 172.21.15.97:0/2215804085 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8a7c0979c0 msgr2=0x7f8a7c12d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:31.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a73fff640 1 --2- 172.21.15.97:0/2215804085 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8a7c0979c0 0x7f8a7c12d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a73fff640 1 -- 172.21.15.97:0/2215804085 >> v2:172.21.15.97:3300/0 conn(0x7f8a7c09a580 msgr2=0x7f8a7c096ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:31.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a73fff640 1 --2- 172.21.15.97:0/2215804085 >> v2:172.21.15.97:3300/0 conn(0x7f8a7c09a580 0x7f8a7c096ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a73fff640 1 -- 172.21.15.97:0/2215804085 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c06a6d0 con 0x7f8a7c0970b0 2024-09-13T18:39:31.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a7a59c640 1 --2- 172.21.15.97:0/2215804085 >> v2:172.21.15.97:3300/0 conn(0x7f8a7c09a580 0x7f8a7c096ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:31.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.028+0000 7f8a7ad9d640 1 --2- 172.21.15.97:0/2215804085 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8a7c0979c0 0x7f8a7c12d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:31.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.029+0000 7f8a73fff640 1 --2- 172.21.15.97:0/2215804085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 0x7f8a7c097480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009850 tx=0x7f8a640090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=128bdabd6d5c87f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.029+0000 7f8a79d9b640 1 -- 172.21.15.97:0/2215804085 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6402abc0 con 0x7f8a7c0970b0 2024-09-13T18:39:31.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.029+0000 7f8a79d9b640 1 -- 172.21.15.97:0/2215804085 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6402ad20 con 0x7f8a7c0970b0 2024-09-13T18:39:31.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.029+0000 7f8a79d9b640 1 -- 172.21.15.97:0/2215804085 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64032670 con 0x7f8a7c0970b0 2024-09-13T18:39:31.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.029+0000 7f8a8083f640 1 -- 172.21.15.97:0/2215804085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 msgr2=0x7f8a7c097480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.029+0000 7f8a8083f640 1 --2- 172.21.15.97:0/2215804085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 0x7f8a7c097480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009850 tx=0x7f8a640090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.029+0000 7f8a8083f640 1 -- 172.21.15.97:0/2215804085 shutdown_connections 2024-09-13T18:39:31.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.029+0000 7f8a8083f640 1 --2- 172.21.15.97:0/2215804085 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8a7c0979c0 0x7f8a7c12d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.029+0000 7f8a8083f640 1 --2- 172.21.15.97:0/2215804085 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 0x7f8a7c097480 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.029+0000 7f8a8083f640 1 --2- 172.21.15.97:0/2215804085 >> v2:172.21.15.97:3300/0 conn(0x7f8a7c09a580 0x7f8a7c096ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.029+0000 7f8a8083f640 1 -- 172.21.15.97:0/2215804085 >> 172.21.15.97:0/2215804085 conn(0x7f8a7c09b170 msgr2=0x7f8a7c09b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.029+0000 7f8a8083f640 1 -- 172.21.15.97:0/2215804085 shutdown_connections 2024-09-13T18:39:31.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.029+0000 7f8a8083f640 1 -- 172.21.15.97:0/2215804085 wait complete. 2024-09-13T18:39:31.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.030+0000 7f8a8083f640 1 Processor -- start 2024-09-13T18:39:31.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.030+0000 7f8a8083f640 1 -- start start 2024-09-13T18:39:31.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a8083f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 0x7f8a7c121f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a8083f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8a7c0979c0 0x7f8a7c11e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a8083f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a7c09a580 0x7f8a7c11e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a8083f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c06b7c0 con 0x7f8a7c09a580 2024-09-13T18:39:31.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a8083f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c06ebc0 con 0x7f8a7c0970b0 2024-09-13T18:39:31.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a8083f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c121a40 con 0x7f8a7c0979c0 2024-09-13T18:39:31.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a7a59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 0x7f8a7c121f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a73fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8a7c0979c0 0x7f8a7c11e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a7a59c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 0x7f8a7c121f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35584/0 (socket says 172.21.15.97:35584) 2024-09-13T18:39:31.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a7a59c640 1 -- 172.21.15.97:0/4271390690 learned_addr learned my addr 172.21.15.97:0/4271390690 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:31.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a7ad9d640 1 --2- 172.21.15.97:0/4271390690 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a7c09a580 0x7f8a7c11e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a7a59c640 1 -- 172.21.15.97:0/4271390690 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8a7c0979c0 msgr2=0x7f8a7c11e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a7a59c640 1 --2- 172.21.15.97:0/4271390690 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8a7c0979c0 0x7f8a7c11e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a7a59c640 1 -- 172.21.15.97:0/4271390690 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a7c09a580 msgr2=0x7f8a7c11e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a7a59c640 1 --2- 172.21.15.97:0/4271390690 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a7c09a580 0x7f8a7c11e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a7a59c640 1 -- 172.21.15.97:0/4271390690 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a74009a20 con 0x7f8a7c0970b0 2024-09-13T18:39:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a73fff640 1 --2- 172.21.15.97:0/4271390690 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8a7c0979c0 0x7f8a7c11e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a7ad9d640 1 --2- 172.21.15.97:0/4271390690 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a7c09a580 0x7f8a7c11e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a7a59c640 1 --2- 172.21.15.97:0/4271390690 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 0x7f8a7c121f40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00ec80 tx=0x7f8a6c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a727fc640 1 -- 172.21.15.97:0/4271390690 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00eec0 con 0x7f8a7c0970b0 2024-09-13T18:39:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a727fc640 1 -- 172.21.15.97:0/4271390690 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c00cb00 con 0x7f8a7c0970b0 2024-09-13T18:39:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a8083f640 1 -- 172.21.15.97:0/4271390690 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c009450 con 0x7f8a7c0970b0 2024-09-13T18:39:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a727fc640 1 -- 172.21.15.97:0/4271390690 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00ce80 con 0x7f8a7c0970b0 2024-09-13T18:39:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.031+0000 7f8a8083f640 1 -- 172.21.15.97:0/4271390690 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a64009390 con 0x7f8a7c0970b0 2024-09-13T18:39:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.032+0000 7f8a727fc640 1 -- 172.21.15.97:0/4271390690 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f8a6c013680 con 0x7f8a7c0970b0 2024-09-13T18:39:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.032+0000 7f8a727fc640 1 -- 172.21.15.97:0/4271390690 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3660+0+0 (secure 0 0 0) 0x7f8a6c0423c0 con 0x7f8a7c0970b0 2024-09-13T18:39:31.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.032+0000 7f8a8083f640 1 -- 172.21.15.97:0/4271390690 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7c121050 con 0x7f8a7c0970b0 2024-09-13T18:39:31.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.037+0000 7f8a727fc640 1 -- 172.21.15.97:0/4271390690 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f8a6c021080 con 0x7f8a7c0970b0 2024-09-13T18:39:31.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.187+0000 7f8a8083f640 1 -- 172.21.15.97:0/4271390690 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a7c0714b0 con 0x7f8a7c0970b0 2024-09-13T18:39:31.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.188+0000 7f8a727fc640 1 -- 172.21.15.97:0/4271390690 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a6c0236b0 con 0x7f8a7c0970b0 2024-09-13T18:39:31.190 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2024-09-13T18:39:31.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.189+0000 7f8a8083f640 1 -- 172.21.15.97:0/4271390690 >> v1:172.21.15.97:6816/34603 conn(0x7f8a5c031160 legacy=0x7f8a5c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.189+0000 7f8a8083f640 1 -- 172.21.15.97:0/4271390690 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 msgr2=0x7f8a7c121f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.189+0000 7f8a8083f640 1 --2- 172.21.15.97:0/4271390690 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 0x7f8a7c121f40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00ec80 tx=0x7f8a6c0091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.190+0000 7f8a8083f640 1 -- 172.21.15.97:0/4271390690 shutdown_connections 2024-09-13T18:39:31.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.190+0000 7f8a8083f640 1 --2- 172.21.15.97:0/4271390690 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a7c09a580 0x7f8a7c11e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.190+0000 7f8a8083f640 1 --2- 172.21.15.97:0/4271390690 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8a7c0979c0 0x7f8a7c11e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.190+0000 7f8a8083f640 1 --2- 172.21.15.97:0/4271390690 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8a7c0970b0 0x7f8a7c121f40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.190+0000 7f8a8083f640 1 -- 172.21.15.97:0/4271390690 >> 172.21.15.97:0/4271390690 conn(0x7f8a7c09b170 msgr2=0x7f8a7c09dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.190+0000 7f8a8083f640 1 -- 172.21.15.97:0/4271390690 shutdown_connections 2024-09-13T18:39:31.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.190+0000 7f8a8083f640 1 -- 172.21.15.97:0/4271390690 wait complete. 2024-09-13T18:39:31.202 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-13T18:39:31.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5d9c94640 1 Processor -- start 2024-09-13T18:39:31.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5d9c94640 1 -- start start 2024-09-13T18:39:31.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5d9c94640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd5d40969d0 0x7fd5d412c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5d9c94640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5d412c990 0x7fd5d4098370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5d9c94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5d412cd60 0x7fd5d40988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5d9c94640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d4096da0 con 0x7fd5d40969d0 2024-09-13T18:39:31.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5d9c94640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d409ac80 con 0x7fd5d412cd60 2024-09-13T18:39:31.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5d9c94640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d4097080 con 0x7fd5d412c990 2024-09-13T18:39:31.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5d3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5d412cd60 0x7fd5d40988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5d37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd5d40969d0 0x7fd5d412c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5cbfff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5d412c990 0x7fd5d4098370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5d3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5d412cd60 0x7fd5d40988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35588/0 (socket says 172.21.15.97:35588) 2024-09-13T18:39:31.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5d3fff640 1 -- 172.21.15.97:0/802474760 learned_addr learned my addr 172.21.15.97:0/802474760 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:31.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.295+0000 7fd5d37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd5d40969d0 0x7fd5d412c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:52708/0 (socket says 172.21.15.97:52708) 2024-09-13T18:39:31.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.296+0000 7fd5d3fff640 1 -- 172.21.15.97:0/802474760 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5d412c990 msgr2=0x7fd5d4098370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:31.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.296+0000 7fd5d3fff640 1 --2- 172.21.15.97:0/802474760 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5d412c990 0x7fd5d4098370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.296+0000 7fd5d3fff640 1 -- 172.21.15.97:0/802474760 >> v2:172.21.15.97:3300/0 conn(0x7fd5d40969d0 msgr2=0x7fd5d412c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:31.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.296+0000 7fd5d3fff640 1 --2- 172.21.15.97:0/802474760 >> v2:172.21.15.97:3300/0 conn(0x7fd5d40969d0 0x7fd5d412c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.296+0000 7fd5d3fff640 1 -- 172.21.15.97:0/802474760 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d4099590 con 0x7fd5d412cd60 2024-09-13T18:39:31.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.296+0000 7fd5d37fe640 1 --2- 172.21.15.97:0/802474760 >> v2:172.21.15.97:3300/0 conn(0x7fd5d40969d0 0x7fd5d412c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:31.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.296+0000 7fd5cbfff640 1 --2- 172.21.15.97:0/802474760 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5d412c990 0x7fd5d4098370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:31.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.296+0000 7fd5d3fff640 1 --2- 172.21.15.97:0/802474760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5d412cd60 0x7fd5d40988b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009f20 tx=0x7fd5cc009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=970428c2c811f7d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.297+0000 7fd5d2ffd640 1 -- 172.21.15.97:0/802474760 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc031400 con 0x7fd5d412cd60 2024-09-13T18:39:31.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.297+0000 7fd5d2ffd640 1 -- 172.21.15.97:0/802474760 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc02d050 con 0x7fd5d412cd60 2024-09-13T18:39:31.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.297+0000 7fd5d2ffd640 1 -- 172.21.15.97:0/802474760 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0317d0 con 0x7fd5d412cd60 2024-09-13T18:39:31.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.297+0000 7fd5d9c94640 1 -- 172.21.15.97:0/802474760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5d412cd60 msgr2=0x7fd5d40988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.297+0000 7fd5d9c94640 1 --2- 172.21.15.97:0/802474760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5d412cd60 0x7fd5d40988b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009f20 tx=0x7fd5cc009840 comp rx=0 tx=0).stop 2024-09-13T18:39:31.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.297+0000 7fd5d9c94640 1 -- 172.21.15.97:0/802474760 shutdown_connections 2024-09-13T18:39:31.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.297+0000 7fd5d9c94640 1 --2- 172.21.15.97:0/802474760 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5d412cd60 0x7fd5d40988b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.297+0000 7fd5d9c94640 1 --2- 172.21.15.97:0/802474760 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5d412c990 0x7fd5d4098370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.297+0000 7fd5d9c94640 1 --2- 172.21.15.97:0/802474760 >> v2:172.21.15.97:3300/0 conn(0x7fd5d40969d0 0x7fd5d412c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.297+0000 7fd5d9c94640 1 -- 172.21.15.97:0/802474760 >> 172.21.15.97:0/802474760 conn(0x7fd5d409b170 msgr2=0x7fd5d409b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.297+0000 7fd5d9c94640 1 -- 172.21.15.97:0/802474760 shutdown_connections 2024-09-13T18:39:31.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.297+0000 7fd5d9c94640 1 -- 172.21.15.97:0/802474760 wait complete. 2024-09-13T18:39:31.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.298+0000 7fd5d9c94640 1 Processor -- start 2024-09-13T18:39:31.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.298+0000 7fd5d9c94640 1 -- start start 2024-09-13T18:39:31.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.298+0000 7fd5d9c94640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5d40969d0 0x7fd5d412b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.298+0000 7fd5d9c94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5d412c990 0x7fd5d411c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.298+0000 7fd5d9c94640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5d412cd60 0x7fd5d411cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5d9c94640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d411d820 con 0x7fd5d412cd60 2024-09-13T18:39:31.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5d9c94640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d411ee80 con 0x7fd5d412c990 2024-09-13T18:39:31.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5d9c94640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d412bef0 con 0x7fd5d40969d0 2024-09-13T18:39:31.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5d37fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5d40969d0 0x7fd5d412b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5cbfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5d412c990 0x7fd5d411c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5d37fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5d40969d0 0x7fd5d412b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:43448/0 (socket says 172.21.15.97:43448) 2024-09-13T18:39:31.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5d37fe640 1 -- 172.21.15.97:0/10109176 learned_addr learned my addr 172.21.15.97:0/10109176 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:31.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5d3fff640 1 --2- 172.21.15.97:0/10109176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5d412cd60 0x7fd5d411cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5cbfff640 1 -- 172.21.15.97:0/10109176 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5d40969d0 msgr2=0x7fd5d412b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5cbfff640 1 --2- 172.21.15.97:0/10109176 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5d40969d0 0x7fd5d412b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5cbfff640 1 -- 172.21.15.97:0/10109176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5d412cd60 msgr2=0x7fd5d411cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5cbfff640 1 --2- 172.21.15.97:0/10109176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5d412cd60 0x7fd5d411cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5cbfff640 1 -- 172.21.15.97:0/10109176 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c4009390 con 0x7fd5d412c990 2024-09-13T18:39:31.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5d37fe640 1 --2- 172.21.15.97:0/10109176 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5d40969d0 0x7fd5d412b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:31.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5cbfff640 1 --2- 172.21.15.97:0/10109176 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5d412c990 0x7fd5d411c7f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00ea50 tx=0x7fd5bc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5cb7fe640 1 -- 172.21.15.97:0/10109176 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00ca10 con 0x7fd5d412c990 2024-09-13T18:39:31.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5cb7fe640 1 -- 172.21.15.97:0/10109176 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc00cb70 con 0x7fd5d412c990 2024-09-13T18:39:31.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5d9c94640 1 -- 172.21.15.97:0/10109176 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5bc009390 con 0x7fd5d412c990 2024-09-13T18:39:31.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5cb7fe640 1 -- 172.21.15.97:0/10109176 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc013470 con 0x7fd5d412c990 2024-09-13T18:39:31.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.299+0000 7fd5d9c94640 1 -- 172.21.15.97:0/10109176 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc009ae0 con 0x7fd5d412c990 2024-09-13T18:39:31.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.300+0000 7fd5cb7fe640 1 -- 172.21.15.97:0/10109176 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fd5bc013860 con 0x7fd5d412c990 2024-09-13T18:39:31.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.300+0000 7fd5cb7fe640 1 -- 172.21.15.97:0/10109176 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3660+0+0 (secure 0 0 0) 0x7fd5bc042370 con 0x7fd5d412c990 2024-09-13T18:39:31.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.300+0000 7fd5d9c94640 1 -- 172.21.15.97:0/10109176 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d40714b0 con 0x7fd5d412c990 2024-09-13T18:39:31.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.304+0000 7fd5cb7fe640 1 -- 172.21.15.97:0/10109176 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fd5bc023ad0 con 0x7fd5d412c990 2024-09-13T18:39:31.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.457+0000 7fd5d9c94640 1 -- 172.21.15.97:0/10109176 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5d409f4e0 con 0x7fd5d412c990 2024-09-13T18:39:31.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.457+0000 7fd5cb7fe640 1 -- 172.21.15.97:0/10109176 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5bc02a0a0 con 0x7fd5d412c990 2024-09-13T18:39:31.460 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 8 2024-09-13T18:39:31.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.459+0000 7fd5d9c94640 1 -- 172.21.15.97:0/10109176 >> v1:172.21.15.97:6816/34603 conn(0x7fd5b4031160 legacy=0x7fd5b4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.459+0000 7fd5d9c94640 1 -- 172.21.15.97:0/10109176 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5d412c990 msgr2=0x7fd5d411c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.459+0000 7fd5d9c94640 1 --2- 172.21.15.97:0/10109176 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5d412c990 0x7fd5d411c7f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00ea50 tx=0x7fd5bc0090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.459+0000 7fd5d9c94640 1 -- 172.21.15.97:0/10109176 shutdown_connections 2024-09-13T18:39:31.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.459+0000 7fd5d9c94640 1 --2- 172.21.15.97:0/10109176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5d412cd60 0x7fd5d411cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.459+0000 7fd5d9c94640 1 --2- 172.21.15.97:0/10109176 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd5d412c990 0x7fd5d411c7f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.459+0000 7fd5d9c94640 1 --2- 172.21.15.97:0/10109176 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5d40969d0 0x7fd5d412b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.459+0000 7fd5d9c94640 1 -- 172.21.15.97:0/10109176 >> 172.21.15.97:0/10109176 conn(0x7fd5d409b170 msgr2=0x7fd5d406d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.459+0000 7fd5d9c94640 1 -- 172.21.15.97:0/10109176 shutdown_connections 2024-09-13T18:39:31.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.459+0000 7fd5d9c94640 1 -- 172.21.15.97:0/10109176 wait complete. 2024-09-13T18:39:31.472 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:39:31.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.566+0000 7f2d9b35d640 1 Processor -- start 2024-09-13T18:39:31.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.566+0000 7f2d9b35d640 1 -- start start 2024-09-13T18:39:31.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.566+0000 7f2d9b35d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2d9409dbb0 0x7f2d94130f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.566+0000 7f2d9b35d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d9409e000 0x7f2d94133460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.567+0000 7f2d9b35d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d94096f90 con 0x7f2d9409d0d0 2024-09-13T18:39:31.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.567+0000 7f2d9b35d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d94098440 con 0x7f2d9409dbb0 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.567+0000 7f2d9b35d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9406ec20 con 0x7f2d9409e000 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.567+0000 7f2d990f9640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2d9409d0d0 0x7f2d9409d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53324/0 (socket says 172.21.15.97:53324) 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.567+0000 7f2d998fa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d9409e000 0x7f2d94133460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.567+0000 7f2d988f8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2d9409dbb0 0x7f2d94130f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.567+0000 7f2d990f9640 1 -- 172.21.15.97:0/2016303143 learned_addr learned my addr 172.21.15.97:0/2016303143 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.567+0000 7f2d998fa640 1 -- 172.21.15.97:0/2016303143 >> v2:172.21.15.97:3300/0 conn(0x7f2d9409dbb0 msgr2=0x7f2d94130f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.567+0000 7f2d998fa640 1 --2- 172.21.15.97:0/2016303143 >> v2:172.21.15.97:3300/0 conn(0x7f2d9409dbb0 0x7f2d94130f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.567+0000 7f2d998fa640 1 -- 172.21.15.97:0/2016303143 >> v1:172.21.15.97:6789/0 conn(0x7f2d9409d0d0 legacy=0x7f2d9409d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.567+0000 7f2d998fa640 1 -- 172.21.15.97:0/2016303143 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d94097960 con 0x7f2d9409e000 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.567+0000 7f2d988f8640 1 --2- 172.21.15.97:0/2016303143 >> v2:172.21.15.97:3300/0 conn(0x7f2d9409dbb0 0x7f2d94130f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.568+0000 7f2d998fa640 1 --2- 172.21.15.97:0/2016303143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d9409e000 0x7f2d94133460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00bf00 tx=0x7f2d8c00d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebbf3b9500c83c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.568+0000 7f2d8bfff640 1 -- 172.21.15.97:0/2016303143 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c030480 con 0x7f2d9409e000 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.568+0000 7f2d8bfff640 1 -- 172.21.15.97:0/2016303143 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c02d030 con 0x7f2d9409e000 2024-09-13T18:39:31.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.568+0000 7f2d8bfff640 1 -- 172.21.15.97:0/2016303143 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c030850 con 0x7f2d9409e000 2024-09-13T18:39:31.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.568+0000 7f2d9b35d640 1 -- 172.21.15.97:0/2016303143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d9409e000 msgr2=0x7f2d94133460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.568+0000 7f2d9b35d640 1 --2- 172.21.15.97:0/2016303143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d9409e000 0x7f2d94133460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00bf00 tx=0x7f2d8c00d040 comp rx=0 tx=0).stop 2024-09-13T18:39:31.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.568+0000 7f2d9b35d640 1 -- 172.21.15.97:0/2016303143 shutdown_connections 2024-09-13T18:39:31.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.568+0000 7f2d9b35d640 1 --2- 172.21.15.97:0/2016303143 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d9409e000 0x7f2d94133460 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.568+0000 7f2d9b35d640 1 --2- 172.21.15.97:0/2016303143 >> v2:172.21.15.97:3300/0 conn(0x7f2d9409dbb0 0x7f2d94130f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.568+0000 7f2d9b35d640 1 -- 172.21.15.97:0/2016303143 >> 172.21.15.97:0/2016303143 conn(0x7f2d9409b200 msgr2=0x7f2d9409b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.568+0000 7f2d9b35d640 1 -- 172.21.15.97:0/2016303143 shutdown_connections 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.568+0000 7f2d9b35d640 1 -- 172.21.15.97:0/2016303143 wait complete. 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.569+0000 7f2d9b35d640 1 Processor -- start 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.569+0000 7f2d9b35d640 1 -- start start 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d9b35d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2d9409d0d0 0x7f2d9411e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d9b35d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d9409dbb0 0x7f2d9411b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d9b35d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d9409e000 0x7f2d9411b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d9b35d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9411da00 con 0x7f2d9409e000 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d9b35d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9411dcc0 con 0x7f2d9409dbb0 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d9b35d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9411bab0 con 0x7f2d9409d0d0 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d988f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d9409dbb0 0x7f2d9411b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d990f9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2d9409d0d0 0x7f2d9411e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d988f8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d9409dbb0 0x7f2d9411b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:35600/0 (socket says 172.21.15.97:35600) 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d988f8640 1 -- 172.21.15.97:0/3120980800 learned_addr learned my addr 172.21.15.97:0/3120980800 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d998fa640 1 --2- 172.21.15.97:0/3120980800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d9409e000 0x7f2d9411b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d988f8640 1 -- 172.21.15.97:0/3120980800 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2d9409d0d0 msgr2=0x7f2d9411e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d988f8640 1 --2- 172.21.15.97:0/3120980800 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2d9409d0d0 0x7f2d9411e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d988f8640 1 -- 172.21.15.97:0/3120980800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d9409e000 msgr2=0x7f2d9411b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d988f8640 1 --2- 172.21.15.97:0/3120980800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d9409e000 0x7f2d9411b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d988f8640 1 -- 172.21.15.97:0/3120980800 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8400d830 con 0x7f2d9409dbb0 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d988f8640 1 --2- 172.21.15.97:0/3120980800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d9409dbb0 0x7f2d9411b030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400deb0 tx=0x7f2d8400f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.570+0000 7f2d897fa640 1 -- 172.21.15.97:0/3120980800 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400d2e0 con 0x7f2d9409dbb0 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.571+0000 7f2d897fa640 1 -- 172.21.15.97:0/3120980800 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d84013040 con 0x7f2d9409dbb0 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.571+0000 7f2d9b35d640 1 -- 172.21.15.97:0/3120980800 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c00ba40 con 0x7f2d9409dbb0 2024-09-13T18:39:31.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.571+0000 7f2d897fa640 1 -- 172.21.15.97:0/3120980800 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84010e10 con 0x7f2d9409dbb0 2024-09-13T18:39:31.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.571+0000 7f2d9b35d640 1 -- 172.21.15.97:0/3120980800 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9411ac10 con 0x7f2d9409dbb0 2024-09-13T18:39:31.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.571+0000 7f2d897fa640 1 -- 172.21.15.97:0/3120980800 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f2d84018690 con 0x7f2d9409dbb0 2024-09-13T18:39:31.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.571+0000 7f2d9b35d640 1 -- 172.21.15.97:0/3120980800 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d94064000 con 0x7f2d9409dbb0 2024-09-13T18:39:31.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.571+0000 7f2d897fa640 1 -- 172.21.15.97:0/3120980800 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3660+0+0 (secure 0 0 0) 0x7f2d84046160 con 0x7f2d9409dbb0 2024-09-13T18:39:31.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.576+0000 7f2d897fa640 1 -- 172.21.15.97:0/3120980800 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f2d8400b450 con 0x7f2d9409dbb0 2024-09-13T18:39:31.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.727+0000 7f2d9b35d640 1 -- 172.21.15.97:0/3120980800 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d9411d620 con 0x7f2d9409dbb0 2024-09-13T18:39:31.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.727+0000 7f2d897fa640 1 -- 172.21.15.97:0/3120980800 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d84016e60 con 0x7f2d9409dbb0 2024-09-13T18:39:31.730 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2024-09-13T18:39:31.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.729+0000 7f2d9b35d640 1 -- 172.21.15.97:0/3120980800 >> v1:172.21.15.97:6816/34603 conn(0x7f2d78031160 legacy=0x7f2d78033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.729+0000 7f2d9b35d640 1 -- 172.21.15.97:0/3120980800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d9409dbb0 msgr2=0x7f2d9411b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.729+0000 7f2d9b35d640 1 --2- 172.21.15.97:0/3120980800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d9409dbb0 0x7f2d9411b030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400deb0 tx=0x7f2d8400f040 comp rx=0 tx=0).stop 2024-09-13T18:39:31.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.729+0000 7f2d9b35d640 1 -- 172.21.15.97:0/3120980800 shutdown_connections 2024-09-13T18:39:31.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.729+0000 7f2d9b35d640 1 --2- 172.21.15.97:0/3120980800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d9409e000 0x7f2d9411b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.729+0000 7f2d9b35d640 1 --2- 172.21.15.97:0/3120980800 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2d9409dbb0 0x7f2d9411b030 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.729+0000 7f2d9b35d640 1 --2- 172.21.15.97:0/3120980800 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2d9409d0d0 0x7f2d9411e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.729+0000 7f2d9b35d640 1 -- 172.21.15.97:0/3120980800 >> 172.21.15.97:0/3120980800 conn(0x7f2d9409b200 msgr2=0x7f2d94099170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.729+0000 7f2d9b35d640 1 -- 172.21.15.97:0/3120980800 shutdown_connections 2024-09-13T18:39:31.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.729+0000 7f2d9b35d640 1 -- 172.21.15.97:0/3120980800 wait complete. 2024-09-13T18:39:31.742 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:39:31.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.836+0000 7ffa2239d640 1 Processor -- start 2024-09-13T18:39:31.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.836+0000 7ffa2239d640 1 -- start start 2024-09-13T18:39:31.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa2239d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa1c0969d0 0x7ffa1c12c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa2239d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffa1c12c990 0x7ffa1c098370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa2239d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa1c12cd60 0x7ffa1c0988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa2239d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1c096da0 con 0x7ffa1c12c990 2024-09-13T18:39:31.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa2239d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c09ac80 con 0x7ffa1c12cd60 2024-09-13T18:39:31.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa2239d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c097080 con 0x7ffa1c0969d0 2024-09-13T18:39:31.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa1bfff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa1c0969d0 0x7ffa1c12c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa2093a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa1c12cd60 0x7ffa1c0988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa13fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffa1c12c990 0x7ffa1c098370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa1bfff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa1c0969d0 0x7ffa1c12c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:43464/0 (socket says 172.21.15.97:43464) 2024-09-13T18:39:31.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa1bfff640 1 -- 172.21.15.97:0/2705713100 learned_addr learned my addr 172.21.15.97:0/2705713100 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:31.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa13fff640 1 -- 172.21.15.97:0/2705713100 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa1c0969d0 msgr2=0x7ffa1c12c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:31.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa13fff640 1 --2- 172.21.15.97:0/2705713100 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa1c0969d0 0x7ffa1c12c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa13fff640 1 -- 172.21.15.97:0/2705713100 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa1c12cd60 msgr2=0x7ffa1c0988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:31.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa13fff640 1 --2- 172.21.15.97:0/2705713100 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa1c12cd60 0x7ffa1c0988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa13fff640 1 -- 172.21.15.97:0/2705713100 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c099590 con 0x7ffa1c12c990 2024-09-13T18:39:31.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.837+0000 7ffa2093a640 1 --2- 172.21.15.97:0/2705713100 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa1c12cd60 0x7ffa1c0988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:31.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.838+0000 7ffa13fff640 1 --2- 172.21.15.97:0/2705713100 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa1c12c990 0x7ffa1c098370 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009850 tx=0x7ffa040090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b474dc55768a3782 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.838+0000 7ffa1b7fe640 1 -- 172.21.15.97:0/2705713100 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0402abc0 con 0x7ffa1c12c990 2024-09-13T18:39:31.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.838+0000 7ffa1b7fe640 1 -- 172.21.15.97:0/2705713100 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0402ad20 con 0x7ffa1c12c990 2024-09-13T18:39:31.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.838+0000 7ffa1b7fe640 1 -- 172.21.15.97:0/2705713100 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04032670 con 0x7ffa1c12c990 2024-09-13T18:39:31.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.839+0000 7ffa2239d640 1 -- 172.21.15.97:0/2705713100 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa1c12c990 msgr2=0x7ffa1c098370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.839+0000 7ffa2239d640 1 --2- 172.21.15.97:0/2705713100 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa1c12c990 0x7ffa1c098370 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009850 tx=0x7ffa040090f0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.839+0000 7ffa2239d640 1 -- 172.21.15.97:0/2705713100 shutdown_connections 2024-09-13T18:39:31.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.839+0000 7ffa2239d640 1 --2- 172.21.15.97:0/2705713100 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa1c12cd60 0x7ffa1c0988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.839+0000 7ffa2239d640 1 --2- 172.21.15.97:0/2705713100 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa1c12c990 0x7ffa1c098370 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.839+0000 7ffa2239d640 1 --2- 172.21.15.97:0/2705713100 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa1c0969d0 0x7ffa1c12c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.839+0000 7ffa2239d640 1 -- 172.21.15.97:0/2705713100 >> 172.21.15.97:0/2705713100 conn(0x7ffa1c09b170 msgr2=0x7ffa1c09b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.839+0000 7ffa2239d640 1 -- 172.21.15.97:0/2705713100 shutdown_connections 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.839+0000 7ffa2239d640 1 -- 172.21.15.97:0/2705713100 wait complete. 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa2239d640 1 Processor -- start 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa2239d640 1 -- start start 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa2239d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa1c0969d0 0x7ffa1c13a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa2239d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa1c12c990 0x7ffa1c13af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa2239d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa1c12cd60 0x7ffa1c1171e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa2239d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c119790 con 0x7ffa1c12cd60 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa2239d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0984f0 con 0x7ffa1c12c990 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa2239d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c099d50 con 0x7ffa1c0969d0 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa1bfff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa1c0969d0 0x7ffa1c13a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa13fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa1c12c990 0x7ffa1c13af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa1bfff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa1c0969d0 0x7ffa1c13a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:43476/0 (socket says 172.21.15.97:43476) 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa1bfff640 1 -- 172.21.15.97:0/770393290 learned_addr learned my addr 172.21.15.97:0/770393290 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa2093a640 1 --2- 172.21.15.97:0/770393290 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa1c12cd60 0x7ffa1c1171e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa1bfff640 1 -- 172.21.15.97:0/770393290 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa1c12c990 msgr2=0x7ffa1c13af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa1bfff640 1 --2- 172.21.15.97:0/770393290 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa1c12c990 0x7ffa1c13af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa1bfff640 1 -- 172.21.15.97:0/770393290 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa1c12cd60 msgr2=0x7ffa1c1171e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa1bfff640 1 --2- 172.21.15.97:0/770393290 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa1c12cd60 0x7ffa1c1171e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa1bfff640 1 -- 172.21.15.97:0/770393290 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1400bc30 con 0x7ffa1c0969d0 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa2093a640 1 --2- 172.21.15.97:0/770393290 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa1c12cd60 0x7ffa1c1171e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.840+0000 7ffa13fff640 1 --2- 172.21.15.97:0/770393290 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa1c12c990 0x7ffa1c13af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.841+0000 7ffa1bfff640 1 --2- 172.21.15.97:0/770393290 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa1c0969d0 0x7ffa1c13a9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00ea20 tx=0x7ffa0c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.841+0000 7ffa18ff9640 1 -- 172.21.15.97:0/770393290 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c00c940 con 0x7ffa1c0969d0 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.841+0000 7ffa18ff9640 1 -- 172.21.15.97:0/770393290 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c00caa0 con 0x7ffa1c0969d0 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.841+0000 7ffa2239d640 1 -- 172.21.15.97:0/770393290 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa04009390 con 0x7ffa1c0969d0 2024-09-13T18:39:31.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.841+0000 7ffa18ff9640 1 -- 172.21.15.97:0/770393290 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c00ce60 con 0x7ffa1c0969d0 2024-09-13T18:39:31.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.841+0000 7ffa2239d640 1 -- 172.21.15.97:0/770393290 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c11b350 con 0x7ffa1c0969d0 2024-09-13T18:39:31.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.841+0000 7ffa18ff9640 1 -- 172.21.15.97:0/770393290 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7ffa0c013680 con 0x7ffa1c0969d0 2024-09-13T18:39:31.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.842+0000 7ffa18ff9640 1 -- 172.21.15.97:0/770393290 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3660+0+0 (secure 0 0 0) 0x7ffa0c042300 con 0x7ffa1c0969d0 2024-09-13T18:39:31.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.842+0000 7ffa2239d640 1 -- 172.21.15.97:0/770393290 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1c11a880 con 0x7ffa1c0969d0 2024-09-13T18:39:31.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.846+0000 7ffa18ff9640 1 -- 172.21.15.97:0/770393290 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7ffa0c021080 con 0x7ffa1c0969d0 2024-09-13T18:39:31.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.996+0000 7ffa2239d640 1 -- 172.21.15.97:0/770393290 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa1c0714b0 con 0x7ffa1c0969d0 2024-09-13T18:39:31.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.996+0000 7ffa18ff9640 1 -- 172.21.15.97:0/770393290 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa0c023ad0 con 0x7ffa1c0969d0 2024-09-13T18:39:31.999 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2024-09-13T18:39:32.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.998+0000 7ffa2239d640 1 -- 172.21.15.97:0/770393290 >> v1:172.21.15.97:6816/34603 conn(0x7ff9fc031160 legacy=0x7ff9fc033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.998+0000 7ffa2239d640 1 -- 172.21.15.97:0/770393290 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa1c0969d0 msgr2=0x7ffa1c13a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.998+0000 7ffa2239d640 1 --2- 172.21.15.97:0/770393290 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa1c0969d0 0x7ffa1c13a9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00ea20 tx=0x7ffa0c0091d0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.998+0000 7ffa2239d640 1 -- 172.21.15.97:0/770393290 shutdown_connections 2024-09-13T18:39:32.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.998+0000 7ffa2239d640 1 --2- 172.21.15.97:0/770393290 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa1c12cd60 0x7ffa1c1171e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.998+0000 7ffa2239d640 1 --2- 172.21.15.97:0/770393290 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffa1c12c990 0x7ffa1c13af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.998+0000 7ffa2239d640 1 --2- 172.21.15.97:0/770393290 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffa1c0969d0 0x7ffa1c13a9d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.998+0000 7ffa2239d640 1 -- 172.21.15.97:0/770393290 >> 172.21.15.97:0/770393290 conn(0x7ffa1c09b170 msgr2=0x7ffa1c06a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:32.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.998+0000 7ffa2239d640 1 -- 172.21.15.97:0/770393290 shutdown_connections 2024-09-13T18:39:32.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:31.998+0000 7ffa2239d640 1 -- 172.21.15.97:0/770393290 wait complete. 2024-09-13T18:39:32.011 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:39:32.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.102+0000 7fc98860f640 1 Processor -- start 2024-09-13T18:39:32.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.102+0000 7fc98860f640 1 -- start start 2024-09-13T18:39:32.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.102+0000 7fc98860f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc98012cda0 0x7fc9801315f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.102+0000 7fc98860f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc980131b30 0x7fc980133f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.102+0000 7fc98860f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98009c520 con 0x7fc98012c2c0 2024-09-13T18:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.102+0000 7fc98860f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc980097a40 con 0x7fc98012cda0 2024-09-13T18:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.102+0000 7fc98860f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc980098e00 con 0x7fc980131b30 2024-09-13T18:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.102+0000 7fc986bac640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc980131b30 0x7fc980133f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.102+0000 7fc985baa640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc98012cda0 0x7fc9801315f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.103+0000 7fc9863ab640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc98012c2c0 0x7fc98012c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53330/0 (socket says 172.21.15.97:53330) 2024-09-13T18:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.103+0000 7fc9863ab640 1 -- 172.21.15.97:0/1968314195 learned_addr learned my addr 172.21.15.97:0/1968314195 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.103+0000 7fc986bac640 1 -- 172.21.15.97:0/1968314195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc98012cda0 msgr2=0x7fc9801315f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.103+0000 7fc986bac640 1 --2- 172.21.15.97:0/1968314195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc98012cda0 0x7fc9801315f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.103+0000 7fc986bac640 1 -- 172.21.15.97:0/1968314195 >> v1:172.21.15.97:6789/0 conn(0x7fc98012c2c0 legacy=0x7fc98012c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.103+0000 7fc986bac640 1 -- 172.21.15.97:0/1968314195 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc980097f60 con 0x7fc980131b30 2024-09-13T18:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.103+0000 7fc9853a9640 1 -- 172.21.15.97:0/1968314195 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025978269 0 0) 0x7fc98009c520 con 0x7fc98012c2c0 2024-09-13T18:39:32.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.103+0000 7fc985baa640 1 --2- 172.21.15.97:0/1968314195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc98012cda0 0x7fc9801315f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.103+0000 7fc986bac640 1 --2- 172.21.15.97:0/1968314195 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc980131b30 0x7fc980133f10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc978009e90 tx=0x7fc978009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49eea0997b2a4b4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.104+0000 7fc9853a9640 1 -- 172.21.15.97:0/1968314195 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978031400 con 0x7fc980131b30 2024-09-13T18:39:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.104+0000 7fc9853a9640 1 -- 172.21.15.97:0/1968314195 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97802d050 con 0x7fc980131b30 2024-09-13T18:39:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.104+0000 7fc9853a9640 1 -- 172.21.15.97:0/1968314195 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978031790 con 0x7fc980131b30 2024-09-13T18:39:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.104+0000 7fc98860f640 1 -- 172.21.15.97:0/1968314195 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc980131b30 msgr2=0x7fc980133f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.104+0000 7fc98860f640 1 --2- 172.21.15.97:0/1968314195 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc980131b30 0x7fc980133f10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc978009e90 tx=0x7fc978009780 comp rx=0 tx=0).stop 2024-09-13T18:39:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.104+0000 7fc98860f640 1 -- 172.21.15.97:0/1968314195 shutdown_connections 2024-09-13T18:39:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.104+0000 7fc98860f640 1 --2- 172.21.15.97:0/1968314195 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc98012cda0 0x7fc9801315f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.104+0000 7fc98860f640 1 --2- 172.21.15.97:0/1968314195 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc980131b30 0x7fc980133f10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.104+0000 7fc98860f640 1 -- 172.21.15.97:0/1968314195 >> 172.21.15.97:0/1968314195 conn(0x7fc98009f9b0 msgr2=0x7fc98009b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:32.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.104+0000 7fc98860f640 1 -- 172.21.15.97:0/1968314195 shutdown_connections 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.104+0000 7fc98860f640 1 -- 172.21.15.97:0/1968314195 wait complete. 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.105+0000 7fc98860f640 1 Processor -- start 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.105+0000 7fc98860f640 1 -- start start 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.105+0000 7fc98860f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc98012c2c0 0x7fc98012a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc98860f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc98012cda0 0x7fc98012ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc98860f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc980131b30 0x7fc98012b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc98860f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98009b1b0 con 0x7fc98012cda0 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc98860f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc980097710 con 0x7fc980131b30 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc98860f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc980125fe0 con 0x7fc98012c2c0 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc9863ab640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc98012c2c0 0x7fc98012a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc985baa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc98012cda0 0x7fc98012ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc9863ab640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc98012c2c0 0x7fc98012a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:43490/0 (socket says 172.21.15.97:43490) 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc985baa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc98012cda0 0x7fc98012ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:52748/0 (socket says 172.21.15.97:52748) 2024-09-13T18:39:32.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc9863ab640 1 -- 172.21.15.97:0/4161778724 learned_addr learned my addr 172.21.15.97:0/4161778724 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc986bac640 1 --2- 172.21.15.97:0/4161778724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc980131b30 0x7fc98012b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc9863ab640 1 -- 172.21.15.97:0/4161778724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc980131b30 msgr2=0x7fc98012b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc9863ab640 1 --2- 172.21.15.97:0/4161778724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc980131b30 0x7fc98012b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc9863ab640 1 -- 172.21.15.97:0/4161778724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc98012cda0 msgr2=0x7fc98012ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc9863ab640 1 --2- 172.21.15.97:0/4161778724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc98012cda0 0x7fc98012ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc9863ab640 1 -- 172.21.15.97:0/4161778724 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc970009390 con 0x7fc98012c2c0 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc9863ab640 1 --2- 172.21.15.97:0/4161778724 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc98012c2c0 0x7fc98012a5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00c5e0 tx=0x7fc97c007d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc9767fc640 1 -- 172.21.15.97:0/4161778724 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c005aa0 con 0x7fc98012c2c0 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc9767fc640 1 -- 172.21.15.97:0/4161778724 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c005c00 con 0x7fc98012c2c0 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc9767fc640 1 -- 172.21.15.97:0/4161778724 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c0070f0 con 0x7fc98012c2c0 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc98860f640 1 -- 172.21.15.97:0/4161778724 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc978009a20 con 0x7fc98012c2c0 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.106+0000 7fc98860f640 1 -- 172.21.15.97:0/4161778724 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc980124880 con 0x7fc98012c2c0 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.107+0000 7fc9767fc640 1 -- 172.21.15.97:0/4161778724 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fc97c007520 con 0x7fc98012c2c0 2024-09-13T18:39:32.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.107+0000 7fc9767fc640 1 -- 172.21.15.97:0/4161778724 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3660+0+0 (secure 0 0 0) 0x7fc97c041af0 con 0x7fc98012c2c0 2024-09-13T18:39:32.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.107+0000 7fc98860f640 1 -- 172.21.15.97:0/4161778724 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc980064000 con 0x7fc98012c2c0 2024-09-13T18:39:32.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.112+0000 7fc9767fc640 1 -- 172.21.15.97:0/4161778724 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fc97c01b400 con 0x7fc98012c2c0 2024-09-13T18:39:32.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.276+0000 7fc98860f640 1 -- 172.21.15.97:0/4161778724 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc98012c7b0 con 0x7fc98012c2c0 2024-09-13T18:39:32.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.276+0000 7fc9767fc640 1 -- 172.21.15.97:0/4161778724 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc97c01a360 con 0x7fc98012c2c0 2024-09-13T18:39:32.279 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2024-09-13T18:39:32.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.278+0000 7fc98860f640 1 -- 172.21.15.97:0/4161778724 >> v1:172.21.15.97:6816/34603 conn(0x7fc964031160 legacy=0x7fc964033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.278+0000 7fc98860f640 1 -- 172.21.15.97:0/4161778724 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc98012c2c0 msgr2=0x7fc98012a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.278+0000 7fc98860f640 1 --2- 172.21.15.97:0/4161778724 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc98012c2c0 0x7fc98012a5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00c5e0 tx=0x7fc97c007d00 comp rx=0 tx=0).stop 2024-09-13T18:39:32.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.278+0000 7fc98860f640 1 -- 172.21.15.97:0/4161778724 shutdown_connections 2024-09-13T18:39:32.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.278+0000 7fc98860f640 1 --2- 172.21.15.97:0/4161778724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc980131b30 0x7fc98012b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.278+0000 7fc98860f640 1 --2- 172.21.15.97:0/4161778724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc98012cda0 0x7fc98012ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.278+0000 7fc98860f640 1 --2- 172.21.15.97:0/4161778724 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc98012c2c0 0x7fc98012a5e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.278+0000 7fc98860f640 1 -- 172.21.15.97:0/4161778724 >> 172.21.15.97:0/4161778724 conn(0x7fc98009f9b0 msgr2=0x7fc980131090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:32.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.279+0000 7fc98860f640 1 -- 172.21.15.97:0/4161778724 shutdown_connections 2024-09-13T18:39:32.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:39:32.279+0000 7fc98860f640 1 -- 172.21.15.97:0/4161778724 wait complete. 2024-09-13T18:39:32.292 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi142.front.sepia.ceph.com... 2024-09-13T18:39:32.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:32.292 DEBUG:teuthology.orchestra.run.smithi142:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:39:32.319 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi142.stderr:ceph-fuse[28917]: fuse finished with error 0 and tester_r 0 2024-09-13T18:39:32.325 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:32.342 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-09-13T18:39:32.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:32.343 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:39:32.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:32.429 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-13T18:39:32.445 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:39:32.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:32.446 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:39:32.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:32.513 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-09-13T18:39:32.618 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T18:39:32.618 INFO:teuthology.run_tasks:Running task print... 2024-09-13T18:39:32.630 INFO:teuthology.task.print:**** done unmount client.0 2024-09-13T18:39:32.630 INFO:teuthology.run_tasks:Running task install.upgrade... 2024-09-13T18:39:32.642 INFO:teuthology.task.install:project ceph config {'client.0': None} overrides {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:39:32.642 INFO:teuthology.task.install:remote ubuntu@smithi142.front.sepia.ceph.com config {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:39:32.642 INFO:teuthology.task.install:extra packages: [] 2024-09-13T18:39:32.648 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T18:39:32.648 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2024-09-13T18:39:32.648 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:39:32.669 INFO:teuthology.orchestra.run.smithi142.stdout:17.2.7-1629.geb16b97b.el9 2024-09-13T18:39:32.670 INFO:teuthology.packaging:The installed version of ceph-common is 17.2.7-1629.geb16b97b.el9 2024-09-13T18:39:32.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:39:32.839 INFO:teuthology.task.install:Ceph rpm upgrade from 17.2.7-1629.geb16b97b.el9 to 18.2.4-860.g6c6b083f 2024-09-13T18:39:32.840 INFO:teuthology.task.install.rpm:Host smithi142 is: centos 9.stream x86_64 2024-09-13T18:39:32.840 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:39:32.996 INFO:teuthology.task.install.rpm:Repo base URL: https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T18:39:32.996 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-09-13T18:39:33.144 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:39:33.144 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:39:33.144 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:39:33.169 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:39:33.235 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:39:33.303 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:39:33.360 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-09-13T18:39:33.371 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-09-13T18:39:33.598 INFO:teuthology.orchestra.run.smithi142.stdout:60 files removed 2024-09-13T18:39:33.626 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2024-09-13T18:39:34.189 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 290 kB/s | 78 kB 00:00 2024-09-13T18:39:34.464 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 50 kB/s | 11 kB 00:00 2024-09-13T18:39:34.740 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-13T18:39:36.598 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-13T18:39:38.258 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 37 MB/s | 20 MB 00:00 2024-09-13T18:39:42.867 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-13T18:39:44.376 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-13T18:39:45.364 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-13T18:39:50.844 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T18:39:53.110 INFO:teuthology.orchestra.run.smithi142.stderr:Package cephadm available, but not installed. 2024-09-13T18:39:53.111 INFO:teuthology.orchestra.run.smithi142.stdout:No match for argument: cephadm 2024-09-13T18:39:53.111 INFO:teuthology.orchestra.run.smithi142.stderr:Package ceph-immutable-object-cache available, but not installed. 2024-09-13T18:39:53.111 INFO:teuthology.orchestra.run.smithi142.stdout:No match for argument: ceph-immutable-object-cache 2024-09-13T18:39:53.122 INFO:teuthology.orchestra.run.smithi142.stderr:Package ceph-mgr-cephadm available, but not installed. 2024-09-13T18:39:53.123 INFO:teuthology.orchestra.run.smithi142.stdout:No match for argument: ceph-mgr-cephadm 2024-09-13T18:39:53.125 INFO:teuthology.orchestra.run.smithi142.stderr:Package ceph-volume available, but not installed. 2024-09-13T18:39:53.126 INFO:teuthology.orchestra.run.smithi142.stdout:No match for argument: ceph-volume 2024-09-13T18:39:53.218 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T18:39:53.221 INFO:teuthology.orchestra.run.smithi142.stdout:====================================================================================== 2024-09-13T18:39:53.221 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-13T18:39:53.221 INFO:teuthology.orchestra.run.smithi142.stdout:====================================================================================== 2024-09-13T18:39:53.221 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-09-13T18:39:53.221 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T18:39:53.221 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T18:39:53.221 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T18:39:53.221 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T18:39:53.222 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T18:39:53.222 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T18:39:53.222 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T18:39:53.222 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T18:39:53.222 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T18:39:53.222 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T18:39:53.222 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T18:39:53.222 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T18:39:53.222 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T18:39:53.223 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T18:39:53.223 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T18:39:53.223 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T18:39:53.223 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T18:39:53.224 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T18:39:53.224 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T18:39:53.224 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T18:39:53.224 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T18:39:53.224 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T18:39:53.224 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T18:39:53.224 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:39:53.224 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T18:39:53.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T18:39:53.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T18:39:53.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T18:39:53.225 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T18:39:53.225 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T18:39:53.225 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T18:39:53.225 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T18:39:53.225 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:39:53.225 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T18:39:53.225 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-13T18:39:53.225 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:39:53.225 INFO:teuthology.orchestra.run.smithi142.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:39:53.225 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:39:53.225 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:39:53.225 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:39:53.225 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:39:53.226 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:39:53.226 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T18:39:53.226 INFO:teuthology.orchestra.run.smithi142.stdout:====================================================================================== 2024-09-13T18:39:53.226 INFO:teuthology.orchestra.run.smithi142.stdout:Install 6 Packages 2024-09-13T18:39:53.226 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 34 Packages 2024-09-13T18:39:53.226 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:39:53.226 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 130 M 2024-09-13T18:39:53.226 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T18:39:53.771 INFO:teuthology.orchestra.run.smithi142.stdout:(1/40): fmt-8.1.1-5.el9.x86_64.rpm 1.9 MB/s | 111 kB 00:00 2024-09-13T18:39:53.804 INFO:teuthology.orchestra.run.smithi142.stdout:(2/40): libarrow-doc-9.0.0-11.el9.noarch.rpm 822 kB/s | 26 kB 00:00 2024-09-13T18:39:53.863 INFO:teuthology.orchestra.run.smithi142.stdout:(3/40): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-13T18:39:53.896 INFO:teuthology.orchestra.run.smithi142.stdout:(4/40): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T18:39:53.972 INFO:teuthology.orchestra.run.smithi142.stdout:(5/40): libarrow-9.0.0-11.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-13T18:39:54.089 INFO:teuthology.orchestra.run.smithi142.stdout:(6/40): ceph-18.2.4-860.g6c6b083f.el9.x86_64.rp 34 kB/s | 6.5 kB 00:00 2024-09-13T18:39:54.422 INFO:teuthology.orchestra.run.smithi142.stdout:(7/40): ceph-base-18.2.4-860.g6c6b083f.el9.x86_ 12 MB/s | 5.1 MB 00:00 2024-09-13T18:39:54.447 INFO:teuthology.orchestra.run.smithi142.stdout:(8/40): boost-program-options-1.75.0-8.el9.x86_ 146 kB/s | 107 kB 00:00 2024-09-13T18:39:54.481 INFO:teuthology.orchestra.run.smithi142.stdout:(9/40): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86_ 14 MB/s | 852 kB 00:00 2024-09-13T18:39:54.573 INFO:teuthology.orchestra.run.smithi142.stdout:(10/40): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 17 MB/s | 1.5 MB 00:00 2024-09-13T18:39:54.824 INFO:teuthology.orchestra.run.smithi142.stdout:(11/40): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 19 MB/s | 4.7 MB 00:00 2024-09-13T18:39:55.015 INFO:teuthology.orchestra.run.smithi142.stdout:(12/40): ceph-common-18.2.4-860.g6c6b083f.el9.x 20 MB/s | 18 MB 00:00 2024-09-13T18:39:55.482 INFO:teuthology.orchestra.run.smithi142.stdout:(13/40): ceph-radosgw-18.2.4-860.g6c6b083f.el9. 17 MB/s | 7.7 MB 00:00 2024-09-13T18:39:55.641 INFO:teuthology.orchestra.run.smithi142.stdout:(14/40): ceph-osd-18.2.4-860.g6c6b083f.el9.x86_ 20 MB/s | 17 MB 00:00 2024-09-13T18:39:55.657 INFO:teuthology.orchestra.run.smithi142.stdout:(15/40): ceph-selinux-18.2.4-860.g6c6b083f.el9. 144 kB/s | 25 kB 00:00 2024-09-13T18:39:55.699 INFO:teuthology.orchestra.run.smithi142.stdout:(16/40): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 1.7 MB/s | 2.1 MB 00:01 2024-09-13T18:39:55.725 INFO:teuthology.orchestra.run.smithi142.stdout:(17/40): libcephfs-devel-18.2.4-860.g6c6b083f.e 463 kB/s | 31 kB 00:00 2024-09-13T18:39:55.783 INFO:teuthology.orchestra.run.smithi142.stdout:(18/40): libcephsqlite-18.2.4-860.g6c6b083f.el9 2.8 MB/s | 166 kB 00:00 2024-09-13T18:39:55.850 INFO:teuthology.orchestra.run.smithi142.stdout:(19/40): librados-devel-18.2.4-860.g6c6b083f.el 1.9 MB/s | 127 kB 00:00 2024-09-13T18:39:55.917 INFO:teuthology.orchestra.run.smithi142.stdout:(20/40): libcephfs2-18.2.4-860.g6c6b083f.el9.x8 3.2 MB/s | 712 kB 00:00 2024-09-13T18:39:56.067 INFO:teuthology.orchestra.run.smithi142.stdout:(21/40): librados2-18.2.4-860.g6c6b083f.el9.x86 15 MB/s | 3.3 MB 00:00 2024-09-13T18:39:56.093 INFO:teuthology.orchestra.run.smithi142.stdout:(22/40): libradosstriper1-18.2.4-860.g6c6b083f. 2.7 MB/s | 478 kB 00:00 2024-09-13T18:39:56.243 INFO:teuthology.orchestra.run.smithi142.stdout:(23/40): librbd1-18.2.4-860.g6c6b083f.el9.x86_6 17 MB/s | 3.0 MB 00:00 2024-09-13T18:39:56.302 INFO:teuthology.orchestra.run.smithi142.stdout:(24/40): python3-ceph-argparse-18.2.4-860.g6c6b 774 kB/s | 45 kB 00:00 2024-09-13T18:39:56.368 INFO:teuthology.orchestra.run.smithi142.stdout:(25/40): python3-ceph-common-18.2.4-860.g6c6b08 1.9 MB/s | 129 kB 00:00 2024-09-13T18:39:56.435 INFO:teuthology.orchestra.run.smithi142.stdout:(26/40): python3-cephfs-18.2.4-860.g6c6b083f.el 2.4 MB/s | 162 kB 00:00 2024-09-13T18:39:56.511 INFO:teuthology.orchestra.run.smithi142.stdout:(27/40): python3-rados-18.2.4-860.g6c6b083f.el9 4.2 MB/s | 321 kB 00:00 2024-09-13T18:39:56.586 INFO:teuthology.orchestra.run.smithi142.stdout:(28/40): python3-rbd-18.2.4-860.g6c6b083f.el9.x 3.9 MB/s | 301 kB 00:00 2024-09-13T18:39:56.653 INFO:teuthology.orchestra.run.smithi142.stdout:(29/40): python3-rgw-18.2.4-860.g6c6b083f.el9.x 1.5 MB/s | 99 kB 00:00 2024-09-13T18:39:56.703 INFO:teuthology.orchestra.run.smithi142.stdout:(30/40): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86_ 1.7 MB/s | 87 kB 00:00 2024-09-13T18:39:56.770 INFO:teuthology.orchestra.run.smithi142.stdout:(31/40): librgw2-18.2.4-860.g6c6b083f.el9.x86_6 6.6 MB/s | 4.5 MB 00:00 2024-09-13T18:39:57.121 INFO:teuthology.orchestra.run.smithi142.stdout:(32/40): ceph-test-18.2.4-860.g6c6b083f.el9.x86 27 MB/s | 40 MB 00:01 2024-09-13T18:39:57.137 INFO:teuthology.orchestra.run.smithi142.stdout:(33/40): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_6 469 kB/s | 172 kB 00:00 2024-09-13T18:39:57.163 INFO:teuthology.orchestra.run.smithi142.stdout:(34/40): ceph-grafana-dashboards-18.2.4-860.g6c 588 kB/s | 24 kB 00:00 2024-09-13T18:39:57.222 INFO:teuthology.orchestra.run.smithi142.stdout:(35/40): rbd-mirror-18.2.4-860.g6c6b083f.el9.x8 5.8 MB/s | 3.0 MB 00:00 2024-09-13T18:39:57.289 INFO:teuthology.orchestra.run.smithi142.stdout:(36/40): ceph-mgr-modules-core-18.2.4-860.g6c6b 3.6 MB/s | 246 kB 00:00 2024-09-13T18:39:57.355 INFO:teuthology.orchestra.run.smithi142.stdout:(37/40): ceph-mgr-rook-18.2.4-860.g6c6b083f.el9 740 kB/s | 49 kB 00:00 2024-09-13T18:39:57.464 INFO:teuthology.orchestra.run.smithi142.stdout:(38/40): ceph-mgr-diskprediction-local-18.2.4-8 25 MB/s | 7.4 MB 00:00 2024-09-13T18:39:57.489 INFO:teuthology.orchestra.run.smithi142.stdout:(39/40): ceph-prometheus-alerts-18.2.4-860.g6c6 123 kB/s | 16 kB 00:00 2024-09-13T18:39:57.547 INFO:teuthology.orchestra.run.smithi142.stdout:(40/40): ceph-mgr-dashboard-18.2.4-860.g6c6b083 8.6 MB/s | 3.5 MB 00:00 2024-09-13T18:39:57.552 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:39:57.553 INFO:teuthology.orchestra.run.smithi142.stdout:Total 30 MB/s | 130 MB 00:04 2024-09-13T18:39:57.566 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T18:39:57.634 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T18:39:57.634 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T18:39:58.535 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T18:39:58.535 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T18:40:01.498 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T18:40:01.599 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 1/74 2024-09-13T18:40:01.941 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 1/74 2024-09-13T18:40:02.016 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2/74 2024-09-13T18:40:02.119 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2/74 2024-09-13T18:40:02.168 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 3/74 2024-09-13T18:40:02.259 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 3/74 2024-09-13T18:40:02.316 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 4/74 2024-09-13T18:40:02.352 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 5/74 2024-09-13T18:40:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 5/74 2024-09-13T18:40:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 6/74 2024-09-13T18:40:02.579 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 6/74 2024-09-13T18:40:02.632 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x 7/74 2024-09-13T18:40:02.718 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 8/74 2024-09-13T18:40:02.769 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/74 2024-09-13T18:40:02.809 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 10/74 2024-09-13T18:40:02.837 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9. 11/74 2024-09-13T18:40:02.929 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9 12/74 2024-09-13T18:40:02.963 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86 13/74 2024-09-13T18:40:03.071 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-20.el9.x86_64 14/74 2024-09-13T18:40:03.103 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 15/74 2024-09-13T18:40:03.130 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/74 2024-09-13T18:40:03.171 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/74 2024-09-13T18:40:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 18/74 2024-09-13T18:40:03.695 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 19/74 2024-09-13T18:40:03.736 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 20/74 2024-09-13T18:40:03.816 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 20/74 2024-09-13T18:40:03.863 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 21/74 2024-09-13T18:40:06.054 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 22/74 2024-09-13T18:40:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 22/74 2024-09-13T18:40:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 22/74 2024-09-13T18:40:06.910 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 23/74 2024-09-13T18:40:06.983 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 23/74 2024-09-13T18:40:07.020 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 24/74 2024-09-13T18:40:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 24/74 2024-09-13T18:40:16.587 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noar 25/74 2024-09-13T18:40:17.818 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noar 25/74 2024-09-13T18:40:18.020 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b08 26/74 2024-09-13T18:40:18.138 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b08 26/74 2024-09-13T18:40:18.351 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.n 27/74 2024-09-13T18:40:18.406 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 28/74 2024-09-13T18:40:18.435 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 28/74 2024-09-13T18:40:18.490 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 29/74 2024-09-13T18:40:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 29/74 2024-09-13T18:40:18.749 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 30/74 2024-09-13T18:40:19.236 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 30/74 2024-09-13T18:40:19.316 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 31/74 2024-09-13T18:40:20.997 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 31/74 2024-09-13T18:40:21.067 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 32/74 2024-09-13T18:40:21.079 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 32/74 2024-09-13T18:40:21.982 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 33/74 2024-09-13T18:40:22.027 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 34/74 2024-09-13T18:40:22.364 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 34/74 2024-09-13T18:40:22.410 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 35/74 2024-09-13T18:40:26.957 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 35/74 2024-09-13T18:40:27.420 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 36/74 2024-09-13T18:40:27.456 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 37/74 2024-09-13T18:40:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 38/74 2024-09-13T18:40:27.622 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 39/74 2024-09-13T18:40:27.676 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 40/74 2024-09-13T18:40:27.706 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 41/74 2024-09-13T18:40:27.737 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 42/74 2024-09-13T18:40:27.738 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 43/74 2024-09-13T18:40:27.780 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 43/74 2024-09-13T18:40:27.785 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 44/74 2024-09-13T18:40:27.785 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 44/74 2024-09-13T18:40:27.813 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 44/74 2024-09-13T18:40:27.847 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9. 45/74 2024-09-13T18:40:27.854 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 46/74 2024-09-13T18:40:27.854 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 46/74 2024-09-13T18:40:27.940 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 46/74 2024-09-13T18:40:27.965 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 47/74 2024-09-13T18:40:27.990 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 48/74 2024-09-13T18:40:27.995 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 49/74 2024-09-13T18:40:27.996 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 49/74 2024-09-13T18:40:28.032 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 49/74 2024-09-13T18:40:28.069 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 50/74 2024-09-13T18:40:28.070 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noa 51/74 2024-09-13T18:40:28.109 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noa 51/74 2024-09-13T18:40:28.109 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 52/74 2024-09-13T18:40:28.193 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 52/74 2024-09-13T18:40:28.221 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 53/74 2024-09-13T18:40:28.223 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 54/74 2024-09-13T18:40:28.223 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 54/74 2024-09-13T18:40:28.252 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 54/74 2024-09-13T18:40:28.257 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 55/74 2024-09-13T18:40:28.257 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 55/74 2024-09-13T18:40:28.285 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 55/74 2024-09-13T18:40:28.290 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 56/74 2024-09-13T18:40:28.290 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 56/74 2024-09-13T18:40:28.336 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 56/74 2024-09-13T18:40:28.336 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 57/74 2024-09-13T18:40:28.369 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 57/74 2024-09-13T18:40:28.376 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 58/74 2024-09-13T18:40:28.376 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 58/74 2024-09-13T18:40:28.473 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 58/74 2024-09-13T18:40:28.473 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 59/74 2024-09-13T18:40:28.506 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 59/74 2024-09-13T18:40:28.506 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 60/74 2024-09-13T18:40:28.582 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 60/74 2024-09-13T18:40:28.607 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 61/74 2024-09-13T18:40:28.633 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 62/74 2024-09-13T18:40:28.633 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 63/74 2024-09-13T18:40:28.717 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 63/74 2024-09-13T18:40:28.742 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 64/74 2024-09-13T18:40:28.742 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 65/74 2024-09-13T18:40:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 65/74 2024-09-13T18:40:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 66/74 2024-09-13T18:40:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 67/74 2024-09-13T18:40:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 67/74 2024-09-13T18:40:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 68/74 2024-09-13T18:40:28.994 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9. 69/74 2024-09-13T18:40:29.020 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x8 70/74 2024-09-13T18:40:29.045 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el 71/74 2024-09-13T18:40:29.070 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9 72/74 2024-09-13T18:40:29.071 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 73/74 2024-09-13T18:40:29.096 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 73/74 2024-09-13T18:40:29.096 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 74/74 2024-09-13T18:40:30.692 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 74/74 2024-09-13T18:40:30.693 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 1/74 2024-09-13T18:40:30.693 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 2/74 2024-09-13T18:40:30.693 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 3/74 2024-09-13T18:40:30.693 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 4/74 2024-09-13T18:40:30.693 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 5/74 2024-09-13T18:40:30.693 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-20.el9.x86_64 6/74 2024-09-13T18:40:30.693 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 7/74 2024-09-13T18:40:30.693 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 8/74 2024-09-13T18:40:30.693 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 9/74 2024-09-13T18:40:30.693 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 10/74 2024-09-13T18:40:30.694 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 11/74 2024-09-13T18:40:30.694 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 12/74 2024-09-13T18:40:30.694 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 13/74 2024-09-13T18:40:30.694 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 14/74 2024-09-13T18:40:30.694 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 15/74 2024-09-13T18:40:30.694 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 16/74 2024-09-13T18:40:30.694 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 17/74 2024-09-13T18:40:30.694 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 18/74 2024-09-13T18:40:30.694 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 19/74 2024-09-13T18:40:30.694 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 20/74 2024-09-13T18:40:30.694 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 21/74 2024-09-13T18:40:30.694 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 22/74 2024-09-13T18:40:30.694 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 23/74 2024-09-13T18:40:30.695 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 24/74 2024-09-13T18:40:30.695 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 25/74 2024-09-13T18:40:30.695 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 26/74 2024-09-13T18:40:30.695 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 27/74 2024-09-13T18:40:30.695 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 28/74 2024-09-13T18:40:30.695 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 29/74 2024-09-13T18:40:30.695 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 30/74 2024-09-13T18:40:30.695 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 31/74 2024-09-13T18:40:30.695 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 32/74 2024-09-13T18:40:30.695 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 33/74 2024-09-13T18:40:30.695 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 34/74 2024-09-13T18:40:30.695 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/74 2024-09-13T18:40:30.695 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 36/74 2024-09-13T18:40:30.696 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 37/74 2024-09-13T18:40:30.696 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 38/74 2024-09-13T18:40:30.696 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 39/74 2024-09-13T18:40:30.696 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 40/74 2024-09-13T18:40:30.697 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 41/74 2024-09-13T18:40:30.697 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 42/74 2024-09-13T18:40:30.697 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 43/74 2024-09-13T18:40:30.697 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 44/74 2024-09-13T18:40:30.697 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x 45/74 2024-09-13T18:40:30.697 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9. 46/74 2024-09-13T18:40:30.697 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86 47/74 2024-09-13T18:40:30.697 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x8 48/74 2024-09-13T18:40:30.697 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 49/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 50/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 51/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 52/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 53/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 54/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 55/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 56/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 57/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 58/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 59/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 60/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 61/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 62/74 2024-09-13T18:40:30.698 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9 63/74 2024-09-13T18:40:30.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el 64/74 2024-09-13T18:40:30.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noar 65/74 2024-09-13T18:40:30.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noa 66/74 2024-09-13T18:40:30.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b08 67/74 2024-09-13T18:40:30.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 68/74 2024-09-13T18:40:30.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.n 69/74 2024-09-13T18:40:30.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9. 70/74 2024-09-13T18:40:30.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 71/74 2024-09-13T18:40:30.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 72/74 2024-09-13T18:40:30.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9. 73/74 2024-09-13T18:40:31.875 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9 74/74 2024-09-13T18:40:31.876 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:40:31.876 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-09-13T18:40:31.876 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.876 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.876 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.876 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.876 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:40:31.876 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.876 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.876 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:40:31.876 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:40:31.876 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:40:31.876 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.877 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.878 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.878 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.878 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.878 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.878 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.878 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.878 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.878 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.878 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:40:31.878 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T18:40:31.878 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 fmt-8.1.1-5.el9.x86_64 2024-09-13T18:40:31.878 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-11.el9.x86_64 libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:40:31.878 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-11.el9.x86_64 re2-1:20211101-20.el9.x86_64 2024-09-13T18:40:31.879 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T18:40:31.879 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T18:40:32.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:40:32.502 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:40:32.525 INFO:teuthology.orchestra.run.smithi142.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T18:40:32.525 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T18:40:32.525 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T18:40:32.528 INFO:teuthology.run_tasks:Running task print... 2024-09-13T18:40:32.537 INFO:teuthology.task.print:**** done install.upgrade on client.0 2024-09-13T18:40:32.537 INFO:teuthology.run_tasks:Running task ceph.healthy... 2024-09-13T18:40:32.547 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:40:32.547 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:40:32.547 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T18:40:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.650+0000 7fe96d500640 1 Processor -- start 2024-09-13T18:40:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.650+0000 7fe96d500640 1 -- start start 2024-09-13T18:40:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.650+0000 7fe96d500640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe968097690 0x7fe968131350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.650+0000 7fe96d500640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe9680969d0 0x7fe9681338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.650+0000 7fe96d500640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96806a190 con 0x7fe96809dfb0 2024-09-13T18:40:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.650+0000 7fe96d500640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96809e380 con 0x7fe9680969d0 2024-09-13T18:40:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.650+0000 7fe96d500640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe968098870 con 0x7fe968097690 2024-09-13T18:40:32.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.651+0000 7fe966ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe96809dfb0 0x7fe968096f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54404/0 (socket says 172.21.15.97:54404) 2024-09-13T18:40:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.651+0000 7fe966ffd640 1 -- 172.21.15.97:0/3824827415 learned_addr learned my addr 172.21.15.97:0/3824827415 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:40:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.651+0000 7fe9677fe640 1 --2- 172.21.15.97:0/3824827415 >> v2:172.21.15.97:3300/0 conn(0x7fe9680969d0 0x7fe9681338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.651+0000 7fe9667fc640 1 --2- 172.21.15.97:0/3824827415 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe968097690 0x7fe968131350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.651+0000 7fe9677fe640 1 -- 172.21.15.97:0/3824827415 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe968097690 msgr2=0x7fe968131350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.651+0000 7fe9677fe640 1 --2- 172.21.15.97:0/3824827415 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe968097690 0x7fe968131350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.651+0000 7fe9677fe640 1 -- 172.21.15.97:0/3824827415 >> v1:172.21.15.97:6789/0 conn(0x7fe96809dfb0 legacy=0x7fe968096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.651+0000 7fe9677fe640 1 -- 172.21.15.97:0/3824827415 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe968098e10 con 0x7fe9680969d0 2024-09-13T18:40:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.651+0000 7fe9667fc640 1 --2- 172.21.15.97:0/3824827415 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe968097690 0x7fe968131350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:32.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.652+0000 7fe9677fe640 1 --2- 172.21.15.97:0/3824827415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9680969d0 0x7fe9681338a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe960009e60 tx=0x7fe960009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ecf5e7e257336b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:32.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.652+0000 7fe965ffb640 1 -- 172.21.15.97:0/3824827415 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960007550 con 0x7fe9680969d0 2024-09-13T18:40:32.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.652+0000 7fe965ffb640 1 -- 172.21.15.97:0/3824827415 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96002d050 con 0x7fe9680969d0 2024-09-13T18:40:32.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.652+0000 7fe965ffb640 1 -- 172.21.15.97:0/3824827415 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960007920 con 0x7fe9680969d0 2024-09-13T18:40:32.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.652+0000 7fe96d500640 1 -- 172.21.15.97:0/3824827415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9680969d0 msgr2=0x7fe9681338a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:32.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.652+0000 7fe96d500640 1 --2- 172.21.15.97:0/3824827415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9680969d0 0x7fe9681338a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe960009e60 tx=0x7fe960009780 comp rx=0 tx=0).stop 2024-09-13T18:40:32.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.652+0000 7fe96d500640 1 -- 172.21.15.97:0/3824827415 shutdown_connections 2024-09-13T18:40:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.652+0000 7fe96d500640 1 --2- 172.21.15.97:0/3824827415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9680969d0 0x7fe9681338a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.652+0000 7fe96d500640 1 --2- 172.21.15.97:0/3824827415 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe968097690 0x7fe968131350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.652+0000 7fe96d500640 1 -- 172.21.15.97:0/3824827415 >> 172.21.15.97:0/3824827415 conn(0x7fe96809b200 msgr2=0x7fe96809b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.652+0000 7fe96d500640 1 -- 172.21.15.97:0/3824827415 shutdown_connections 2024-09-13T18:40:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.652+0000 7fe96d500640 1 -- 172.21.15.97:0/3824827415 wait complete. 2024-09-13T18:40:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.653+0000 7fe96d500640 1 Processor -- start 2024-09-13T18:40:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.653+0000 7fe96d500640 1 -- start start 2024-09-13T18:40:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe96d500640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe9680969d0 0x7fe96812c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe96d500640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe968097690 0x7fe96806a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe96d500640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe96809dfb0 0x7fe96806a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe96d500640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96811b0f0 con 0x7fe968097690 2024-09-13T18:40:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe96d500640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96806bf90 con 0x7fe96809dfb0 2024-09-13T18:40:32.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe96d500640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe96806e3c0 con 0x7fe9680969d0 2024-09-13T18:40:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe966ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe9680969d0 0x7fe96812c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe9667fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe968097690 0x7fe96806a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe966ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe9680969d0 0x7fe96812c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47084/0 (socket says 172.21.15.97:47084) 2024-09-13T18:40:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe966ffd640 1 -- 172.21.15.97:0/2066381376 learned_addr learned my addr 172.21.15.97:0/2066381376 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe9677fe640 1 --2- 172.21.15.97:0/2066381376 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe96809dfb0 0x7fe96806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe966ffd640 1 -- 172.21.15.97:0/2066381376 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe96809dfb0 msgr2=0x7fe96806a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe966ffd640 1 --2- 172.21.15.97:0/2066381376 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe96809dfb0 0x7fe96806a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe966ffd640 1 -- 172.21.15.97:0/2066381376 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe968097690 msgr2=0x7fe96806a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe966ffd640 1 --2- 172.21.15.97:0/2066381376 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe968097690 0x7fe96806a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe966ffd640 1 -- 172.21.15.97:0/2066381376 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c009390 con 0x7fe9680969d0 2024-09-13T18:40:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe9667fc640 1 --2- 172.21.15.97:0/2066381376 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe968097690 0x7fe96806a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.654+0000 7fe966ffd640 1 --2- 172.21.15.97:0/2066381376 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe9680969d0 0x7fe96812c660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe95800c590 tx=0x7fe958007ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:32.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.655+0000 7fe94effd640 1 -- 172.21.15.97:0/2066381376 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe958005aa0 con 0x7fe9680969d0 2024-09-13T18:40:32.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.655+0000 7fe94effd640 1 -- 172.21.15.97:0/2066381376 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe958005c20 con 0x7fe9680969d0 2024-09-13T18:40:32.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.655+0000 7fe96d500640 1 -- 172.21.15.97:0/2066381376 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe960009a20 con 0x7fe9680969d0 2024-09-13T18:40:32.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.655+0000 7fe94effd640 1 -- 172.21.15.97:0/2066381376 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9580070f0 con 0x7fe9680969d0 2024-09-13T18:40:32.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.655+0000 7fe96d500640 1 -- 172.21.15.97:0/2066381376 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe968119bd0 con 0x7fe9680969d0 2024-09-13T18:40:32.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.655+0000 7fe94effd640 1 -- 172.21.15.97:0/2066381376 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fe958007540 con 0x7fe9680969d0 2024-09-13T18:40:32.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.656+0000 7fe96d500640 1 -- 172.21.15.97:0/2066381376 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe968064000 con 0x7fe9680969d0 2024-09-13T18:40:32.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.656+0000 7fe94effd640 1 -- 172.21.15.97:0/2066381376 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fe9580415f0 con 0x7fe9680969d0 2024-09-13T18:40:32.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.660+0000 7fe94effd640 1 -- 172.21.15.97:0/2066381376 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fe958018030 con 0x7fe9680969d0 2024-09-13T18:40:32.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.852+0000 7fe96d500640 1 -- 172.21.15.97:0/2066381376 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe9680676d0 con 0x7fe9680969d0 2024-09-13T18:40:32.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.854+0000 7fe94effd640 1 -- 172.21.15.97:0/2066381376 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+73552 (secure 0 0 0) 0x7fe958018020 con 0x7fe9680969d0 2024-09-13T18:40:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:40:32.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.856+0000 7fe96d500640 1 -- 172.21.15.97:0/2066381376 >> v1:172.21.15.97:6816/34603 conn(0x7fe9540311b0 legacy=0x7fe954033660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:32.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.856+0000 7fe96d500640 1 -- 172.21.15.97:0/2066381376 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe9680969d0 msgr2=0x7fe96812c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:32.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.856+0000 7fe96d500640 1 --2- 172.21.15.97:0/2066381376 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe9680969d0 0x7fe96812c660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe95800c590 tx=0x7fe958007ee0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.856+0000 7fe96d500640 1 -- 172.21.15.97:0/2066381376 shutdown_connections 2024-09-13T18:40:32.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.856+0000 7fe96d500640 1 --2- 172.21.15.97:0/2066381376 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe96809dfb0 0x7fe96806a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.856+0000 7fe96d500640 1 --2- 172.21.15.97:0/2066381376 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe968097690 0x7fe96806a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.856+0000 7fe96d500640 1 --2- 172.21.15.97:0/2066381376 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe9680969d0 0x7fe96812c660 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.856+0000 7fe96d500640 1 -- 172.21.15.97:0/2066381376 >> 172.21.15.97:0/2066381376 conn(0x7fe96809b200 msgr2=0x7fe96809cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:32.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.856+0000 7fe96d500640 1 -- 172.21.15.97:0/2066381376 shutdown_connections 2024-09-13T18:40:32.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.856+0000 7fe96d500640 1 -- 172.21.15.97:0/2066381376 wait complete. 2024-09-13T18:40:32.870 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6816","nonce":34603}]},"active_addr":"172.21.15.97:6816/34603","active_change":"2024-09-13T18:38:53.339366+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":1159338426}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":1371460631}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":670133140}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":3762677274}]}]} 2024-09-13T18:40:32.872 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T18:40:32.872 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T18:40:32.872 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:40:32.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd370434640 1 Processor -- start 2024-09-13T18:40:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd370434640 1 -- start start 2024-09-13T18:40:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd370434640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd36806b2a0 0x7fd368099a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd370434640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd36809adb0 0x7fd368099f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd370434640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36812d360 0x7fd36812d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd370434640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36806f060 con 0x7fd36806b2a0 2024-09-13T18:40:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd370434640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36809ab70 con 0x7fd36812d360 2024-09-13T18:40:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd370434640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd36806ae80 con 0x7fd36809adb0 2024-09-13T18:40:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd36d9cf640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd36809adb0 0x7fd368099f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd36e9d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36812d360 0x7fd36812d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd36e1d0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd36806b2a0 0x7fd368099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:32.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd36e9d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36812d360 0x7fd36812d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:52170/0 (socket says 172.21.15.97:52170) 2024-09-13T18:40:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd36e1d0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd36806b2a0 0x7fd368099a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36288/0 (socket says 172.21.15.97:36288) 2024-09-13T18:40:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd36e9d1640 1 -- 172.21.15.97:0/1349755170 learned_addr learned my addr 172.21.15.97:0/1349755170 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.963+0000 7fd36d9cf640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd36809adb0 0x7fd368099f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47088/0 (socket says 172.21.15.97:47088) 2024-09-13T18:40:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.964+0000 7fd36e9d1640 1 -- 172.21.15.97:0/1349755170 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd36809adb0 msgr2=0x7fd368099f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.964+0000 7fd36e9d1640 1 --2- 172.21.15.97:0/1349755170 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd36809adb0 0x7fd368099f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.964+0000 7fd36e9d1640 1 -- 172.21.15.97:0/1349755170 >> v2:172.21.15.97:3300/0 conn(0x7fd36806b2a0 msgr2=0x7fd368099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.964+0000 7fd36e9d1640 1 --2- 172.21.15.97:0/1349755170 >> v2:172.21.15.97:3300/0 conn(0x7fd36806b2a0 0x7fd368099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.964+0000 7fd36e9d1640 1 -- 172.21.15.97:0/1349755170 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36806aaa0 con 0x7fd36812d360 2024-09-13T18:40:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.964+0000 7fd36d9cf640 1 --2- 172.21.15.97:0/1349755170 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd36809adb0 0x7fd368099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.964+0000 7fd36e1d0640 1 --2- 172.21.15.97:0/1349755170 >> v2:172.21.15.97:3300/0 conn(0x7fd36806b2a0 0x7fd368099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.964+0000 7fd36e9d1640 1 --2- 172.21.15.97:0/1349755170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36812d360 0x7fd36812d7e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd360009f50 tx=0x7fd360009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48301d0f7cc8a5a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.965+0000 7fd36d1ce640 1 -- 172.21.15.97:0/1349755170 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360031400 con 0x7fd36812d360 2024-09-13T18:40:32.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.965+0000 7fd36d1ce640 1 -- 172.21.15.97:0/1349755170 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36002d050 con 0x7fd36812d360 2024-09-13T18:40:32.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.965+0000 7fd36d1ce640 1 -- 172.21.15.97:0/1349755170 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3600317d0 con 0x7fd36812d360 2024-09-13T18:40:32.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.965+0000 7fd370434640 1 -- 172.21.15.97:0/1349755170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36812d360 msgr2=0x7fd36812d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:32.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.965+0000 7fd370434640 1 --2- 172.21.15.97:0/1349755170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36812d360 0x7fd36812d7e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd360009f50 tx=0x7fd360009840 comp rx=0 tx=0).stop 2024-09-13T18:40:32.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.965+0000 7fd370434640 1 -- 172.21.15.97:0/1349755170 shutdown_connections 2024-09-13T18:40:32.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.965+0000 7fd370434640 1 --2- 172.21.15.97:0/1349755170 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36812d360 0x7fd36812d7e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.965+0000 7fd370434640 1 --2- 172.21.15.97:0/1349755170 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd36809adb0 0x7fd368099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.965+0000 7fd370434640 1 --2- 172.21.15.97:0/1349755170 >> v2:172.21.15.97:3300/0 conn(0x7fd36806b2a0 0x7fd368099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.965+0000 7fd370434640 1 -- 172.21.15.97:0/1349755170 >> 172.21.15.97:0/1349755170 conn(0x7fd36809e890 msgr2=0x7fd36809ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:32.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.965+0000 7fd370434640 1 -- 172.21.15.97:0/1349755170 shutdown_connections 2024-09-13T18:40:32.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.965+0000 7fd370434640 1 -- 172.21.15.97:0/1349755170 wait complete. 2024-09-13T18:40:32.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd370434640 1 Processor -- start 2024-09-13T18:40:32.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd370434640 1 -- start start 2024-09-13T18:40:32.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd370434640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36806b2a0 0x7fd36813a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:32.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd370434640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd36809adb0 0x7fd36813aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd370434640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd36812d360 0x7fd368119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd370434640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36811a810 con 0x7fd36809adb0 2024-09-13T18:40:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd370434640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36811ae60 con 0x7fd36806b2a0 2024-09-13T18:40:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd370434640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd368096b60 con 0x7fd36812d360 2024-09-13T18:40:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd36d9cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd36809adb0 0x7fd36813aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd36e1d0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36806b2a0 0x7fd36813a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd36d9cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd36809adb0 0x7fd36813aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36302/0 (socket says 172.21.15.97:36302) 2024-09-13T18:40:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd36e9d1640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd36812d360 0x7fd368119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd36e1d0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36806b2a0 0x7fd36813a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:52176/0 (socket says 172.21.15.97:52176) 2024-09-13T18:40:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.966+0000 7fd36d9cf640 1 -- 172.21.15.97:0/3438231291 learned_addr learned my addr 172.21.15.97:0/3438231291 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.967+0000 7fd36e1d0640 1 -- 172.21.15.97:0/3438231291 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd36812d360 msgr2=0x7fd368119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.967+0000 7fd36e1d0640 1 --2- 172.21.15.97:0/3438231291 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd36812d360 0x7fd368119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.967+0000 7fd36e1d0640 1 -- 172.21.15.97:0/3438231291 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd36809adb0 msgr2=0x7fd36813aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:32.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.967+0000 7fd36e1d0640 1 --2- 172.21.15.97:0/3438231291 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd36809adb0 0x7fd36813aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:32.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.967+0000 7fd36e1d0640 1 -- 172.21.15.97:0/3438231291 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd358009390 con 0x7fd36806b2a0 2024-09-13T18:40:32.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.967+0000 7fd36d9cf640 1 --2- 172.21.15.97:0/3438231291 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd36809adb0 0x7fd36813aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:32.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.967+0000 7fd36e1d0640 1 --2- 172.21.15.97:0/3438231291 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36806b2a0 0x7fd36813a580 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd35800ea80 tx=0x7fd3580090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:32.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.967+0000 7fd35e7fc640 1 -- 172.21.15.97:0/3438231291 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358009670 con 0x7fd36806b2a0 2024-09-13T18:40:32.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.967+0000 7fd35e7fc640 1 -- 172.21.15.97:0/3438231291 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35800ca10 con 0x7fd36806b2a0 2024-09-13T18:40:32.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.967+0000 7fd370434640 1 -- 172.21.15.97:0/3438231291 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36400d830 con 0x7fd36806b2a0 2024-09-13T18:40:32.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.967+0000 7fd35e7fc640 1 -- 172.21.15.97:0/3438231291 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800cdb0 con 0x7fd36806b2a0 2024-09-13T18:40:32.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.967+0000 7fd370434640 1 -- 172.21.15.97:0/3438231291 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd360009ae0 con 0x7fd36806b2a0 2024-09-13T18:40:32.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.968+0000 7fd35e7fc640 1 -- 172.21.15.97:0/3438231291 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fd358013680 con 0x7fd36806b2a0 2024-09-13T18:40:32.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.968+0000 7fd370434640 1 -- 172.21.15.97:0/3438231291 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd368071440 con 0x7fd36806b2a0 2024-09-13T18:40:32.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.968+0000 7fd35e7fc640 1 -- 172.21.15.97:0/3438231291 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fd3580423c0 con 0x7fd36806b2a0 2024-09-13T18:40:32.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:32.972+0000 7fd35e7fc640 1 -- 172.21.15.97:0/3438231291 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fd3580123d0 con 0x7fd36806b2a0 2024-09-13T18:40:33.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.123+0000 7fd370434640 1 -- 172.21.15.97:0/3438231291 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd368064a00 con 0x7fd36806b2a0 2024-09-13T18:40:33.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.124+0000 7fd35e7fc640 1 -- 172.21.15.97:0/3438231291 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+11626 (secure 0 0 0) 0x7fd3580232f0 con 0x7fd36806b2a0 2024-09-13T18:40:33.127 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:40:33.127 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":23,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:54.652125+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.8","mappings":[{"from":1,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:33.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.126+0000 7fd370434640 1 -- 172.21.15.97:0/3438231291 >> v1:172.21.15.97:6816/34603 conn(0x7fd34c031160 legacy=0x7fd34c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.126+0000 7fd370434640 1 -- 172.21.15.97:0/3438231291 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36806b2a0 msgr2=0x7fd36813a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.126+0000 7fd370434640 1 --2- 172.21.15.97:0/3438231291 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36806b2a0 0x7fd36813a580 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd35800ea80 tx=0x7fd3580090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.126+0000 7fd370434640 1 -- 172.21.15.97:0/3438231291 shutdown_connections 2024-09-13T18:40:33.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.126+0000 7fd370434640 1 --2- 172.21.15.97:0/3438231291 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd36812d360 0x7fd368119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.126+0000 7fd370434640 1 --2- 172.21.15.97:0/3438231291 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd36809adb0 0x7fd36813aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.126+0000 7fd370434640 1 --2- 172.21.15.97:0/3438231291 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd36806b2a0 0x7fd36813a580 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.126+0000 7fd370434640 1 -- 172.21.15.97:0/3438231291 >> 172.21.15.97:0/3438231291 conn(0x7fd36809e890 msgr2=0x7fd36806d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.126+0000 7fd370434640 1 -- 172.21.15.97:0/3438231291 shutdown_connections 2024-09-13T18:40:33.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.126+0000 7fd370434640 1 -- 172.21.15.97:0/3438231291 wait complete. 2024-09-13T18:40:33.139 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T18:40:33.139 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:40:33.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.230+0000 7fcb9a0af640 1 Processor -- start 2024-09-13T18:40:33.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.230+0000 7fcb9a0af640 1 -- start start 2024-09-13T18:40:33.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.230+0000 7fcb9a0af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb9409dfb0 0x7fcb94096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.230+0000 7fcb9a0af640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcb940974c0 0x7fcb9412c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.230+0000 7fcb9a0af640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9406a190 con 0x7fcb940969d0 2024-09-13T18:40:33.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.230+0000 7fcb9a0af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9409e380 con 0x7fcb9409dfb0 2024-09-13T18:40:33.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.230+0000 7fcb9a0af640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94098870 con 0x7fcb940974c0 2024-09-13T18:40:33.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.230+0000 7fcb937fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb9409dfb0 0x7fcb94096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.230+0000 7fcb92ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fcb940969d0 0x7fcb9412bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54416/0 (socket says 172.21.15.97:54416) 2024-09-13T18:40:33.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.230+0000 7fcb92ffd640 1 -- 172.21.15.97:0/760263655 learned_addr learned my addr 172.21.15.97:0/760263655 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:40:33.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.230+0000 7fcb93fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcb940974c0 0x7fcb9412c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.231+0000 7fcb93fff640 1 -- 172.21.15.97:0/760263655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb9409dfb0 msgr2=0x7fcb94096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.231+0000 7fcb93fff640 1 --2- 172.21.15.97:0/760263655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb9409dfb0 0x7fcb94096f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.231+0000 7fcb927fc640 1 -- 172.21.15.97:0/760263655 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471847475 0 0) 0x7fcb9406a190 con 0x7fcb940969d0 2024-09-13T18:40:33.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.231+0000 7fcb93fff640 1 -- 172.21.15.97:0/760263655 >> v1:172.21.15.97:6789/0 conn(0x7fcb940969d0 legacy=0x7fcb9412bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.231+0000 7fcb93fff640 1 -- 172.21.15.97:0/760263655 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb94097960 con 0x7fcb940974c0 2024-09-13T18:40:33.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.231+0000 7fcb937fe640 1 --2- 172.21.15.97:0/760263655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb9409dfb0 0x7fcb94096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:33.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.231+0000 7fcb93fff640 1 --2- 172.21.15.97:0/760263655 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcb940974c0 0x7fcb9412c680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009ec0 tx=0x7fcb8c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a74eba9ba64dc67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.231+0000 7fcb927fc640 1 -- 172.21.15.97:0/760263655 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c007550 con 0x7fcb940974c0 2024-09-13T18:40:33.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.231+0000 7fcb927fc640 1 -- 172.21.15.97:0/760263655 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c02d050 con 0x7fcb940974c0 2024-09-13T18:40:33.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.232+0000 7fcb927fc640 1 -- 172.21.15.97:0/760263655 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c0078e0 con 0x7fcb940974c0 2024-09-13T18:40:33.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.232+0000 7fcb9a0af640 1 -- 172.21.15.97:0/760263655 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcb940974c0 msgr2=0x7fcb9412c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.232+0000 7fcb9a0af640 1 --2- 172.21.15.97:0/760263655 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcb940974c0 0x7fcb9412c680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009ec0 tx=0x7fcb8c009780 comp rx=0 tx=0).stop 2024-09-13T18:40:33.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.232+0000 7fcb9a0af640 1 -- 172.21.15.97:0/760263655 shutdown_connections 2024-09-13T18:40:33.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.232+0000 7fcb9a0af640 1 --2- 172.21.15.97:0/760263655 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcb940974c0 0x7fcb9412c680 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.232+0000 7fcb9a0af640 1 --2- 172.21.15.97:0/760263655 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb9409dfb0 0x7fcb94096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.232+0000 7fcb9a0af640 1 -- 172.21.15.97:0/760263655 >> 172.21.15.97:0/760263655 conn(0x7fcb9409b200 msgr2=0x7fcb9409b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.232+0000 7fcb9a0af640 1 -- 172.21.15.97:0/760263655 shutdown_connections 2024-09-13T18:40:33.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.232+0000 7fcb9a0af640 1 -- 172.21.15.97:0/760263655 wait complete. 2024-09-13T18:40:33.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.233+0000 7fcb9a0af640 1 Processor -- start 2024-09-13T18:40:33.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.233+0000 7fcb9a0af640 1 -- start start 2024-09-13T18:40:33.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.233+0000 7fcb9a0af640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcb940969d0 0x7fcb9409cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.233+0000 7fcb9a0af640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb940974c0 0x7fcb9411d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.233+0000 7fcb9a0af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb9409dfb0 0x7fcb9411daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.233+0000 7fcb9a0af640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9411ead0 con 0x7fcb940974c0 2024-09-13T18:40:33.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.233+0000 7fcb9a0af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9406a510 con 0x7fcb9409dfb0 2024-09-13T18:40:33.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.233+0000 7fcb9a0af640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94097e10 con 0x7fcb940969d0 2024-09-13T18:40:33.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.233+0000 7fcb937fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcb940969d0 0x7fcb9409cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.233+0000 7fcb92ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb940974c0 0x7fcb9411d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.233+0000 7fcb937fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcb940969d0 0x7fcb9409cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47126/0 (socket says 172.21.15.97:47126) 2024-09-13T18:40:33.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.233+0000 7fcb937fe640 1 -- 172.21.15.97:0/3254280245 learned_addr learned my addr 172.21.15.97:0/3254280245 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.234+0000 7fcb93fff640 1 --2- 172.21.15.97:0/3254280245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb9409dfb0 0x7fcb9411daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.234+0000 7fcb937fe640 1 -- 172.21.15.97:0/3254280245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb9409dfb0 msgr2=0x7fcb9411daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.234+0000 7fcb937fe640 1 --2- 172.21.15.97:0/3254280245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb9409dfb0 0x7fcb9411daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.234+0000 7fcb937fe640 1 -- 172.21.15.97:0/3254280245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb940974c0 msgr2=0x7fcb9411d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.234+0000 7fcb937fe640 1 --2- 172.21.15.97:0/3254280245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb940974c0 0x7fcb9411d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.234+0000 7fcb937fe640 1 -- 172.21.15.97:0/3254280245 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb84009390 con 0x7fcb940969d0 2024-09-13T18:40:33.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.234+0000 7fcb92ffd640 1 --2- 172.21.15.97:0/3254280245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb940974c0 0x7fcb9411d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:33.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.234+0000 7fcb937fe640 1 --2- 172.21.15.97:0/3254280245 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcb940969d0 0x7fcb9409cea0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400ec80 tx=0x7fcb840090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.234+0000 7fcb7b7fe640 1 -- 172.21.15.97:0/3254280245 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8400eec0 con 0x7fcb940969d0 2024-09-13T18:40:33.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.234+0000 7fcb7b7fe640 1 -- 172.21.15.97:0/3254280245 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8400cbc0 con 0x7fcb940969d0 2024-09-13T18:40:33.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.234+0000 7fcb7b7fe640 1 -- 172.21.15.97:0/3254280245 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84013470 con 0x7fcb940969d0 2024-09-13T18:40:33.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.234+0000 7fcb9a0af640 1 -- 172.21.15.97:0/3254280245 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c009a20 con 0x7fcb940969d0 2024-09-13T18:40:33.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.234+0000 7fcb9a0af640 1 -- 172.21.15.97:0/3254280245 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9412c4c0 con 0x7fcb940969d0 2024-09-13T18:40:33.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.235+0000 7fcb7b7fe640 1 -- 172.21.15.97:0/3254280245 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fcb840137e0 con 0x7fcb940969d0 2024-09-13T18:40:33.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.235+0000 7fcb7b7fe640 1 -- 172.21.15.97:0/3254280245 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fcb84042530 con 0x7fcb940969d0 2024-09-13T18:40:33.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.235+0000 7fcb9a0af640 1 -- 172.21.15.97:0/3254280245 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9411fb80 con 0x7fcb940969d0 2024-09-13T18:40:33.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.239+0000 7fcb7b7fe640 1 -- 172.21.15.97:0/3254280245 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fcb84021020 con 0x7fcb940969d0 2024-09-13T18:40:33.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.394+0000 7fcb9a0af640 1 -- 172.21.15.97:0/3254280245 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb94064000 con 0x7fcb940969d0 2024-09-13T18:40:33.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.394+0000 7fcb7b7fe640 1 -- 172.21.15.97:0/3254280245 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+11626 (secure 0 0 0) 0x7fcb84023ad0 con 0x7fcb940969d0 2024-09-13T18:40:33.397 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:40:33.397 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":23,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:54.652125+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.8","mappings":[{"from":1,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:33.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.396+0000 7fcb9a0af640 1 -- 172.21.15.97:0/3254280245 >> v1:172.21.15.97:6816/34603 conn(0x7fcb80031160 legacy=0x7fcb80033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.396+0000 7fcb9a0af640 1 -- 172.21.15.97:0/3254280245 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcb940969d0 msgr2=0x7fcb9409cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.396+0000 7fcb9a0af640 1 --2- 172.21.15.97:0/3254280245 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcb940969d0 0x7fcb9409cea0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400ec80 tx=0x7fcb840090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.396+0000 7fcb9a0af640 1 -- 172.21.15.97:0/3254280245 shutdown_connections 2024-09-13T18:40:33.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.396+0000 7fcb9a0af640 1 --2- 172.21.15.97:0/3254280245 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcb9409dfb0 0x7fcb9411daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.396+0000 7fcb9a0af640 1 --2- 172.21.15.97:0/3254280245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb940974c0 0x7fcb9411d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.396+0000 7fcb9a0af640 1 --2- 172.21.15.97:0/3254280245 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcb940969d0 0x7fcb9409cea0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.396+0000 7fcb9a0af640 1 -- 172.21.15.97:0/3254280245 >> 172.21.15.97:0/3254280245 conn(0x7fcb9409b200 msgr2=0x7fcb94114d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.396+0000 7fcb9a0af640 1 -- 172.21.15.97:0/3254280245 shutdown_connections 2024-09-13T18:40:33.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.396+0000 7fcb9a0af640 1 -- 172.21.15.97:0/3254280245 wait complete. 2024-09-13T18:40:33.410 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T18:40:33.410 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T18:40:33.410 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T18:40:33.411 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T18:40:33.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.507+0000 7f178399d640 1 Processor -- start 2024-09-13T18:40:33.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.507+0000 7f09eae6f640 1 Processor -- start 2024-09-13T18:40:33.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.507+0000 7feac620f640 1 Processor -- start 2024-09-13T18:40:33.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.507+0000 7f4e6d660640 1 Processor -- start 2024-09-13T18:40:33.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.507+0000 7f09eae6f640 1 -- start start 2024-09-13T18:40:33.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.507+0000 7feac620f640 1 -- start start 2024-09-13T18:40:33.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.507+0000 7f178399d640 1 -- start start 2024-09-13T18:40:33.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.507+0000 7f4e6d660640 1 -- start start 2024-09-13T18:40:33.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f4e6d660640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4e680a3470 0x7f4e6812f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f4e6d660640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e6812fb50 0x7f4e6812ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f09eae6f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f09e40a32b0 0x7f09e412f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f4e6d660640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6809ed70 con 0x7f4e68068970 2024-09-13T18:40:33.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f4e6d660640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e680a3840 con 0x7f4e680a3470 2024-09-13T18:40:33.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f4e6d660640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6809dbe0 con 0x7f4e6812fb50 2024-09-13T18:40:33.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f09eae6f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e412fed0 0x7f09e4068970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f09eae6f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f09e4068eb0 0x7f09e4069350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f09eae6f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e4096b70 con 0x7f09e4068eb0 2024-09-13T18:40:33.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f4e66ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4e680a3470 0x7f4e6812f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f4e66ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4e680a3470 0x7f4e6812f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36318/0 (socket says 172.21.15.97:36318) 2024-09-13T18:40:33.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f4e66ffd640 1 -- 172.21.15.97:0/4018162960 learned_addr learned my addr 172.21.15.97:0/4018162960 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7feac620f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7feac0098ab0 0x7feac009cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f4e667fc640 1 --2- 172.21.15.97:0/4018162960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e6812fb50 0x7f4e6812ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f178399d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f177c06de90 0x7f177c09c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f178399d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f177c09ce60 0x7f177c12f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f178399d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f177c09d230 0x7f177c12f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7feabf7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7feac0098ab0 0x7feac009cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7feabf7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7feac0098ab0 0x7feac009cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36332/0 (socket says 172.21.15.97:36332) 2024-09-13T18:40:33.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7feabf7fe640 1 -- 172.21.15.97:0/1519372922 learned_addr learned my addr 172.21.15.97:0/1519372922 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7feac620f640 1 --2- 172.21.15.97:0/1519372922 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feac0096e00 0x7feac009d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7feabeffd640 1 --2- 172.21.15.97:0/1519372922 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feac0096e00 0x7feac009d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f1780f38640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f177c09ce60 0x7f177c12f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f1780f38640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f177c09ce60 0x7f177c12f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36342/0 (socket says 172.21.15.97:36342) 2024-09-13T18:40:33.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f1781739640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f177c06de90 0x7f177c09c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f178399d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177c06e260 con 0x7f177c09ce60 2024-09-13T18:40:33.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f178399d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c09e4b0 con 0x7f177c09d230 2024-09-13T18:40:33.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f178399d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f177c06ebd0 con 0x7f177c06de90 2024-09-13T18:40:33.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f1780f38640 1 -- 172.21.15.97:0/1619015256 learned_addr learned my addr 172.21.15.97:0/1619015256 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f1781f3a640 1 --2- 172.21.15.97:0/1619015256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f177c09d230 0x7f177c12f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f09eae6f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40a3680 con 0x7f09e412fed0 2024-09-13T18:40:33.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f09eae6f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09e4097460 con 0x7f09e40a32b0 2024-09-13T18:40:33.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f09e8c0b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f09e40a32b0 0x7f09e412f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7feac620f640 1 -- 172.21.15.97:0/1519372922 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac0097ff0 con 0x7feac009d920 2024-09-13T18:40:33.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7feac620f640 1 -- 172.21.15.97:0/1519372922 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac0098e80 con 0x7feac0098ab0 2024-09-13T18:40:33.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7feac620f640 1 -- 172.21.15.97:0/1519372922 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac009e5a0 con 0x7feac0096e00 2024-09-13T18:40:33.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f09e8c0b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f09e40a32b0 0x7f09e412f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47128/0 (socket says 172.21.15.97:47128) 2024-09-13T18:40:33.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f09e8c0b640 1 -- 172.21.15.97:0/939788733 learned_addr learned my addr 172.21.15.97:0/939788733 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f09e3fff640 1 --2- 172.21.15.97:0/939788733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e412fed0 0x7f09e4068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f4e66ffd640 1 -- 172.21.15.97:0/4018162960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e6812fb50 msgr2=0x7f4e6812ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f4e66ffd640 1 --2- 172.21.15.97:0/4018162960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e6812fb50 0x7f4e6812ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f4e66ffd640 1 -- 172.21.15.97:0/4018162960 >> v1:172.21.15.97:6789/0 conn(0x7f4e68068970 legacy=0x7f4e68068dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f09e8c0b640 1 -- 172.21.15.97:0/939788733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e412fed0 msgr2=0x7f09e4068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f4e66ffd640 1 -- 172.21.15.97:0/4018162960 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6809de20 con 0x7f4e680a3470 2024-09-13T18:40:33.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.508+0000 7f09e940c640 1 --2- 172.21.15.97:0/939788733 >> v2:172.21.15.97:3300/0 conn(0x7f09e4068eb0 0x7f09e4069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7f1780f38640 1 -- 172.21.15.97:0/1619015256 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f177c06de90 msgr2=0x7f177c09c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7f1780f38640 1 --2- 172.21.15.97:0/1619015256 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f177c06de90 0x7f177c09c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7f1780f38640 1 -- 172.21.15.97:0/1619015256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f177c09d230 msgr2=0x7f177c12f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7f1780f38640 1 --2- 172.21.15.97:0/1619015256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f177c09d230 0x7f177c12f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7f1780f38640 1 -- 172.21.15.97:0/1619015256 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c06e9d0 con 0x7f177c09ce60 2024-09-13T18:40:33.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7f09e8c0b640 1 --2- 172.21.15.97:0/939788733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e412fed0 0x7f09e4068970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7f09e8c0b640 1 -- 172.21.15.97:0/939788733 >> v2:172.21.15.97:3300/0 conn(0x7f09e4068eb0 msgr2=0x7f09e4069350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7f09e8c0b640 1 --2- 172.21.15.97:0/939788733 >> v2:172.21.15.97:3300/0 conn(0x7f09e4068eb0 0x7f09e4069350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7f09e8c0b640 1 -- 172.21.15.97:0/939788733 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e41302c0 con 0x7f09e40a32b0 2024-09-13T18:40:33.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7f09e940c640 1 --2- 172.21.15.97:0/939788733 >> v2:172.21.15.97:3300/0 conn(0x7f09e4068eb0 0x7f09e4069350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:33.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7f09e3fff640 1 --2- 172.21.15.97:0/939788733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e412fed0 0x7f09e4068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:33.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7feabf7fe640 1 -- 172.21.15.97:0/1519372922 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feac0096e00 msgr2=0x7feac009d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7feabf7fe640 1 --2- 172.21.15.97:0/1519372922 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feac0096e00 0x7feac009d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7feabf7fe640 1 -- 172.21.15.97:0/1519372922 >> v1:172.21.15.97:6789/0 conn(0x7feac009d920 legacy=0x7feac0131f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7feabf7fe640 1 -- 172.21.15.97:0/1519372922 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac006eb80 con 0x7feac0098ab0 2024-09-13T18:40:33.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.509+0000 7f4e66ffd640 1 --2- 172.21.15.97:0/4018162960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e680a3470 0x7f4e6812f610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009940 tx=0x7f4e580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6639adf910ddaf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7f4e65ffb640 1 -- 172.21.15.97:0/4018162960 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5802ad50 con 0x7f4e680a3470 2024-09-13T18:40:33.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7f4e65ffb640 1 -- 172.21.15.97:0/4018162960 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58032440 con 0x7f4e680a3470 2024-09-13T18:40:33.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7f4e65ffb640 1 -- 172.21.15.97:0/4018162960 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580327e0 con 0x7f4e680a3470 2024-09-13T18:40:33.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7f1780f38640 1 --2- 172.21.15.97:0/1619015256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f177c09ce60 0x7f177c12f380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f176c0131d0 tx=0x7f176c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab971dc5ededaa6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7f09e8c0b640 1 --2- 172.21.15.97:0/939788733 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f09e40a32b0 0x7f09e412f990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009910 tx=0x7f09d80091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13aa5e465d7da9b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7feabf7fe640 1 --2- 172.21.15.97:0/1519372922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feac0098ab0 0x7feac009cea0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feab0009940 tx=0x7feab00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c740e869cfdb40d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7f1773fff640 1 -- 172.21.15.97:0/1619015256 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0112e0 con 0x7f177c09ce60 2024-09-13T18:40:33.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7f1773fff640 1 -- 172.21.15.97:0/1619015256 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c011440 con 0x7f177c09ce60 2024-09-13T18:40:33.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7f1773fff640 1 -- 172.21.15.97:0/1619015256 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c00f850 con 0x7f177c09ce60 2024-09-13T18:40:33.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7feabe7fc640 1 -- 172.21.15.97:0/1519372922 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab002ad50 con 0x7feac0098ab0 2024-09-13T18:40:33.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7f09e37fe640 1 -- 172.21.15.97:0/939788733 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d802ad20 con 0x7f09e40a32b0 2024-09-13T18:40:33.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7f09e37fe640 1 -- 172.21.15.97:0/939788733 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d802ae80 con 0x7f09e40a32b0 2024-09-13T18:40:33.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7f09e37fe640 1 -- 172.21.15.97:0/939788733 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8032670 con 0x7f09e40a32b0 2024-09-13T18:40:33.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7feabe7fc640 1 -- 172.21.15.97:0/1519372922 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab0032440 con 0x7feac0098ab0 2024-09-13T18:40:33.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7feabe7fc640 1 -- 172.21.15.97:0/1519372922 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab00327e0 con 0x7feac0098ab0 2024-09-13T18:40:33.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7f4e6d660640 1 -- 172.21.15.97:0/4018162960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e680a3470 msgr2=0x7f4e6812f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.510+0000 7f4e6d660640 1 --2- 172.21.15.97:0/4018162960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e680a3470 0x7f4e6812f610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009940 tx=0x7f4e580091d0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f4e6d660640 1 -- 172.21.15.97:0/4018162960 shutdown_connections 2024-09-13T18:40:33.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f4e6d660640 1 --2- 172.21.15.97:0/4018162960 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e6812fb50 0x7f4e6812ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f4e6d660640 1 --2- 172.21.15.97:0/4018162960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e680a3470 0x7f4e6812f610 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f4e6d660640 1 -- 172.21.15.97:0/4018162960 >> 172.21.15.97:0/4018162960 conn(0x7f4e6806efb0 msgr2=0x7f4e680a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f4e6d660640 1 -- 172.21.15.97:0/4018162960 shutdown_connections 2024-09-13T18:40:33.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f4e6d660640 1 -- 172.21.15.97:0/4018162960 wait complete. 2024-09-13T18:40:33.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f09eae6f640 1 -- 172.21.15.97:0/939788733 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f09e40a32b0 msgr2=0x7f09e412f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f09eae6f640 1 --2- 172.21.15.97:0/939788733 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f09e40a32b0 0x7f09e412f990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009910 tx=0x7f09d80091d0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7feac620f640 1 -- 172.21.15.97:0/1519372922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feac0098ab0 msgr2=0x7feac009cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7feac620f640 1 --2- 172.21.15.97:0/1519372922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feac0098ab0 0x7feac009cea0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feab0009940 tx=0x7feab00091d0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f178399d640 1 -- 172.21.15.97:0/1619015256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f177c09ce60 msgr2=0x7f177c12f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7feac620f640 1 -- 172.21.15.97:0/1519372922 shutdown_connections 2024-09-13T18:40:33.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f178399d640 1 --2- 172.21.15.97:0/1619015256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f177c09ce60 0x7f177c12f380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f176c0131d0 tx=0x7f176c011a60 comp rx=0 tx=0).stop 2024-09-13T18:40:33.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f09eae6f640 1 -- 172.21.15.97:0/939788733 shutdown_connections 2024-09-13T18:40:33.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f09eae6f640 1 --2- 172.21.15.97:0/939788733 >> v2:172.21.15.97:3300/0 conn(0x7f09e4068eb0 0x7f09e4069350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f09eae6f640 1 --2- 172.21.15.97:0/939788733 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e412fed0 0x7f09e4068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f09eae6f640 1 --2- 172.21.15.97:0/939788733 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f09e40a32b0 0x7f09e412f990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f09eae6f640 1 -- 172.21.15.97:0/939788733 >> 172.21.15.97:0/939788733 conn(0x7f09e406eef0 msgr2=0x7f09e40a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7feac620f640 1 --2- 172.21.15.97:0/1519372922 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feac0096e00 0x7feac009d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7feac620f640 1 --2- 172.21.15.97:0/1519372922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feac0098ab0 0x7feac009cea0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7feac620f640 1 -- 172.21.15.97:0/1519372922 >> 172.21.15.97:0/1519372922 conn(0x7feac009b200 msgr2=0x7feac009b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f09eae6f640 1 -- 172.21.15.97:0/939788733 shutdown_connections 2024-09-13T18:40:33.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f09eae6f640 1 -- 172.21.15.97:0/939788733 wait complete. 2024-09-13T18:40:33.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7feac620f640 1 -- 172.21.15.97:0/1519372922 shutdown_connections 2024-09-13T18:40:33.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f178399d640 1 -- 172.21.15.97:0/1619015256 shutdown_connections 2024-09-13T18:40:33.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f178399d640 1 --2- 172.21.15.97:0/1619015256 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f177c09d230 0x7f177c12f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7feac620f640 1 -- 172.21.15.97:0/1519372922 wait complete. 2024-09-13T18:40:33.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f178399d640 1 --2- 172.21.15.97:0/1619015256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f177c09ce60 0x7f177c12f380 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f178399d640 1 --2- 172.21.15.97:0/1619015256 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f177c06de90 0x7f177c09c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f178399d640 1 -- 172.21.15.97:0/1619015256 >> 172.21.15.97:0/1619015256 conn(0x7f177c09b200 msgr2=0x7f177c09b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f178399d640 1 -- 172.21.15.97:0/1619015256 shutdown_connections 2024-09-13T18:40:33.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.511+0000 7f178399d640 1 -- 172.21.15.97:0/1619015256 wait complete. 2024-09-13T18:40:33.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.512+0000 7f09eae6f640 1 Processor -- start 2024-09-13T18:40:33.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.512+0000 7f4e6d660640 1 Processor -- start 2024-09-13T18:40:33.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.512+0000 7f09eae6f640 1 -- start start 2024-09-13T18:40:33.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.512+0000 7f4e6d660640 1 -- start start 2024-09-13T18:40:33.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.512+0000 7feac620f640 1 Processor -- start 2024-09-13T18:40:33.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.512+0000 7feac620f640 1 -- start start 2024-09-13T18:40:33.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.512+0000 7f09eae6f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f09e4068eb0 0x7f09e409b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09eae6f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09e40a32b0 0x7f09e409bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09eae6f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e412fed0 0x7f09e413a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09eae6f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e409e710 con 0x7f09e40a32b0 2024-09-13T18:40:33.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09eae6f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e411aca0 con 0x7f09e412fed0 2024-09-13T18:40:33.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09eae6f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09e409b4b0 con 0x7f09e4068eb0 2024-09-13T18:40:33.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09e8c0b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f09e4068eb0 0x7f09e409b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09e8c0b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f09e4068eb0 0x7f09e409b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47156/0 (socket says 172.21.15.97:47156) 2024-09-13T18:40:33.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09e3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09e40a32b0 0x7f09e409bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09e8c0b640 1 -- 172.21.15.97:0/1370355997 learned_addr learned my addr 172.21.15.97:0/1370355997 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09e940c640 1 --2- 172.21.15.97:0/1370355997 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e412fed0 0x7f09e413a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f178399d640 1 Processor -- start 2024-09-13T18:40:33.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f4e6d660640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e68068970 0x7f4e6813ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f4e6d660640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e680a3470 0x7f4e6813f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f178399d640 1 -- start start 2024-09-13T18:40:33.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7feac620f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7feac0096e00 0x7feac011f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7feac620f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feac0098ab0 0x7feac011fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7feac620f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feac009d920 0x7feac013ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7feac620f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac006ddf0 con 0x7feac0098ab0 2024-09-13T18:40:33.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7feac620f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac01224f0 con 0x7feac009d920 2024-09-13T18:40:33.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7feac620f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feac011f2b0 con 0x7feac0096e00 2024-09-13T18:40:33.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7feabeffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feac0098ab0 0x7feac011fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7feabeffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feac0098ab0 0x7feac011fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36384/0 (socket says 172.21.15.97:36384) 2024-09-13T18:40:33.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7feabeffd640 1 -- 172.21.15.97:0/1040845781 learned_addr learned my addr 172.21.15.97:0/1040845781 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7feabffff640 1 --2- 172.21.15.97:0/1040845781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feac009d920 0x7feac013ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7feabf7fe640 1 --2- 172.21.15.97:0/1040845781 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7feac0096e00 0x7feac011f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09e3fff640 1 -- 172.21.15.97:0/1370355997 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f09e4068eb0 msgr2=0x7f09e409b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09e3fff640 1 --2- 172.21.15.97:0/1370355997 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f09e4068eb0 0x7f09e409b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09e3fff640 1 -- 172.21.15.97:0/1370355997 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e412fed0 msgr2=0x7f09e413a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09e3fff640 1 --2- 172.21.15.97:0/1370355997 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e412fed0 0x7f09e413a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09e3fff640 1 -- 172.21.15.97:0/1370355997 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0013a10 con 0x7f09e40a32b0 2024-09-13T18:40:33.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09e940c640 1 --2- 172.21.15.97:0/1370355997 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f09e412fed0 0x7f09e413a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:33.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f09e8c0b640 1 --2- 172.21.15.97:0/1370355997 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f09e4068eb0 0x7f09e409b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:33.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7feabeffd640 1 -- 172.21.15.97:0/1040845781 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7feac0096e00 msgr2=0x7feac011f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f09e3fff640 1 --2- 172.21.15.97:0/1370355997 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09e40a32b0 0x7f09e409bd50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f09d0017450 tx=0x7f09d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7feabeffd640 1 --2- 172.21.15.97:0/1040845781 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7feac0096e00 0x7feac011f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7feabeffd640 1 -- 172.21.15.97:0/1040845781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feac009d920 msgr2=0x7feac013ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7feabeffd640 1 --2- 172.21.15.97:0/1040845781 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7feac009d920 0x7feac013ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7feabeffd640 1 -- 172.21.15.97:0/1040845781 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab0009450 con 0x7feac0098ab0 2024-09-13T18:40:33.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7feabeffd640 1 --2- 172.21.15.97:0/1040845781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feac0098ab0 0x7feac011fae0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feab400d890 tx=0x7feab4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f178399d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f177c06de90 0x7f177c116aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f09e0ff9640 1 -- 172.21.15.97:0/1370355997 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d001f400 con 0x7f09e40a32b0 2024-09-13T18:40:33.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f4e6d660640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4e6812fb50 0x7f4e6811a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f4e6d660640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6811cbb0 con 0x7f4e68068970 2024-09-13T18:40:33.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f4e6d660640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680a2060 con 0x7f4e680a3470 2024-09-13T18:40:33.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f4e6d660640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6809e6f0 con 0x7f4e6812fb50 2024-09-13T18:40:33.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f4e667fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e680a3470 0x7f4e6813f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.513+0000 7f4e66ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e68068970 0x7f4e6813ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f4e667fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e680a3470 0x7f4e6813f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:52226/0 (socket says 172.21.15.97:52226) 2024-09-13T18:40:33.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f4e667fc640 1 -- 172.21.15.97:0/3101984091 learned_addr learned my addr 172.21.15.97:0/3101984091 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f09e0ff9640 1 -- 172.21.15.97:0/1370355997 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d0019040 con 0x7f09e40a32b0 2024-09-13T18:40:33.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f178399d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f177c09ce60 0x7f177c116fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f178399d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f177c09d230 0x7f177c13a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f09e0ff9640 1 -- 172.21.15.97:0/1370355997 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d001f770 con 0x7f09e40a32b0 2024-09-13T18:40:33.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f178399d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c118a10 con 0x7f177c09d230 2024-09-13T18:40:33.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f178399d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c1194e0 con 0x7f177c09ce60 2024-09-13T18:40:33.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f178399d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f177c09ddf0 con 0x7f177c06de90 2024-09-13T18:40:33.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f4e667fc640 1 -- 172.21.15.97:0/3101984091 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4e6812fb50 msgr2=0x7f4e6811a600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:40:33.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f09eae6f640 1 -- 172.21.15.97:0/1370355997 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d8009450 con 0x7f09e40a32b0 2024-09-13T18:40:33.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f4e677fe640 1 --2- 172.21.15.97:0/3101984091 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4e6812fb50 0x7f4e6811a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f4e667fc640 1 --2- 172.21.15.97:0/3101984091 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4e6812fb50 0x7f4e6811a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f4e667fc640 1 -- 172.21.15.97:0/3101984091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e68068970 msgr2=0x7f4e6813ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f4e667fc640 1 --2- 172.21.15.97:0/3101984091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e68068970 0x7f4e6813ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f4e667fc640 1 -- 172.21.15.97:0/3101984091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e58009450 con 0x7f4e680a3470 2024-09-13T18:40:33.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f4e66ffd640 1 --2- 172.21.15.97:0/3101984091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e68068970 0x7f4e6813ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:33.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f1780f38640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f177c09ce60 0x7f177c116fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f1780f38640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f177c09ce60 0x7f177c116fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:52256/0 (socket says 172.21.15.97:52256) 2024-09-13T18:40:33.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f1780f38640 1 -- 172.21.15.97:0/1749070400 learned_addr learned my addr 172.21.15.97:0/1749070400 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7f1781f3a640 1 --2- 172.21.15.97:0/1749070400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f177c09d230 0x7f177c13a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7feaa77fe640 1 -- 172.21.15.97:0/1040845781 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab400de20 con 0x7feac0098ab0 2024-09-13T18:40:33.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7feaa77fe640 1 -- 172.21.15.97:0/1040845781 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab400b8d0 con 0x7feac0098ab0 2024-09-13T18:40:33.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.514+0000 7feaa77fe640 1 -- 172.21.15.97:0/1040845781 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab400bc70 con 0x7feac0098ab0 2024-09-13T18:40:33.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7f09eae6f640 1 -- 172.21.15.97:0/1370355997 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e4119330 con 0x7f09e40a32b0 2024-09-13T18:40:33.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7f4e667fc640 1 --2- 172.21.15.97:0/3101984091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e680a3470 0x7f4e6813f230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00ea20 tx=0x7f4e5c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7f1781739640 1 --2- 172.21.15.97:0/1749070400 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f177c06de90 0x7f177c116aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7f4e4effd640 1 -- 172.21.15.97:0/3101984091 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c00ca10 con 0x7f4e680a3470 2024-09-13T18:40:33.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7f4e4effd640 1 -- 172.21.15.97:0/3101984091 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c00cb70 con 0x7f4e680a3470 2024-09-13T18:40:33.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7f4e4effd640 1 -- 172.21.15.97:0/3101984091 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c013470 con 0x7f4e680a3470 2024-09-13T18:40:33.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7f4e6d660640 1 -- 172.21.15.97:0/3101984091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6811e020 con 0x7f4e680a3470 2024-09-13T18:40:33.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7f4e6d660640 1 -- 172.21.15.97:0/3101984091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6813f770 con 0x7f4e680a3470 2024-09-13T18:40:33.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7feac620f640 1 -- 172.21.15.97:0/1040845781 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac0122f00 con 0x7feac0098ab0 2024-09-13T18:40:33.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7f1780f38640 1 -- 172.21.15.97:0/1749070400 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f177c06de90 msgr2=0x7f177c116aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7f1780f38640 1 --2- 172.21.15.97:0/1749070400 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f177c06de90 0x7f177c116aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7feac620f640 1 -- 172.21.15.97:0/1040845781 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac0120020 con 0x7feac0098ab0 2024-09-13T18:40:33.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7f1780f38640 1 -- 172.21.15.97:0/1749070400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f177c09d230 msgr2=0x7f177c13a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7f1780f38640 1 --2- 172.21.15.97:0/1749070400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f177c09d230 0x7f177c13a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.515+0000 7f1780f38640 1 -- 172.21.15.97:0/1749070400 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c011d00 con 0x7f177c09ce60 2024-09-13T18:40:33.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.516+0000 7f1781739640 1 --2- 172.21.15.97:0/1749070400 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f177c06de90 0x7f177c116aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:33.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.516+0000 7f4e6d660640 1 -- 172.21.15.97:0/3101984091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e6811c320 con 0x7f4e680a3470 2024-09-13T18:40:33.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.516+0000 7f1780f38640 1 --2- 172.21.15.97:0/1749070400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f177c09ce60 0x7f177c116fe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f176c0131d0 tx=0x7f176c03f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.516+0000 7f4e4effd640 1 -- 172.21.15.97:0/3101984091 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f4e5c013860 con 0x7f4e680a3470 2024-09-13T18:40:33.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.516+0000 7f17717fa640 1 -- 172.21.15.97:0/1749070400 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0115b0 con 0x7f177c09ce60 2024-09-13T18:40:33.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.516+0000 7f09e0ff9640 1 -- 172.21.15.97:0/1370355997 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f09d001fb20 con 0x7f09e40a32b0 2024-09-13T18:40:33.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.516+0000 7f17717fa640 1 -- 172.21.15.97:0/1749070400 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c047070 con 0x7f177c09ce60 2024-09-13T18:40:33.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.516+0000 7feac620f640 1 -- 172.21.15.97:0/1040845781 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feac0120af0 con 0x7feac0098ab0 2024-09-13T18:40:33.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.516+0000 7f17717fa640 1 -- 172.21.15.97:0/1749070400 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c011710 con 0x7f177c09ce60 2024-09-13T18:40:33.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.516+0000 7f09eae6f640 1 -- 172.21.15.97:0/1370355997 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09e4064000 con 0x7f09e40a32b0 2024-09-13T18:40:33.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.517+0000 7f178399d640 1 -- 172.21.15.97:0/1749070400 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c1167c0 con 0x7f177c09ce60 2024-09-13T18:40:33.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.517+0000 7feaa77fe640 1 -- 172.21.15.97:0/1040845781 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7feab4014640 con 0x7feac0098ab0 2024-09-13T18:40:33.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.517+0000 7f178399d640 1 -- 172.21.15.97:0/1749070400 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c117e10 con 0x7f177c09ce60 2024-09-13T18:40:33.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.517+0000 7f09e0ff9640 1 -- 172.21.15.97:0/1370355997 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f09d004a880 con 0x7f09e40a32b0 2024-09-13T18:40:33.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.517+0000 7f09e0ff9640 1 -- 172.21.15.97:0/1370355997 --> v1:172.21.15.97:6808/35061 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09c803dd50 con 0x7f09c803a050 2024-09-13T18:40:33.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.517+0000 7f09e0ff9640 1 -- 172.21.15.97:0/1370355997 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09d001fdd0 con 0x7f09e40a32b0 2024-09-13T18:40:33.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.517+0000 7f4e4effd640 1 -- 172.21.15.97:0/3101984091 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f4e5c042550 con 0x7f4e680a3470 2024-09-13T18:40:33.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.517+0000 7f4e4effd640 1 -- 172.21.15.97:0/3101984091 --> v1:172.21.15.97:6804/35063 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e5403de00 con 0x7f4e5403a100 2024-09-13T18:40:33.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.517+0000 7f4e4effd640 1 -- 172.21.15.97:0/3101984091 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e5c044a50 con 0x7f4e680a3470 2024-09-13T18:40:33.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.517+0000 7feaa77fe640 1 -- 172.21.15.97:0/1040845781 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7feab4042750 con 0x7feac0098ab0 2024-09-13T18:40:33.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.517+0000 7feaa77fe640 1 -- 172.21.15.97:0/1040845781 --> v1:172.21.15.97:6800/35060 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feaac03dd50 con 0x7feaac03a050 2024-09-13T18:40:33.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.517+0000 7feaa77fe640 1 -- 172.21.15.97:0/1040845781 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7feab40148f0 con 0x7feac0098ab0 2024-09-13T18:40:33.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.518+0000 7f178399d640 1 -- 172.21.15.97:0/1749070400 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f177c064000 con 0x7f177c09ce60 2024-09-13T18:40:33.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.518+0000 7f17717fa640 1 -- 172.21.15.97:0/1749070400 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f176c049030 con 0x7f177c09ce60 2024-09-13T18:40:33.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.518+0000 7f17717fa640 1 -- 172.21.15.97:0/1749070400 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f176c035070 con 0x7f177c09ce60 2024-09-13T18:40:33.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.518+0000 7f17717fa640 1 -- 172.21.15.97:0/1749070400 --> v1:172.21.15.97:6812/35062 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f176003de50 con 0x7f176003a150 2024-09-13T18:40:33.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.518+0000 7f17717fa640 1 -- 172.21.15.97:0/1749070400 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f176c055d40 con 0x7f177c09ce60 2024-09-13T18:40:33.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.518+0000 7f4e4effd640 1 -- 172.21.15.97:0/3101984091 <== osd.2 v1:172.21.15.97:6804/35063 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f4e5403de00 con 0x7f4e5403a100 2024-09-13T18:40:33.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.519+0000 7f09e0ff9640 1 -- 172.21.15.97:0/1370355997 <== osd.1 v1:172.21.15.97:6808/35061 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f09c803dd50 con 0x7f09c803a050 2024-09-13T18:40:33.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.519+0000 7feaa77fe640 1 -- 172.21.15.97:0/1040845781 <== osd.3 v1:172.21.15.97:6800/35060 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7feaac03dd50 con 0x7feaac03a050 2024-09-13T18:40:33.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.519+0000 7f17717fa640 1 -- 172.21.15.97:0/1749070400 <== osd.0 v1:172.21.15.97:6812/35062 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f176003de50 con 0x7f176003a150 2024-09-13T18:40:33.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.531+0000 7f09eae6f640 1 -- 172.21.15.97:0/1370355997 --> v1:172.21.15.97:6808/35061 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09e409c4d0 con 0x7f09c803a050 2024-09-13T18:40:33.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.531+0000 7f4e6d660640 1 -- 172.21.15.97:0/3101984091 --> v1:172.21.15.97:6804/35063 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4e68133a40 con 0x7f4e5403a100 2024-09-13T18:40:33.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.531+0000 7feac620f640 1 -- 172.21.15.97:0/1040845781 --> v1:172.21.15.97:6800/35060 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feac006b140 con 0x7feaac03a050 2024-09-13T18:40:33.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.531+0000 7f4e4effd640 1 -- 172.21.15.97:0/3101984091 <== osd.2 v1:172.21.15.97:6804/35063 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1894478275) 0x7f4e68133a40 con 0x7f4e5403a100 2024-09-13T18:40:33.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.531+0000 7feaa77fe640 1 -- 172.21.15.97:0/1040845781 <== osd.3 v1:172.21.15.97:6800/35060 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2189488832) 0x7feac006b140 con 0x7feaac03a050 2024-09-13T18:40:33.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f09e0ff9640 1 -- 172.21.15.97:0/1370355997 <== osd.1 v1:172.21.15.97:6808/35061 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2446328116) 0x7f09e409c4d0 con 0x7f09c803a050 2024-09-13T18:40:33.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7feac620f640 1 -- 172.21.15.97:0/1040845781 >> v1:172.21.15.97:6800/35060 conn(0x7feaac03a050 legacy=0x7feaac03c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f4e6d660640 1 -- 172.21.15.97:0/3101984091 >> v1:172.21.15.97:6804/35063 conn(0x7f4e5403a100 legacy=0x7f4e5403c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7feac620f640 1 -- 172.21.15.97:0/1040845781 >> v1:172.21.15.97:6816/34603 conn(0x7feaac031160 legacy=0x7feaac033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f09eae6f640 1 -- 172.21.15.97:0/1370355997 >> v1:172.21.15.97:6808/35061 conn(0x7f09c803a050 legacy=0x7f09c803c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7feac620f640 1 -- 172.21.15.97:0/1040845781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feac0098ab0 msgr2=0x7feac011fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f4e6d660640 1 -- 172.21.15.97:0/3101984091 >> v1:172.21.15.97:6816/34603 conn(0x7f4e54031190 legacy=0x7f4e54033640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7feac620f640 1 --2- 172.21.15.97:0/1040845781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feac0098ab0 0x7feac011fae0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feab400d890 tx=0x7feab4008040 comp rx=0 tx=0).stop 2024-09-13T18:40:33.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7feabffff640 1 -- 172.21.15.97:0/1040845781 reap_dead start 2024-09-13T18:40:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f4e6d660640 1 -- 172.21.15.97:0/3101984091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e680a3470 msgr2=0x7f4e6813f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f4e6d660640 1 --2- 172.21.15.97:0/3101984091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4e680a3470 0x7f4e6813f230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00ea20 tx=0x7f4e5c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f4e677fe640 1 -- 172.21.15.97:0/3101984091 reap_dead start 2024-09-13T18:40:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7feac620f640 1 -- 172.21.15.97:0/1040845781 shutdown_connections 2024-09-13T18:40:33.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7feac620f640 1 -- 172.21.15.97:0/1040845781 >> 172.21.15.97:0/1040845781 conn(0x7feac009b200 msgr2=0x7feac006c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f09eae6f640 1 -- 172.21.15.97:0/1370355997 >> v1:172.21.15.97:6816/34603 conn(0x7f09c8031160 legacy=0x7f09c8033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f09eae6f640 1 -- 172.21.15.97:0/1370355997 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09e40a32b0 msgr2=0x7f09e409bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7feac620f640 1 -- 172.21.15.97:0/1040845781 shutdown_connections 2024-09-13T18:40:33.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f09eae6f640 1 --2- 172.21.15.97:0/1370355997 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f09e40a32b0 0x7f09e409bd50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f09d0017450 tx=0x7f09d0008040 comp rx=0 tx=0).stop 2024-09-13T18:40:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f09e940c640 1 -- 172.21.15.97:0/1370355997 reap_dead start 2024-09-13T18:40:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f09eae6f640 1 -- 172.21.15.97:0/1370355997 shutdown_connections 2024-09-13T18:40:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f09eae6f640 1 -- 172.21.15.97:0/1370355997 >> 172.21.15.97:0/1370355997 conn(0x7f09e406eef0 msgr2=0x7f09e40a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f4e6d660640 1 -- 172.21.15.97:0/3101984091 shutdown_connections 2024-09-13T18:40:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.532+0000 7f4e6d660640 1 -- 172.21.15.97:0/3101984091 >> 172.21.15.97:0/3101984091 conn(0x7f4e6806efb0 msgr2=0x7f4e68132690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.533+0000 7f178399d640 1 -- 172.21.15.97:0/1749070400 --> v1:172.21.15.97:6812/35062 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f177c117520 con 0x7f176003a150 2024-09-13T18:40:33.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.533+0000 7feac620f640 1 -- 172.21.15.97:0/1040845781 wait complete. 2024-09-13T18:40:33.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.533+0000 7f4e6d660640 1 -- 172.21.15.97:0/3101984091 shutdown_connections 2024-09-13T18:40:33.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.533+0000 7f4e6d660640 1 -- 172.21.15.97:0/3101984091 wait complete. 2024-09-13T18:40:33.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.533+0000 7f09eae6f640 1 -- 172.21.15.97:0/1370355997 shutdown_connections 2024-09-13T18:40:33.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.533+0000 7f09eae6f640 1 -- 172.21.15.97:0/1370355997 wait complete. 2024-09-13T18:40:33.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.533+0000 7f17717fa640 1 -- 172.21.15.97:0/1749070400 <== osd.0 v1:172.21.15.97:6812/35062 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2189488832) 0x7f177c117520 con 0x7f176003a150 2024-09-13T18:40:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.533+0000 7f178399d640 1 -- 172.21.15.97:0/1749070400 >> v1:172.21.15.97:6812/35062 conn(0x7f176003a150 legacy=0x7f176003c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.534+0000 7f178399d640 1 -- 172.21.15.97:0/1749070400 >> v1:172.21.15.97:6816/34603 conn(0x7f17600311e0 legacy=0x7f1760033690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.534+0000 7f178399d640 1 -- 172.21.15.97:0/1749070400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f177c09ce60 msgr2=0x7f177c116fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.534+0000 7f178399d640 1 --2- 172.21.15.97:0/1749070400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f177c09ce60 0x7f177c116fe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f176c0131d0 tx=0x7f176c03f000 comp rx=0 tx=0).stop 2024-09-13T18:40:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.534+0000 7f1781f3a640 1 -- 172.21.15.97:0/1749070400 reap_dead start 2024-09-13T18:40:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.534+0000 7f178399d640 1 -- 172.21.15.97:0/1749070400 shutdown_connections 2024-09-13T18:40:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.534+0000 7f178399d640 1 -- 172.21.15.97:0/1749070400 >> 172.21.15.97:0/1749070400 conn(0x7f177c09b200 msgr2=0x7f177c12c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.534+0000 7f178399d640 1 -- 172.21.15.97:0/1749070400 shutdown_connections 2024-09-13T18:40:33.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.534+0000 7f178399d640 1 -- 172.21.15.97:0/1749070400 wait complete. 2024-09-13T18:40:33.569 INFO:teuthology.orchestra.run.smithi097.stdout:38654705686 2024-09-13T18:40:33.570 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:40:33.570 INFO:teuthology.orchestra.run.smithi097.stdout:38654705685 2024-09-13T18:40:33.571 INFO:teuthology.orchestra.run.smithi097.stdout:38654705687 2024-09-13T18:40:33.571 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:40:33.572 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:40:33.573 INFO:teuthology.orchestra.run.smithi097.stdout:38654705686 2024-09-13T18:40:33.573 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:40:33.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.707+0000 7fa5010c9640 1 Processor -- start 2024-09-13T18:40:33.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.707+0000 7fa5010c9640 1 -- start start 2024-09-13T18:40:33.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.707+0000 7f22cdf00640 1 Processor -- start 2024-09-13T18:40:33.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.707+0000 7f22cdf00640 1 -- start start 2024-09-13T18:40:33.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7fa5010c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4fc09dfb0 0x7fa4fc096d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7fa5010c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa4fc0972c0 0x7fa4fc12c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7fa5010c9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa4fc0976b0 0x7fa4fc12c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7f22cdf00640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22c80a32b0 0x7f22c812f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7fa4fa59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa4fc0972c0 0x7fa4fc12c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7fa4fad9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4fc09dfb0 0x7fa4fc096d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7fa4fa59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa4fc0972c0 0x7fa4fc12c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36404/0 (socket says 172.21.15.97:36404) 2024-09-13T18:40:33.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7fa4fad9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4fc09dfb0 0x7fa4fc096d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:52258/0 (socket says 172.21.15.97:52258) 2024-09-13T18:40:33.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7fa4fa59c640 1 -- 172.21.15.97:0/453064543 learned_addr learned my addr 172.21.15.97:0/453064543 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7fa5010c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4fc098e80 con 0x7fa4fc0972c0 2024-09-13T18:40:33.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7fa5010c9640 1 -- 172.21.15.97:0/453064543 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc06a180 con 0x7fa4fc09dfb0 2024-09-13T18:40:33.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7fa5010c9640 1 -- 172.21.15.97:0/453064543 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc098870 con 0x7fa4fc0976b0 2024-09-13T18:40:33.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7fa4fb59e640 1 --2- 172.21.15.97:0/453064543 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa4fc0976b0 0x7fa4fc12c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7f22cdf00640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f22c812fed0 0x7f22c8068970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7f22cdf00640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c8096b70 con 0x7f22c8068eb0 2024-09-13T18:40:33.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7f22cdf00640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c80a3680 con 0x7f22c80a32b0 2024-09-13T18:40:33.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7ffb7c8c0640 1 Processor -- start 2024-09-13T18:40:33.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7f22c6ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f22c812fed0 0x7f22c8068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7f22c6ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f22c812fed0 0x7f22c8068970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47202/0 (socket says 172.21.15.97:47202) 2024-09-13T18:40:33.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7ffb7c8c0640 1 -- start start 2024-09-13T18:40:33.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.708+0000 7f22c6ffd640 1 -- 172.21.15.97:0/710188193 learned_addr learned my addr 172.21.15.97:0/710188193 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fa4fa59c640 1 -- 172.21.15.97:0/453064543 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa4fc0976b0 msgr2=0x7fa4fc12c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7f22c77fe640 1 --2- 172.21.15.97:0/710188193 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22c80a32b0 0x7f22c812f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fa4fa59c640 1 --2- 172.21.15.97:0/453064543 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa4fc0976b0 0x7fa4fc12c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7f22cdf00640 1 -- 172.21.15.97:0/710188193 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22c8097460 con 0x7f22c812fed0 2024-09-13T18:40:33.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fcee1a34640 1 Processor -- start 2024-09-13T18:40:33.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fa4fa59c640 1 -- 172.21.15.97:0/453064543 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4fc09dfb0 msgr2=0x7fa4fc096d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fcee1a34640 1 -- start start 2024-09-13T18:40:33.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fa4fa59c640 1 --2- 172.21.15.97:0/453064543 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4fc09dfb0 0x7fa4fc096d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fa4fa59c640 1 -- 172.21.15.97:0/453064543 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc09cbb0 con 0x7fa4fc0972c0 2024-09-13T18:40:33.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fa4fb59e640 1 --2- 172.21.15.97:0/453064543 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa4fc0976b0 0x7fa4fc12c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:33.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7f22c67fc640 1 -- 172.21.15.97:0/710188193 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258918183 0 0) 0x7f22c8096b70 con 0x7f22c8068eb0 2024-09-13T18:40:33.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7f22c67fc640 1 -- 172.21.15.97:0/710188193 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b00034e0 con 0x7f22c8068eb0 2024-09-13T18:40:33.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7f22c77fe640 1 -- 172.21.15.97:0/710188193 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f22c812fed0 msgr2=0x7f22c8068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7f22c77fe640 1 --2- 172.21.15.97:0/710188193 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f22c812fed0 0x7f22c8068970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7f22c77fe640 1 -- 172.21.15.97:0/710188193 >> v1:172.21.15.97:6789/0 conn(0x7f22c8068eb0 legacy=0x7f22c8136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7f22c77fe640 1 -- 172.21.15.97:0/710188193 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c81302c0 con 0x7f22c80a32b0 2024-09-13T18:40:33.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fcee1a34640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcedc09dfb0 0x7fcedc096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fcee1a34640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcedc0974c0 0x7fcedc12c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fcee1a34640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc06a190 con 0x7fcedc0969d0 2024-09-13T18:40:33.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fcee1a34640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc09e380 con 0x7fcedc09dfb0 2024-09-13T18:40:33.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fcee1a34640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc098870 con 0x7fcedc0974c0 2024-09-13T18:40:33.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.709+0000 7fcedaffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcedc09dfb0 0x7fcedc096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7fceda7fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fcedc0969d0 0x7fcedc12bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54438/0 (socket says 172.21.15.97:54438) 2024-09-13T18:40:33.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7fceda7fc640 1 -- 172.21.15.97:0/3845089898 learned_addr learned my addr 172.21.15.97:0/3845089898 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:40:33.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7fcedb7fe640 1 --2- 172.21.15.97:0/3845089898 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcedc0974c0 0x7fcedc12c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb7c8c0640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffb7809e630 0x7ffb780991c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb7c8c0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffb78099700 0x7ffb7812c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7fa4fa59c640 1 --2- 172.21.15.97:0/453064543 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4fc0972c0 0x7fa4fc12c0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009910 tx=0x7fa4f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79b3a0c219648b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb7c8c0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb78096a10 con 0x7ffb7812c590 2024-09-13T18:40:33.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb7c8c0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb78099ad0 con 0x7ffb78099700 2024-09-13T18:40:33.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb7c8c0640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78097890 con 0x7ffb7809e630 2024-09-13T18:40:33.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7fcedb7fe640 1 -- 172.21.15.97:0/3845089898 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcedc09dfb0 msgr2=0x7fcedc096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb76d9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ffb7812c590 0x7ffb781333b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54452/0 (socket says 172.21.15.97:54452) 2024-09-13T18:40:33.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb76d9d640 1 -- 172.21.15.97:0/1651849620 learned_addr learned my addr 172.21.15.97:0/1651849620 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:40:33.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb75d9b640 1 --2- 172.21.15.97:0/1651849620 >> v2:172.21.15.97:3300/0 conn(0x7ffb78099700 0x7ffb7812c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb7659c640 1 --2- 172.21.15.97:0/1651849620 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffb7809e630 0x7ffb780991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7fa4f9d9b640 1 -- 172.21.15.97:0/453064543 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0031510 con 0x7fa4fc0972c0 2024-09-13T18:40:33.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7fcedb7fe640 1 --2- 172.21.15.97:0/3845089898 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcedc09dfb0 0x7fcedc096f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7fcedb7fe640 1 -- 172.21.15.97:0/3845089898 >> v1:172.21.15.97:6789/0 conn(0x7fcedc0969d0 legacy=0x7fcedc12bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7fcedb7fe640 1 -- 172.21.15.97:0/3845089898 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc097960 con 0x7fcedc0974c0 2024-09-13T18:40:33.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7fcedaffd640 1 --2- 172.21.15.97:0/3845089898 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcedc09dfb0 0x7fcedc096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:33.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7fa4f9d9b640 1 -- 172.21.15.97:0/453064543 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f002f050 con 0x7fa4fc0972c0 2024-09-13T18:40:33.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7f22c77fe640 1 --2- 172.21.15.97:0/710188193 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22c80a32b0 0x7f22c812f990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009880 tx=0x7f22b80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d5e6fdd708b605d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb7559a640 1 -- 172.21.15.97:0/1651849620 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607741235 0 0) 0x7ffb78096a10 con 0x7ffb7812c590 2024-09-13T18:40:33.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7fa4f9d9b640 1 -- 172.21.15.97:0/453064543 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00318e0 con 0x7fa4fc0972c0 2024-09-13T18:40:33.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb7559a640 1 -- 172.21.15.97:0/1651849620 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb600034e0 con 0x7ffb7812c590 2024-09-13T18:40:33.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb75d9b640 1 -- 172.21.15.97:0/1651849620 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffb7809e630 msgr2=0x7ffb780991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:33.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb75d9b640 1 --2- 172.21.15.97:0/1651849620 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffb7809e630 0x7ffb780991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.710+0000 7ffb75d9b640 1 -- 172.21.15.97:0/1651849620 >> v1:172.21.15.97:6789/0 conn(0x7ffb7812c590 legacy=0x7ffb781333b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7f22c67fc640 1 -- 172.21.15.97:0/710188193 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b802acd0 con 0x7f22c80a32b0 2024-09-13T18:40:33.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7ffb75d9b640 1 -- 172.21.15.97:0/1651849620 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb78097b50 con 0x7ffb78099700 2024-09-13T18:40:33.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7ffb7659c640 1 --2- 172.21.15.97:0/1651849620 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffb7809e630 0x7ffb780991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:33.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7f22c67fc640 1 -- 172.21.15.97:0/710188193 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b802ae30 con 0x7f22c80a32b0 2024-09-13T18:40:33.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7f22c67fc640 1 -- 172.21.15.97:0/710188193 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8032650 con 0x7f22c80a32b0 2024-09-13T18:40:33.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7fcedb7fe640 1 --2- 172.21.15.97:0/3845089898 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcedc0974c0 0x7fcedc12c680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fced4009ec0 tx=0x7fced4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7410453c6023b849 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7fced9ffb640 1 -- 172.21.15.97:0/3845089898 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4007550 con 0x7fcedc0974c0 2024-09-13T18:40:33.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7fa5010c9640 1 -- 172.21.15.97:0/453064543 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4fc0972c0 msgr2=0x7fa4fc12c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7fa5010c9640 1 --2- 172.21.15.97:0/453064543 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4fc0972c0 0x7fa4fc12c0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009910 tx=0x7fa4f00091d0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7fced9ffb640 1 -- 172.21.15.97:0/3845089898 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced402d050 con 0x7fcedc0974c0 2024-09-13T18:40:33.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7fced9ffb640 1 -- 172.21.15.97:0/3845089898 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4007920 con 0x7fcedc0974c0 2024-09-13T18:40:33.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7fa5010c9640 1 -- 172.21.15.97:0/453064543 shutdown_connections 2024-09-13T18:40:33.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7fa5010c9640 1 --2- 172.21.15.97:0/453064543 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa4fc0976b0 0x7fa4fc12c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7fa5010c9640 1 --2- 172.21.15.97:0/453064543 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4fc0972c0 0x7fa4fc12c0c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7fa5010c9640 1 --2- 172.21.15.97:0/453064543 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4fc09dfb0 0x7fa4fc096d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7fa5010c9640 1 -- 172.21.15.97:0/453064543 >> 172.21.15.97:0/453064543 conn(0x7fa4fc09b200 msgr2=0x7fa4fc09b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7fa5010c9640 1 -- 172.21.15.97:0/453064543 shutdown_connections 2024-09-13T18:40:33.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7fa5010c9640 1 -- 172.21.15.97:0/453064543 wait complete. 2024-09-13T18:40:33.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.711+0000 7ffb75d9b640 1 --2- 172.21.15.97:0/1651849620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb78099700 0x7ffb7812c050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009850 tx=0x7ffb6c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c6af069502bcb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7f22cdf00640 1 -- 172.21.15.97:0/710188193 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22c80a32b0 msgr2=0x7f22c812f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7f22cdf00640 1 --2- 172.21.15.97:0/710188193 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22c80a32b0 0x7f22c812f990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009880 tx=0x7f22b80090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7f22cdf00640 1 -- 172.21.15.97:0/710188193 shutdown_connections 2024-09-13T18:40:33.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7f22cdf00640 1 --2- 172.21.15.97:0/710188193 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f22c812fed0 0x7f22c8068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7f22cdf00640 1 --2- 172.21.15.97:0/710188193 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22c80a32b0 0x7f22c812f990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7f22cdf00640 1 -- 172.21.15.97:0/710188193 >> 172.21.15.97:0/710188193 conn(0x7f22c806eef0 msgr2=0x7f22c80a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7f22cdf00640 1 -- 172.21.15.97:0/710188193 shutdown_connections 2024-09-13T18:40:33.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7f22cdf00640 1 -- 172.21.15.97:0/710188193 wait complete. 2024-09-13T18:40:33.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7fcee1a34640 1 -- 172.21.15.97:0/3845089898 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcedc0974c0 msgr2=0x7fcedc12c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7fcee1a34640 1 --2- 172.21.15.97:0/3845089898 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcedc0974c0 0x7fcedc12c680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fced4009ec0 tx=0x7fced4009780 comp rx=0 tx=0).stop 2024-09-13T18:40:33.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7ffb7559a640 1 -- 172.21.15.97:0/1651849620 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c02ad00 con 0x7ffb78099700 2024-09-13T18:40:33.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7ffb7559a640 1 -- 172.21.15.97:0/1651849620 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c02ae60 con 0x7ffb78099700 2024-09-13T18:40:33.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7fcee1a34640 1 -- 172.21.15.97:0/3845089898 shutdown_connections 2024-09-13T18:40:33.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7fcee1a34640 1 --2- 172.21.15.97:0/3845089898 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcedc0974c0 0x7fcedc12c680 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7fcee1a34640 1 --2- 172.21.15.97:0/3845089898 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcedc09dfb0 0x7fcedc096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7fcee1a34640 1 -- 172.21.15.97:0/3845089898 >> 172.21.15.97:0/3845089898 conn(0x7fcedc09b200 msgr2=0x7fcedc09b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7fcee1a34640 1 -- 172.21.15.97:0/3845089898 shutdown_connections 2024-09-13T18:40:33.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7ffb7559a640 1 -- 172.21.15.97:0/1651849620 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c032670 con 0x7ffb78099700 2024-09-13T18:40:33.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.712+0000 7fcee1a34640 1 -- 172.21.15.97:0/3845089898 wait complete. 2024-09-13T18:40:33.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.713+0000 7fa5010c9640 1 Processor -- start 2024-09-13T18:40:33.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.713+0000 7fa5010c9640 1 -- start start 2024-09-13T18:40:33.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.713+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1651849620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb78099700 msgr2=0x7ffb7812c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.713+0000 7ffb7c8c0640 1 --2- 172.21.15.97:0/1651849620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb78099700 0x7ffb7812c050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009850 tx=0x7ffb6c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.713+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1651849620 shutdown_connections 2024-09-13T18:40:33.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.713+0000 7ffb7c8c0640 1 --2- 172.21.15.97:0/1651849620 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb78099700 0x7ffb7812c050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.713+0000 7ffb7c8c0640 1 --2- 172.21.15.97:0/1651849620 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffb7809e630 0x7ffb780991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.713+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1651849620 >> 172.21.15.97:0/1651849620 conn(0x7ffb7805e5d0 msgr2=0x7ffb7809f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.713+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1651849620 shutdown_connections 2024-09-13T18:40:33.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7f22cdf00640 1 Processor -- start 2024-09-13T18:40:33.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fcee1a34640 1 Processor -- start 2024-09-13T18:40:33.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fa5010c9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa4fc0972c0 0x7fa4fc13a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.713+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1651849620 wait complete. 2024-09-13T18:40:33.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7f22cdf00640 1 -- start start 2024-09-13T18:40:33.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fa5010c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4fc0976b0 0x7fa4fc13ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fa4fad9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa4fc0972c0 0x7fa4fc13a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fa4fad9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa4fc0972c0 0x7fa4fc13a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47224/0 (socket says 172.21.15.97:47224) 2024-09-13T18:40:33.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fa4fad9d640 1 -- 172.21.15.97:0/2820321242 learned_addr learned my addr 172.21.15.97:0/2820321242 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fa5010c9640 1 --2- 172.21.15.97:0/2820321242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4fc09dfb0 0x7fa4fc1153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7ffb7c8c0640 1 Processor -- start 2024-09-13T18:40:33.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fcee1a34640 1 -- start start 2024-09-13T18:40:33.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fcee1a34640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcedc0969d0 0x7fcedc12ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fcee1a34640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcedc0974c0 0x7fcedc11daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fcee1a34640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcedc09dfb0 0x7fcedc11e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fcee1a34640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc121560 con 0x7fcedc09dfb0 2024-09-13T18:40:33.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fcee1a34640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc11f6c0 con 0x7fcedc0969d0 2024-09-13T18:40:33.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fcee1a34640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc06e0e0 con 0x7fcedc0974c0 2024-09-13T18:40:33.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fcedb7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcedc09dfb0 0x7fcedc11e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fcedb7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcedc09dfb0 0x7fcedc11e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36446/0 (socket says 172.21.15.97:36446) 2024-09-13T18:40:33.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fcedb7fe640 1 -- 172.21.15.97:0/4210351763 learned_addr learned my addr 172.21.15.97:0/4210351763 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7fa4fa59c640 1 --2- 172.21.15.97:0/2820321242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4fc0976b0 0x7fa4fc13ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fcedaffd640 1 --2- 172.21.15.97:0/4210351763 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcedc0969d0 0x7fcedc12ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7f22cdf00640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f22c8068eb0 0x7f22c813eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fceda7fc640 1 --2- 172.21.15.97:0/4210351763 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcedc0974c0 0x7fcedc11daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7f22cdf00640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22c80a32b0 0x7f22c813f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7f22cdf00640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22c812fed0 0x7f22c81190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7f22cdf00640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c811bac0 con 0x7f22c80a32b0 2024-09-13T18:40:33.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.714+0000 7ffb7c8c0640 1 -- start start 2024-09-13T18:40:33.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7ffb7c8c0640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffb78099700 0x7ffb781430a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7ffb7c8c0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb7809e630 0x7ffb781435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7ffb7c8c0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb7812c590 0x7ffb7806bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:33.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7ffb7c8c0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78116530 con 0x7ffb7812c590 2024-09-13T18:40:33.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7ffb7c8c0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7806d9e0 con 0x7ffb7809e630 2024-09-13T18:40:33.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7ffb7c8c0640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78116760 con 0x7ffb78099700 2024-09-13T18:40:33.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7f22c7fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22c812fed0 0x7f22c81190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7f22c7fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22c812fed0 0x7f22c81190b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:52308/0 (socket says 172.21.15.97:52308) 2024-09-13T18:40:33.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7f22c7fff640 1 -- 172.21.15.97:0/3892097068 learned_addr learned my addr 172.21.15.97:0/3892097068 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7f22cdf00640 1 -- 172.21.15.97:0/3892097068 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c80a25e0 con 0x7f22c812fed0 2024-09-13T18:40:33.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7f22cdf00640 1 -- 172.21.15.97:0/3892097068 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22c811a940 con 0x7f22c8068eb0 2024-09-13T18:40:33.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7ffb7659c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffb78099700 0x7ffb781430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7ffb7659c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffb78099700 0x7ffb781430a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47254/0 (socket says 172.21.15.97:47254) 2024-09-13T18:40:33.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7ffb7659c640 1 -- 172.21.15.97:0/1630731850 learned_addr learned my addr 172.21.15.97:0/1630731850 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:33.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fa5010c9640 1 -- 172.21.15.97:0/2820321242 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc118720 con 0x7fa4fc0976b0 2024-09-13T18:40:33.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fa5010c9640 1 -- 172.21.15.97:0/2820321242 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc118900 con 0x7fa4fc09dfb0 2024-09-13T18:40:33.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fa5010c9640 1 -- 172.21.15.97:0/2820321242 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc09a760 con 0x7fa4fc0972c0 2024-09-13T18:40:33.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fa4fb59e640 1 --2- 172.21.15.97:0/2820321242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4fc09dfb0 0x7fa4fc1153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fcedb7fe640 1 -- 172.21.15.97:0/4210351763 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcedc0974c0 msgr2=0x7fcedc11daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fcedb7fe640 1 --2- 172.21.15.97:0/4210351763 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcedc0974c0 0x7fcedc11daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fcedb7fe640 1 -- 172.21.15.97:0/4210351763 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcedc0969d0 msgr2=0x7fcedc12ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fcedb7fe640 1 --2- 172.21.15.97:0/4210351763 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcedc0969d0 0x7fcedc12ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7fcedb7fe640 1 -- 172.21.15.97:0/4210351763 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced4009a20 con 0x7fcedc09dfb0 2024-09-13T18:40:33.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7f22c77fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f22c8068eb0 0x7f22c813eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.715+0000 7ffb76d9d640 1 --2- 172.21.15.97:0/1630731850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb7812c590 0x7ffb7806bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7f22c6ffd640 1 --2- 172.21.15.97:0/3892097068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22c80a32b0 0x7f22c813f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:33.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7ffb7659c640 1 -- 172.21.15.97:0/1630731850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb7809e630 msgr2=0x7ffb781435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7ffb7659c640 1 --2- 172.21.15.97:0/1630731850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb7809e630 0x7ffb781435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7ffb7659c640 1 -- 172.21.15.97:0/1630731850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb7812c590 msgr2=0x7ffb7806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7ffb7659c640 1 --2- 172.21.15.97:0/1630731850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb7812c590 0x7ffb7806bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7ffb7659c640 1 -- 172.21.15.97:0/1630731850 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c009390 con 0x7ffb78099700 2024-09-13T18:40:33.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7fcedb7fe640 1 --2- 172.21.15.97:0/4210351763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcedc09dfb0 0x7fcedc11e030 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fced402ab30 tx=0x7fced4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7fa4fad9d640 1 -- 172.21.15.97:0/2820321242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4fc09dfb0 msgr2=0x7fa4fc1153d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7fa4fad9d640 1 --2- 172.21.15.97:0/2820321242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4fc09dfb0 0x7fa4fc1153d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7fa4fad9d640 1 -- 172.21.15.97:0/2820321242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4fc0976b0 msgr2=0x7fa4fc13ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7fa4fad9d640 1 --2- 172.21.15.97:0/2820321242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4fc0976b0 0x7fa4fc13ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7fa4fad9d640 1 -- 172.21.15.97:0/2820321242 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f4009a20 con 0x7fa4fc0972c0 2024-09-13T18:40:33.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7f22c7fff640 1 -- 172.21.15.97:0/3892097068 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f22c8068eb0 msgr2=0x7f22c813eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7f22c7fff640 1 --2- 172.21.15.97:0/3892097068 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f22c8068eb0 0x7f22c813eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7f22c7fff640 1 -- 172.21.15.97:0/3892097068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22c80a32b0 msgr2=0x7f22c813f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7f22c7fff640 1 --2- 172.21.15.97:0/3892097068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22c80a32b0 0x7f22c813f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7f22c7fff640 1 -- 172.21.15.97:0/3892097068 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b8009390 con 0x7f22c812fed0 2024-09-13T18:40:33.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7fcec2ffd640 1 -- 172.21.15.97:0/4210351763 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4031890 con 0x7fcedc09dfb0 2024-09-13T18:40:33.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7fcec2ffd640 1 -- 172.21.15.97:0/4210351763 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced4040070 con 0x7fcedc09dfb0 2024-09-13T18:40:33.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7fcec2ffd640 1 -- 172.21.15.97:0/4210351763 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4031c40 con 0x7fcedc09dfb0 2024-09-13T18:40:33.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7fcee1a34640 1 -- 172.21.15.97:0/4210351763 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc097e10 con 0x7fcedc09dfb0 2024-09-13T18:40:33.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7ffb7659c640 1 --2- 172.21.15.97:0/1630731850 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffb78099700 0x7ffb781430a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800d890 tx=0x7ffb68008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7fcee1a34640 1 -- 172.21.15.97:0/4210351763 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc12bfa0 con 0x7fcedc09dfb0 2024-09-13T18:40:33.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.716+0000 7f22c7fff640 1 --2- 172.21.15.97:0/3892097068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22c812fed0 0x7f22c81190b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22c000c940 tx=0x7f22c00026f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.717+0000 7fa4fad9d640 1 --2- 172.21.15.97:0/2820321242 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa4fc0972c0 0x7fa4fc13a800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00ea50 tx=0x7fa4ec0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:33.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.717+0000 7f22af7fe640 1 -- 172.21.15.97:0/3892097068 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000a850 con 0x7f22c812fed0 2024-09-13T18:40:33.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.717+0000 7f22cdf00640 1 -- 172.21.15.97:0/3892097068 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c811a150 con 0x7f22c812fed0 2024-09-13T18:40:33.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.717+0000 7f22cdf00640 1 -- 172.21.15.97:0/3892097068 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c813f610 con 0x7f22c812fed0 2024-09-13T18:40:33.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.717+0000 7ffb667fc640 1 -- 172.21.15.97:0/1630731850 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800de80 con 0x7ffb78099700 2024-09-13T18:40:33.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.717+0000 7ffb667fc640 1 -- 172.21.15.97:0/1630731850 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6800b870 con 0x7ffb78099700 2024-09-13T18:40:33.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.717+0000 7fa4e2ffd640 1 -- 172.21.15.97:0/2820321242 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec009600 con 0x7fa4fc0972c0 2024-09-13T18:40:33.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.717+0000 7fa5010c9640 1 -- 172.21.15.97:0/2820321242 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f0009450 con 0x7fa4fc0972c0 2024-09-13T18:40:33.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.717+0000 7ffb667fc640 1 -- 172.21.15.97:0/1630731850 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800bc30 con 0x7ffb78099700 2024-09-13T18:40:33.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.717+0000 7fa5010c9640 1 -- 172.21.15.97:0/2820321242 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4fc1174d0 con 0x7fa4fc0972c0 2024-09-13T18:40:33.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.718+0000 7fcee1a34640 1 -- 172.21.15.97:0/4210351763 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcedc064000 con 0x7fcedc09dfb0 2024-09-13T18:40:33.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.717+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1630731850 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb78116aa0 con 0x7ffb78099700 2024-09-13T18:40:33.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.718+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1630731850 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb78117100 con 0x7ffb78099700 2024-09-13T18:40:33.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.718+0000 7f22cdf00640 1 -- 172.21.15.97:0/3892097068 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c811bc30 con 0x7f22c812fed0 2024-09-13T18:40:33.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.718+0000 7fa5010c9640 1 -- 172.21.15.97:0/2820321242 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4fc116d90 con 0x7fa4fc0972c0 2024-09-13T18:40:33.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.719+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1630731850 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb781161e0 con 0x7ffb78099700 2024-09-13T18:40:33.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.720+0000 7fcec2ffd640 1 -- 172.21.15.97:0/4210351763 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fced4042030 con 0x7fcedc09dfb0 2024-09-13T18:40:33.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.720+0000 7fa4e2ffd640 1 -- 172.21.15.97:0/2820321242 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ec00ca10 con 0x7fa4fc0972c0 2024-09-13T18:40:33.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.720+0000 7fa4e2ffd640 1 -- 172.21.15.97:0/2820321242 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec009600 con 0x7fa4fc0972c0 2024-09-13T18:40:33.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.720+0000 7fcec2ffd640 1 -- 172.21.15.97:0/4210351763 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fced4063eb0 con 0x7fcedc09dfb0 2024-09-13T18:40:33.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.721+0000 7ffb667fc640 1 -- 172.21.15.97:0/1630731850 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7ffb6801e460 con 0x7ffb78099700 2024-09-13T18:40:33.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.721+0000 7f22af7fe640 1 -- 172.21.15.97:0/3892097068 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c000abc0 con 0x7f22c812fed0 2024-09-13T18:40:33.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.721+0000 7f22af7fe640 1 -- 172.21.15.97:0/3892097068 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000ad90 con 0x7f22c812fed0 2024-09-13T18:40:33.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.721+0000 7f22af7fe640 1 -- 172.21.15.97:0/3892097068 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f22c0024420 con 0x7f22c812fed0 2024-09-13T18:40:33.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.721+0000 7ffb667fc640 1 -- 172.21.15.97:0/1630731850 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7ffb680431c0 con 0x7ffb78099700 2024-09-13T18:40:33.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.721+0000 7fa4e2ffd640 1 -- 172.21.15.97:0/2820321242 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fa4ec00cb80 con 0x7fa4fc0972c0 2024-09-13T18:40:33.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.721+0000 7fa4e2ffd640 1 -- 172.21.15.97:0/2820321242 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fa4ec00ce30 con 0x7fa4fc0972c0 2024-09-13T18:40:33.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.722+0000 7f22af7fe640 1 -- 172.21.15.97:0/3892097068 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f22c0042960 con 0x7f22c812fed0 2024-09-13T18:40:33.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.725+0000 7fcec2ffd640 1 -- 172.21.15.97:0/4210351763 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fced4044bb0 con 0x7fcedc09dfb0 2024-09-13T18:40:33.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.729+0000 7ffb667fc640 1 -- 172.21.15.97:0/1630731850 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7ffb68013bc0 con 0x7ffb78099700 2024-09-13T18:40:33.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.729+0000 7f22af7fe640 1 -- 172.21.15.97:0/3892097068 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f22c0019d70 con 0x7f22c812fed0 2024-09-13T18:40:33.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.734+0000 7fa4e2ffd640 1 -- 172.21.15.97:0/2820321242 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fa4ec013cd0 con 0x7fa4fc0972c0 2024-09-13T18:40:33.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.889+0000 7f22cdf00640 1 -- 172.21.15.97:0/3892097068 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f22c8064000 con 0x7f22c812fed0 2024-09-13T18:40:33.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.890+0000 7f22af7fe640 1 -- 172.21.15.97:0/3892097068 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22c0028090 con 0x7f22c812fed0 2024-09-13T18:40:33.893 INFO:teuthology.orchestra.run.smithi097.stdout:38654705685 2024-09-13T18:40:33.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.892+0000 7f22cdf00640 1 -- 172.21.15.97:0/3892097068 >> v1:172.21.15.97:6816/34603 conn(0x7f22b4031160 legacy=0x7f22b4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.892+0000 7f22cdf00640 1 -- 172.21.15.97:0/3892097068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22c812fed0 msgr2=0x7f22c81190b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.892+0000 7f22cdf00640 1 --2- 172.21.15.97:0/3892097068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22c812fed0 0x7f22c81190b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22c000c940 tx=0x7f22c00026f0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.892+0000 7f22cdf00640 1 -- 172.21.15.97:0/3892097068 shutdown_connections 2024-09-13T18:40:33.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.892+0000 7f22cdf00640 1 --2- 172.21.15.97:0/3892097068 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f22c812fed0 0x7f22c81190b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.892+0000 7f22cdf00640 1 --2- 172.21.15.97:0/3892097068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22c80a32b0 0x7f22c813f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.892+0000 7f22cdf00640 1 --2- 172.21.15.97:0/3892097068 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f22c8068eb0 0x7f22c813eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.892+0000 7f22cdf00640 1 -- 172.21.15.97:0/3892097068 >> 172.21.15.97:0/3892097068 conn(0x7f22c806eef0 msgr2=0x7f22c8132530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.892+0000 7f22cdf00640 1 -- 172.21.15.97:0/3892097068 shutdown_connections 2024-09-13T18:40:33.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.892+0000 7f22cdf00640 1 -- 172.21.15.97:0/3892097068 wait complete. 2024-09-13T18:40:33.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.895+0000 7fa5010c9640 1 -- 172.21.15.97:0/2820321242 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa4fc118a40 con 0x7fa4fc0972c0 2024-09-13T18:40:33.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.895+0000 7fa4e2ffd640 1 -- 172.21.15.97:0/2820321242 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4ec021020 con 0x7fa4fc0972c0 2024-09-13T18:40:33.898 INFO:teuthology.orchestra.run.smithi097.stdout:38654705684 2024-09-13T18:40:33.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.899+0000 7fa5010c9640 1 -- 172.21.15.97:0/2820321242 >> v1:172.21.15.97:6816/34603 conn(0x7fa4e80311c0 legacy=0x7fa4e8033670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.899+0000 7fa5010c9640 1 -- 172.21.15.97:0/2820321242 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa4fc0972c0 msgr2=0x7fa4fc13a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.899+0000 7fa5010c9640 1 --2- 172.21.15.97:0/2820321242 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa4fc0972c0 0x7fa4fc13a800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00ea50 tx=0x7fa4ec0090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.899+0000 7fa5010c9640 1 -- 172.21.15.97:0/2820321242 shutdown_connections 2024-09-13T18:40:33.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.899+0000 7fa5010c9640 1 --2- 172.21.15.97:0/2820321242 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa4fc09dfb0 0x7fa4fc1153d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.899+0000 7fa5010c9640 1 --2- 172.21.15.97:0/2820321242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4fc0976b0 0x7fa4fc13ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.899+0000 7fa5010c9640 1 --2- 172.21.15.97:0/2820321242 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa4fc0972c0 0x7fa4fc13a800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.899+0000 7fa5010c9640 1 -- 172.21.15.97:0/2820321242 >> 172.21.15.97:0/2820321242 conn(0x7fa4fc09b200 msgr2=0x7fa4fc12d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.899+0000 7fa5010c9640 1 -- 172.21.15.97:0/2820321242 shutdown_connections 2024-09-13T18:40:33.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.899+0000 7fa5010c9640 1 -- 172.21.15.97:0/2820321242 wait complete. 2024-09-13T18:40:33.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705686 got 38654705685 for osd.3 2024-09-13T18:40:33.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.910+0000 7fcee1a34640 1 -- 172.21.15.97:0/4210351763 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcedc11a850 con 0x7fcedc09dfb0 2024-09-13T18:40:33.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705685 got 38654705684 for osd.1 2024-09-13T18:40:33.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.910+0000 7fcec2ffd640 1 -- 172.21.15.97:0/4210351763 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fced40443d0 con 0x7fcedc09dfb0 2024-09-13T18:40:33.914 INFO:teuthology.orchestra.run.smithi097.stdout:38654705686 2024-09-13T18:40:33.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.911+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1630731850 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffb78064600 con 0x7ffb78099700 2024-09-13T18:40:33.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.911+0000 7ffb667fc640 1 -- 172.21.15.97:0/1630731850 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb6802c090 con 0x7ffb78099700 2024-09-13T18:40:33.915 INFO:teuthology.orchestra.run.smithi097.stdout:38654705685 2024-09-13T18:40:33.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.912+0000 7fcee1a34640 1 -- 172.21.15.97:0/4210351763 >> v1:172.21.15.97:6816/34603 conn(0x7fcec8031190 legacy=0x7fcec8033640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.912+0000 7fcee1a34640 1 -- 172.21.15.97:0/4210351763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcedc09dfb0 msgr2=0x7fcedc11e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.912+0000 7fcee1a34640 1 --2- 172.21.15.97:0/4210351763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcedc09dfb0 0x7fcedc11e030 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fced402ab30 tx=0x7fced4037000 comp rx=0 tx=0).stop 2024-09-13T18:40:33.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.912+0000 7fcee1a34640 1 -- 172.21.15.97:0/4210351763 shutdown_connections 2024-09-13T18:40:33.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.912+0000 7fcee1a34640 1 --2- 172.21.15.97:0/4210351763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcedc09dfb0 0x7fcedc11e030 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.912+0000 7fcee1a34640 1 --2- 172.21.15.97:0/4210351763 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fcedc0974c0 0x7fcedc11daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.912+0000 7fcee1a34640 1 --2- 172.21.15.97:0/4210351763 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fcedc0969d0 0x7fcedc12ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.912+0000 7fcee1a34640 1 -- 172.21.15.97:0/4210351763 >> 172.21.15.97:0/4210351763 conn(0x7fcedc09b200 msgr2=0x7fcedc06d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.912+0000 7fcee1a34640 1 -- 172.21.15.97:0/4210351763 shutdown_connections 2024-09-13T18:40:33.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.912+0000 7fcee1a34640 1 -- 172.21.15.97:0/4210351763 wait complete. 2024-09-13T18:40:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.913+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1630731850 >> v1:172.21.15.97:6816/34603 conn(0x7ffb580311b0 legacy=0x7ffb58033660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.913+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1630731850 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffb78099700 msgr2=0x7ffb781430a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.913+0000 7ffb7c8c0640 1 --2- 172.21.15.97:0/1630731850 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffb78099700 0x7ffb781430a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800d890 tx=0x7ffb68008040 comp rx=0 tx=0).stop 2024-09-13T18:40:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.913+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1630731850 shutdown_connections 2024-09-13T18:40:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.913+0000 7ffb7c8c0640 1 --2- 172.21.15.97:0/1630731850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb7812c590 0x7ffb7806bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.913+0000 7ffb7c8c0640 1 --2- 172.21.15.97:0/1630731850 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ffb7809e630 0x7ffb781435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.913+0000 7ffb7c8c0640 1 --2- 172.21.15.97:0/1630731850 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ffb78099700 0x7ffb781430a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.913+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1630731850 >> 172.21.15.97:0/1630731850 conn(0x7ffb7805e5d0 msgr2=0x7ffb7809c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.913+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1630731850 shutdown_connections 2024-09-13T18:40:33.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:33.913+0000 7ffb7c8c0640 1 -- 172.21.15.97:0/1630731850 wait complete. 2024-09-13T18:40:33.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705687 got 38654705686 for osd.2 2024-09-13T18:40:33.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705686 got 38654705685 for osd.0 2024-09-13T18:40:34.908 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:40:34.914 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:40:34.927 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:40:34.928 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:40:35.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.019+0000 7f579fe94640 1 Processor -- start 2024-09-13T18:40:35.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.019+0000 7f579fe94640 1 -- start start 2024-09-13T18:40:35.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.020+0000 7f579fe94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57980a32b0 0x7f579812f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.020+0000 7f579fe94640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5798069080 0x7f5798137770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.020+0000 7f579fe94640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57980a3680 con 0x7f579812fed0 2024-09-13T18:40:35.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.020+0000 7f579fe94640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5798097460 con 0x7f5798069080 2024-09-13T18:40:35.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.020+0000 7f579fe94640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57981302c0 con 0x7f57980a32b0 2024-09-13T18:40:35.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.020+0000 7f579e431640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5798069080 0x7f5798137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.020+0000 7f579e431640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5798069080 0x7f5798137770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36482/0 (socket says 172.21.15.97:36482) 2024-09-13T18:40:35.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.020+0000 7f579e431640 1 -- 172.21.15.97:0/1919724595 learned_addr learned my addr 172.21.15.97:0/1919724595 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:35.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.020+0000 7f579dc30640 1 --2- 172.21.15.97:0/1919724595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57980a32b0 0x7f579812f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.020+0000 7f579dc30640 1 -- 172.21.15.97:0/1919724595 >> v2:172.21.15.97:3300/0 conn(0x7f5798069080 msgr2=0x7f5798137770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:35.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.020+0000 7f579dc30640 1 --2- 172.21.15.97:0/1919724595 >> v2:172.21.15.97:3300/0 conn(0x7f5798069080 0x7f5798137770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.020+0000 7f579dc30640 1 -- 172.21.15.97:0/1919724595 >> v1:172.21.15.97:6789/0 conn(0x7f579812fed0 legacy=0x7f5798068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.020+0000 7f579dc30640 1 -- 172.21.15.97:0/1919724595 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579812d770 con 0x7f57980a32b0 2024-09-13T18:40:35.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.021+0000 7f579dc30640 1 --2- 172.21.15.97:0/1919724595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57980a32b0 0x7f579812f990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5794009850 tx=0x7f57940090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0d53264766d6540 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:35.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.021+0000 7f579cc2e640 1 -- 172.21.15.97:0/1919724595 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579402ad00 con 0x7f57980a32b0 2024-09-13T18:40:35.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.021+0000 7f579cc2e640 1 -- 172.21.15.97:0/1919724595 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579402ae60 con 0x7f57980a32b0 2024-09-13T18:40:35.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.021+0000 7f579cc2e640 1 -- 172.21.15.97:0/1919724595 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794032670 con 0x7f57980a32b0 2024-09-13T18:40:35.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.022+0000 7f579fe94640 1 -- 172.21.15.97:0/1919724595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57980a32b0 msgr2=0x7f579812f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.022+0000 7f579fe94640 1 --2- 172.21.15.97:0/1919724595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57980a32b0 0x7f579812f990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5794009850 tx=0x7f57940090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.022+0000 7f579fe94640 1 -- 172.21.15.97:0/1919724595 shutdown_connections 2024-09-13T18:40:35.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.022+0000 7f579fe94640 1 --2- 172.21.15.97:0/1919724595 >> v2:172.21.15.97:3300/0 conn(0x7f5798069080 0x7f5798137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.022+0000 7f579fe94640 1 --2- 172.21.15.97:0/1919724595 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f57980a32b0 0x7f579812f990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.022+0000 7f579fe94640 1 -- 172.21.15.97:0/1919724595 >> 172.21.15.97:0/1919724595 conn(0x7f579806eef0 msgr2=0x7f57980a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:35.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.022+0000 7f579fe94640 1 -- 172.21.15.97:0/1919724595 shutdown_connections 2024-09-13T18:40:35.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.022+0000 7f579fe94640 1 -- 172.21.15.97:0/1919724595 wait complete. 2024-09-13T18:40:35.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.023+0000 7f579fe94640 1 Processor -- start 2024-09-13T18:40:35.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.023+0000 7f579fe94640 1 -- start start 2024-09-13T18:40:35.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579fe94640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5798069080 0x7f579813ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579fe94640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f57980a32b0 0x7f579813f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579fe94640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f579812fed0 0x7f57981190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579fe94640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579811a3a0 con 0x7f579812fed0 2024-09-13T18:40:35.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579fe94640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57980a0a50 con 0x7f5798069080 2024-09-13T18:40:35.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579fe94640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f579809e710 con 0x7f57980a32b0 2024-09-13T18:40:35.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579dc30640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5798069080 0x7f579813ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579d42f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f57980a32b0 0x7f579813f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579dc30640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5798069080 0x7f579813ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:52346/0 (socket says 172.21.15.97:52346) 2024-09-13T18:40:35.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579dc30640 1 -- 172.21.15.97:0/4002670524 learned_addr learned my addr 172.21.15.97:0/4002670524 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:35.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579e431640 1 --2- 172.21.15.97:0/4002670524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f579812fed0 0x7f57981190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579dc30640 1 -- 172.21.15.97:0/4002670524 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f57980a32b0 msgr2=0x7f579813f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579dc30640 1 --2- 172.21.15.97:0/4002670524 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f57980a32b0 0x7f579813f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579dc30640 1 -- 172.21.15.97:0/4002670524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f579812fed0 msgr2=0x7f57981190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579dc30640 1 --2- 172.21.15.97:0/4002670524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f579812fed0 0x7f57981190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579dc30640 1 -- 172.21.15.97:0/4002670524 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5794009390 con 0x7f5798069080 2024-09-13T18:40:35.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.024+0000 7f579d42f640 1 --2- 172.21.15.97:0/4002670524 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f57980a32b0 0x7f579813f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:35.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.025+0000 7f579dc30640 1 --2- 172.21.15.97:0/4002670524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5798069080 0x7f579813ebf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f579402a630 tx=0x7f5794032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:35.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.025+0000 7f578dffb640 1 -- 172.21.15.97:0/4002670524 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579404c6f0 con 0x7f5798069080 2024-09-13T18:40:35.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.025+0000 7f578dffb640 1 -- 172.21.15.97:0/4002670524 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579404c850 con 0x7f5798069080 2024-09-13T18:40:35.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.025+0000 7f578dffb640 1 -- 172.21.15.97:0/4002670524 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579404cc10 con 0x7f5798069080 2024-09-13T18:40:35.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.025+0000 7f579fe94640 1 -- 172.21.15.97:0/4002670524 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579811a9a0 con 0x7f5798069080 2024-09-13T18:40:35.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.025+0000 7f579fe94640 1 -- 172.21.15.97:0/4002670524 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579813f810 con 0x7f5798069080 2024-09-13T18:40:35.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.026+0000 7f578dffb640 1 -- 172.21.15.97:0/4002670524 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f5794039040 con 0x7f5798069080 2024-09-13T18:40:35.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.026+0000 7f578dffb640 1 -- 172.21.15.97:0/4002670524 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f57940732e0 con 0x7f5798069080 2024-09-13T18:40:35.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.027+0000 7f579fe94640 1 -- 172.21.15.97:0/4002670524 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5798064000 con 0x7f5798069080 2024-09-13T18:40:35.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.031+0000 7f578dffb640 1 -- 172.21.15.97:0/4002670524 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f5794037080 con 0x7f5798069080 2024-09-13T18:40:35.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.056+0000 7f6a78f54640 1 Processor -- start 2024-09-13T18:40:35.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.056+0000 7f6a78f54640 1 -- start start 2024-09-13T18:40:35.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7fe83555d640 1 Processor -- start 2024-09-13T18:40:35.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7fe83555d640 1 -- start start 2024-09-13T18:40:35.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7fe83555d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe83005db50 0x7fe83009af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7fe83555d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe830134fc0 0x7fe8301373a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7f6a78f54640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a740a32b0 0x7f6a7412f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7f6a78f54640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a7412fed0 0x7f6a74068970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7fe83555d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe830095a50 con 0x7fe8300976c0 2024-09-13T18:40:35.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7fe83555d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe830070db0 con 0x7fe830134fc0 2024-09-13T18:40:35.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7fe83555d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe830068480 con 0x7fe83005db50 2024-09-13T18:40:35.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7fe82e7fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe83005db50 0x7fe83009af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7fe82e7fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe83005db50 0x7fe83009af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47276/0 (socket says 172.21.15.97:47276) 2024-09-13T18:40:35.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7fe82e7fc640 1 -- 172.21.15.97:0/29713352 learned_addr learned my addr 172.21.15.97:0/29713352 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:35.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7f6a71d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a7412fed0 0x7f6a74068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7f6a71d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a7412fed0 0x7f6a74068970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:52354/0 (socket says 172.21.15.97:52354) 2024-09-13T18:40:35.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7f6a71d9b640 1 -- 172.21.15.97:0/3288698080 learned_addr learned my addr 172.21.15.97:0/3288698080 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:35.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.057+0000 7fe82f7fe640 1 --2- 172.21.15.97:0/29713352 >> v2:172.21.15.97:3300/0 conn(0x7fe830134fc0 0x7fe8301373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7f6a78f54640 1 -- 172.21.15.97:0/3288698080 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a74096b70 con 0x7f6a74068eb0 2024-09-13T18:40:35.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7f6a78f54640 1 -- 172.21.15.97:0/3288698080 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a740a3680 con 0x7f6a7412fed0 2024-09-13T18:40:35.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7f6a78f54640 1 -- 172.21.15.97:0/3288698080 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a74097460 con 0x7f6a740a32b0 2024-09-13T18:40:35.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7f6a7259c640 1 --2- 172.21.15.97:0/3288698080 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a740a32b0 0x7f6a7412f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7fe82f7fe640 1 -- 172.21.15.97:0/29713352 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe83005db50 msgr2=0x7fe83009af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:35.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7fe82f7fe640 1 --2- 172.21.15.97:0/29713352 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe83005db50 0x7fe83009af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7fe82f7fe640 1 -- 172.21.15.97:0/29713352 >> v1:172.21.15.97:6789/0 conn(0x7fe8300976c0 legacy=0x7fe83009a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7f6a7159a640 1 -- 172.21.15.97:0/3288698080 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304663503 0 0) 0x7f6a74096b70 con 0x7f6a74068eb0 2024-09-13T18:40:35.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7f6a7159a640 1 -- 172.21.15.97:0/3288698080 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a5c0034e0 con 0x7f6a74068eb0 2024-09-13T18:40:35.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7fe82f7fe640 1 -- 172.21.15.97:0/29713352 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe830099260 con 0x7fe830134fc0 2024-09-13T18:40:35.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7f6a7259c640 1 -- 172.21.15.97:0/3288698080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a7412fed0 msgr2=0x7f6a74068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:35.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7f6a7259c640 1 --2- 172.21.15.97:0/3288698080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a7412fed0 0x7f6a74068970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7f6a7259c640 1 -- 172.21.15.97:0/3288698080 >> v1:172.21.15.97:6789/0 conn(0x7f6a74068eb0 legacy=0x7f6a74136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7f6a7259c640 1 -- 172.21.15.97:0/3288698080 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a741302c0 con 0x7f6a740a32b0 2024-09-13T18:40:35.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.058+0000 7f6a71d9b640 1 --2- 172.21.15.97:0/3288698080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a7412fed0 0x7f6a74068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:35.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.059+0000 7fe82f7fe640 1 --2- 172.21.15.97:0/29713352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe830134fc0 0x7fe8301373a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe828009e60 tx=0x7fe828009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7164ff0b7701ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:35.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.059+0000 7fe82dffb640 1 -- 172.21.15.97:0/29713352 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828007550 con 0x7fe830134fc0 2024-09-13T18:40:35.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.059+0000 7f6a7259c640 1 --2- 172.21.15.97:0/3288698080 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a740a32b0 0x7f6a7412f990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009ae0 tx=0x7f6a640090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1772be627ec154c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:35.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.059+0000 7fe82dffb640 1 -- 172.21.15.97:0/29713352 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82802d050 con 0x7fe830134fc0 2024-09-13T18:40:35.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.059+0000 7fe82dffb640 1 -- 172.21.15.97:0/29713352 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828007920 con 0x7fe830134fc0 2024-09-13T18:40:35.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.059+0000 7f6a7159a640 1 -- 172.21.15.97:0/3288698080 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64031400 con 0x7f6a740a32b0 2024-09-13T18:40:35.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.059+0000 7f6a7159a640 1 -- 172.21.15.97:0/3288698080 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6402d050 con 0x7f6a740a32b0 2024-09-13T18:40:35.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.059+0000 7f6a7159a640 1 -- 172.21.15.97:0/3288698080 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64031400 con 0x7f6a740a32b0 2024-09-13T18:40:35.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7fe83555d640 1 -- 172.21.15.97:0/29713352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe830134fc0 msgr2=0x7fe8301373a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7fe83555d640 1 --2- 172.21.15.97:0/29713352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe830134fc0 0x7fe8301373a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe828009e60 tx=0x7fe828009780 comp rx=0 tx=0).stop 2024-09-13T18:40:35.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7fe83555d640 1 -- 172.21.15.97:0/29713352 shutdown_connections 2024-09-13T18:40:35.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7fe83555d640 1 --2- 172.21.15.97:0/29713352 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe830134fc0 0x7fe8301373a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7fe83555d640 1 --2- 172.21.15.97:0/29713352 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe83005db50 0x7fe83009af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7fe83555d640 1 -- 172.21.15.97:0/29713352 >> 172.21.15.97:0/29713352 conn(0x7fe83009f8a0 msgr2=0x7fe83009b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:35.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7fe83555d640 1 -- 172.21.15.97:0/29713352 shutdown_connections 2024-09-13T18:40:35.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7f6a78f54640 1 -- 172.21.15.97:0/3288698080 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a740a32b0 msgr2=0x7f6a7412f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7f6a78f54640 1 --2- 172.21.15.97:0/3288698080 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a740a32b0 0x7f6a7412f990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009ae0 tx=0x7f6a640090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7f6a78f54640 1 -- 172.21.15.97:0/3288698080 shutdown_connections 2024-09-13T18:40:35.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7f6a78f54640 1 --2- 172.21.15.97:0/3288698080 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a7412fed0 0x7f6a74068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7f6a78f54640 1 --2- 172.21.15.97:0/3288698080 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a740a32b0 0x7f6a7412f990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7f6a78f54640 1 -- 172.21.15.97:0/3288698080 >> 172.21.15.97:0/3288698080 conn(0x7f6a7406eef0 msgr2=0x7f6a740a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:35.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7f6a78f54640 1 -- 172.21.15.97:0/3288698080 shutdown_connections 2024-09-13T18:40:35.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7f6a78f54640 1 -- 172.21.15.97:0/3288698080 wait complete. 2024-09-13T18:40:35.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.060+0000 7fe83555d640 1 -- 172.21.15.97:0/29713352 wait complete. 2024-09-13T18:40:35.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.061+0000 7fe83555d640 1 Processor -- start 2024-09-13T18:40:35.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.061+0000 7fe83555d640 1 -- start start 2024-09-13T18:40:35.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.061+0000 7f6a78f54640 1 Processor -- start 2024-09-13T18:40:35.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.061+0000 7f6a78f54640 1 -- start start 2024-09-13T18:40:35.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.061+0000 7fe83555d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe83005db50 0x7fe830142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.061+0000 7fe83555d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8300976c0 0x7fe830143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.061+0000 7fe83555d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe830134fc0 0x7fe830088610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.061+0000 7fe83555d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83009ab10 con 0x7fe8300976c0 2024-09-13T18:40:35.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.061+0000 7fe83555d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83013dc40 con 0x7fe83005db50 2024-09-13T18:40:35.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.061+0000 7fe83555d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe83008bb50 con 0x7fe830134fc0 2024-09-13T18:40:35.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7fe82effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe83005db50 0x7fe830142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7fe82e7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8300976c0 0x7fe830143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7fe82effd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe83005db50 0x7fe830142e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:52356/0 (socket says 172.21.15.97:52356) 2024-09-13T18:40:35.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7fe82effd640 1 -- 172.21.15.97:0/190235378 learned_addr learned my addr 172.21.15.97:0/190235378 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:35.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7fe82e7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8300976c0 0x7fe830143390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36508/0 (socket says 172.21.15.97:36508) 2024-09-13T18:40:35.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7fe82f7fe640 1 --2- 172.21.15.97:0/190235378 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe830134fc0 0x7fe830088610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7f6a78f54640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a74068eb0 0x7f6a7413ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7f6a78f54640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a740a32b0 0x7f6a7413ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7f6a78f54640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a7412fed0 0x7f6a741190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7f6a78f54640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a74133760 con 0x7f6a74068eb0 2024-09-13T18:40:35.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7f6a78f54640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7411a150 con 0x7f6a740a32b0 2024-09-13T18:40:35.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7f6a78f54640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7411a8d0 con 0x7f6a7412fed0 2024-09-13T18:40:35.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7f6a7259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a74068eb0 0x7f6a7413ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7f6a71d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a740a32b0 0x7f6a7413ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7f6a7259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a74068eb0 0x7f6a7413ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36516/0 (socket says 172.21.15.97:36516) 2024-09-13T18:40:35.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7f6a7259c640 1 -- 172.21.15.97:0/13974384 learned_addr learned my addr 172.21.15.97:0/13974384 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:35.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7fe82e7fc640 1 -- 172.21.15.97:0/190235378 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe830134fc0 msgr2=0x7fe830088610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7fe82e7fc640 1 --2- 172.21.15.97:0/190235378 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe830134fc0 0x7fe830088610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7fe82e7fc640 1 -- 172.21.15.97:0/190235378 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe83005db50 msgr2=0x7fe830142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7fe82e7fc640 1 --2- 172.21.15.97:0/190235378 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe83005db50 0x7fe830142e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7fe82e7fc640 1 -- 172.21.15.97:0/190235378 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828009a20 con 0x7fe8300976c0 2024-09-13T18:40:35.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7fe82effd640 1 --2- 172.21.15.97:0/190235378 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe83005db50 0x7fe830142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:35.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7fe82e7fc640 1 --2- 172.21.15.97:0/190235378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8300976c0 0x7fe830143390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe82400d890 tx=0x7fe824008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:35.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.062+0000 7f6a72d9d640 1 --2- 172.21.15.97:0/13974384 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a7412fed0 0x7f6a741190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.063+0000 7f6a7259c640 1 -- 172.21.15.97:0/13974384 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a7412fed0 msgr2=0x7f6a741190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.063+0000 7f6a7259c640 1 --2- 172.21.15.97:0/13974384 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a7412fed0 0x7f6a741190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.063+0000 7f6a7259c640 1 -- 172.21.15.97:0/13974384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a740a32b0 msgr2=0x7f6a7413ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.063+0000 7f6a7259c640 1 --2- 172.21.15.97:0/13974384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a740a32b0 0x7f6a7413ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.063+0000 7f6a7259c640 1 -- 172.21.15.97:0/13974384 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a68009450 con 0x7f6a74068eb0 2024-09-13T18:40:35.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.063+0000 7fe816ffd640 1 -- 172.21.15.97:0/190235378 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240096a0 con 0x7fe8300976c0 2024-09-13T18:40:35.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.063+0000 7fe816ffd640 1 -- 172.21.15.97:0/190235378 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe824009800 con 0x7fe8300976c0 2024-09-13T18:40:35.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.063+0000 7fe816ffd640 1 -- 172.21.15.97:0/190235378 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe824009bc0 con 0x7fe8300976c0 2024-09-13T18:40:35.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.063+0000 7fe83555d640 1 -- 172.21.15.97:0/190235378 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83008c580 con 0x7fe8300976c0 2024-09-13T18:40:35.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.063+0000 7fe83555d640 1 -- 172.21.15.97:0/190235378 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8301438d0 con 0x7fe8300976c0 2024-09-13T18:40:35.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.063+0000 7f6a71d9b640 1 --2- 172.21.15.97:0/13974384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a740a32b0 0x7f6a7413ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:35.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.063+0000 7f6a72d9d640 1 --2- 172.21.15.97:0/13974384 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a7412fed0 0x7f6a741190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:35.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.063+0000 7f6a7259c640 1 --2- 172.21.15.97:0/13974384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a74068eb0 0x7f6a7413ea30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009b40 tx=0x7f6a64035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:35.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.064+0000 7f6a627fc640 1 -- 172.21.15.97:0/13974384 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64030780 con 0x7f6a74068eb0 2024-09-13T18:40:35.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.064+0000 7f6a78f54640 1 -- 172.21.15.97:0/13974384 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a64009390 con 0x7f6a74068eb0 2024-09-13T18:40:35.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.064+0000 7f6a627fc640 1 -- 172.21.15.97:0/13974384 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a640308e0 con 0x7f6a74068eb0 2024-09-13T18:40:35.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.064+0000 7f6a627fc640 1 -- 172.21.15.97:0/13974384 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64030ca0 con 0x7f6a74068eb0 2024-09-13T18:40:35.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.064+0000 7f6a78f54640 1 -- 172.21.15.97:0/13974384 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7413f4b0 con 0x7f6a74068eb0 2024-09-13T18:40:35.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.064+0000 7fe816ffd640 1 -- 172.21.15.97:0/190235378 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fe824014410 con 0x7fe8300976c0 2024-09-13T18:40:35.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.064+0000 7fe83555d640 1 -- 172.21.15.97:0/190235378 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe830064600 con 0x7fe8300976c0 2024-09-13T18:40:35.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.065+0000 7f6a627fc640 1 -- 172.21.15.97:0/13974384 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f6a6403c630 con 0x7f6a74068eb0 2024-09-13T18:40:35.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.065+0000 7f6a627fc640 1 -- 172.21.15.97:0/13974384 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f6a640633a0 con 0x7f6a74068eb0 2024-09-13T18:40:35.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.065+0000 7fe816ffd640 1 -- 172.21.15.97:0/190235378 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fe824042830 con 0x7fe8300976c0 2024-09-13T18:40:35.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.065+0000 7f6a78f54640 1 -- 172.21.15.97:0/13974384 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a74064000 con 0x7f6a74068eb0 2024-09-13T18:40:35.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.069+0000 7fbfab2c0640 1 Processor -- start 2024-09-13T18:40:35.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.069+0000 7fbfab2c0640 1 -- start start 2024-09-13T18:40:35.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.069+0000 7fe816ffd640 1 -- 172.21.15.97:0/190235378 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fe824025b30 con 0x7fe8300976c0 2024-09-13T18:40:35.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfab2c0640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbfa40a1320 0x7fbfa412f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfab2c0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbfa40a0230 0x7fbfa412fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfa885b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbfa40a0230 0x7fbfa412fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfa985d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fbfa409e740 0x7fbfa409ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54496/0 (socket says 172.21.15.97:54496) 2024-09-13T18:40:35.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfa985d640 1 -- 172.21.15.97:0/4156948157 learned_addr learned my addr 172.21.15.97:0/4156948157 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:40:35.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfa905c640 1 --2- 172.21.15.97:0/4156948157 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbfa40a1320 0x7fbfa412f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfab2c0640 1 -- 172.21.15.97:0/4156948157 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa409fc20 con 0x7fbfa409e740 2024-09-13T18:40:35.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfab2c0640 1 -- 172.21.15.97:0/4156948157 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa406a290 con 0x7fbfa40a0230 2024-09-13T18:40:35.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfab2c0640 1 -- 172.21.15.97:0/4156948157 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40a16f0 con 0x7fbfa40a1320 2024-09-13T18:40:35.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfa885b640 1 -- 172.21.15.97:0/4156948157 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbfa40a1320 msgr2=0x7fbfa412f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:35.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfa885b640 1 --2- 172.21.15.97:0/4156948157 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbfa40a1320 0x7fbfa412f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfa885b640 1 -- 172.21.15.97:0/4156948157 >> v1:172.21.15.97:6789/0 conn(0x7fbfa409e740 legacy=0x7fbfa409ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfa885b640 1 -- 172.21.15.97:0/4156948157 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa4069f80 con 0x7fbfa40a0230 2024-09-13T18:40:35.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.070+0000 7fbfa905c640 1 --2- 172.21.15.97:0/4156948157 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbfa40a1320 0x7fbfa412f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:35.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.071+0000 7fbfa885b640 1 --2- 172.21.15.97:0/4156948157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa40a0230 0x7fbfa412fce0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009850 tx=0x7fbf940090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defd07df702f1a53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:35.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.074+0000 7fbf9bfff640 1 -- 172.21.15.97:0/4156948157 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9402ac70 con 0x7fbfa40a0230 2024-09-13T18:40:35.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.074+0000 7fbf9bfff640 1 -- 172.21.15.97:0/4156948157 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9402add0 con 0x7fbfa40a0230 2024-09-13T18:40:35.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.074+0000 7fbf9bfff640 1 -- 172.21.15.97:0/4156948157 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94032670 con 0x7fbfa40a0230 2024-09-13T18:40:35.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.074+0000 7f6a627fc640 1 -- 172.21.15.97:0/13974384 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f6a6403ce00 con 0x7f6a74068eb0 2024-09-13T18:40:35.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.074+0000 7fbfab2c0640 1 -- 172.21.15.97:0/4156948157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa40a0230 msgr2=0x7fbfa412fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.074+0000 7fbfab2c0640 1 --2- 172.21.15.97:0/4156948157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa40a0230 0x7fbfa412fce0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009850 tx=0x7fbf940090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.074+0000 7fbfab2c0640 1 -- 172.21.15.97:0/4156948157 shutdown_connections 2024-09-13T18:40:35.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.074+0000 7fbfab2c0640 1 --2- 172.21.15.97:0/4156948157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa40a0230 0x7fbfa412fce0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.074+0000 7fbfab2c0640 1 --2- 172.21.15.97:0/4156948157 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbfa40a1320 0x7fbfa412f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.074+0000 7fbfab2c0640 1 -- 172.21.15.97:0/4156948157 >> 172.21.15.97:0/4156948157 conn(0x7fbfa40a0840 msgr2=0x7fbfa40a0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:35.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.075+0000 7fbfab2c0640 1 -- 172.21.15.97:0/4156948157 shutdown_connections 2024-09-13T18:40:35.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.075+0000 7fbfab2c0640 1 -- 172.21.15.97:0/4156948157 wait complete. 2024-09-13T18:40:35.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.075+0000 7fbfab2c0640 1 Processor -- start 2024-09-13T18:40:35.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.076+0000 7fbfab2c0640 1 -- start start 2024-09-13T18:40:35.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.076+0000 7fbfab2c0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbfa409e740 0x7fbfa411bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.076+0000 7fbfab2c0640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbfa40a0230 0x7fbfa411c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.076+0000 7fbfa905c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbfa409e740 0x7fbfa411bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.076+0000 7fbfa905c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbfa409e740 0x7fbfa411bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:52374/0 (socket says 172.21.15.97:52374) 2024-09-13T18:40:35.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.076+0000 7fbfa905c640 1 -- 172.21.15.97:0/1064321428 learned_addr learned my addr 172.21.15.97:0/1064321428 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:35.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.077+0000 7fbfab2c0640 1 --2- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa40a1320 0x7fbfa413e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:35.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.077+0000 7fbfab2c0640 1 -- 172.21.15.97:0/1064321428 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa411efe0 con 0x7fbfa40a1320 2024-09-13T18:40:35.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.077+0000 7fbfa885b640 1 --2- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbfa40a0230 0x7fbfa411c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.077+0000 7fbfab2c0640 1 -- 172.21.15.97:0/1064321428 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa411ea40 con 0x7fbfa409e740 2024-09-13T18:40:35.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.077+0000 7fbfa985d640 1 --2- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa40a1320 0x7fbfa413e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:35.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.077+0000 7fbfab2c0640 1 -- 172.21.15.97:0/1064321428 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa411ed00 con 0x7fbfa40a0230 2024-09-13T18:40:35.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.077+0000 7fbfa885b640 1 -- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbfa409e740 msgr2=0x7fbfa411bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.077+0000 7fbfa885b640 1 --2- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbfa409e740 0x7fbfa411bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.077+0000 7fbfa885b640 1 -- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa40a1320 msgr2=0x7fbfa413e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.077+0000 7fbfa885b640 1 --2- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa40a1320 0x7fbfa413e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.077+0000 7fbfa885b640 1 -- 172.21.15.97:0/1064321428 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa0009390 con 0x7fbfa40a0230 2024-09-13T18:40:35.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.077+0000 7fbfa985d640 1 --2- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa40a1320 0x7fbfa413e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:35.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.077+0000 7fbfa905c640 1 --2- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbfa409e740 0x7fbfa411bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:35.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.078+0000 7fbfa885b640 1 --2- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbfa40a0230 0x7fbfa411c320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf94031000 tx=0x7fbf94032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:35.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.078+0000 7fbf997fa640 1 -- 172.21.15.97:0/1064321428 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94031a60 con 0x7fbfa40a0230 2024-09-13T18:40:35.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.078+0000 7fbfab2c0640 1 -- 172.21.15.97:0/1064321428 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf94009390 con 0x7fbfa40a0230 2024-09-13T18:40:35.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.078+0000 7fbf997fa640 1 -- 172.21.15.97:0/1064321428 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf94031c00 con 0x7fbfa40a0230 2024-09-13T18:40:35.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.078+0000 7fbf997fa640 1 -- 172.21.15.97:0/1064321428 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9403d420 con 0x7fbfa40a0230 2024-09-13T18:40:35.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.078+0000 7fbfab2c0640 1 -- 172.21.15.97:0/1064321428 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa411ba20 con 0x7fbfa40a0230 2024-09-13T18:40:35.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.079+0000 7fbfab2c0640 1 -- 172.21.15.97:0/1064321428 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa4069020 con 0x7fbfa40a0230 2024-09-13T18:40:35.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.079+0000 7fbf997fa640 1 -- 172.21.15.97:0/1064321428 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fbf94039040 con 0x7fbfa40a0230 2024-09-13T18:40:35.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.079+0000 7fbf997fa640 1 -- 172.21.15.97:0/1064321428 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fbf94061fc0 con 0x7fbfa40a0230 2024-09-13T18:40:35.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.083+0000 7fbf997fa640 1 -- 172.21.15.97:0/1064321428 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fbf94030b20 con 0x7fbfa40a0230 2024-09-13T18:40:35.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.234+0000 7f6a78f54640 1 -- 172.21.15.97:0/13974384 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6a7405e0b0 con 0x7f6a74068eb0 2024-09-13T18:40:35.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.235+0000 7f6a627fc640 1 -- 172.21.15.97:0/13974384 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a6404b300 con 0x7f6a74068eb0 2024-09-13T18:40:35.238 INFO:teuthology.orchestra.run.smithi097.stdout:38654705684 2024-09-13T18:40:35.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.237+0000 7f6a78f54640 1 -- 172.21.15.97:0/13974384 >> v1:172.21.15.97:6816/34603 conn(0x7f6a54031160 legacy=0x7f6a54033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.237+0000 7f6a78f54640 1 -- 172.21.15.97:0/13974384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a74068eb0 msgr2=0x7f6a7413ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.237+0000 7f6a78f54640 1 --2- 172.21.15.97:0/13974384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a74068eb0 0x7f6a7413ea30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009b40 tx=0x7f6a64035000 comp rx=0 tx=0).stop 2024-09-13T18:40:35.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.237+0000 7f6a78f54640 1 -- 172.21.15.97:0/13974384 shutdown_connections 2024-09-13T18:40:35.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.237+0000 7f6a78f54640 1 --2- 172.21.15.97:0/13974384 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6a7412fed0 0x7f6a741190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.237+0000 7f6a78f54640 1 --2- 172.21.15.97:0/13974384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6a740a32b0 0x7f6a7413ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.237+0000 7f6a78f54640 1 --2- 172.21.15.97:0/13974384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6a74068eb0 0x7f6a7413ea30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.237+0000 7f6a78f54640 1 -- 172.21.15.97:0/13974384 >> 172.21.15.97:0/13974384 conn(0x7f6a7406eef0 msgr2=0x7f6a7412d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:35.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.237+0000 7f6a78f54640 1 -- 172.21.15.97:0/13974384 shutdown_connections 2024-09-13T18:40:35.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.237+0000 7f6a78f54640 1 -- 172.21.15.97:0/13974384 wait complete. 2024-09-13T18:40:35.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.241+0000 7f579fe94640 1 -- 172.21.15.97:0/4002670524 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f579811baf0 con 0x7f5798069080 2024-09-13T18:40:35.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.242+0000 7f578dffb640 1 -- 172.21.15.97:0/4002670524 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f579405a020 con 0x7f5798069080 2024-09-13T18:40:35.244 INFO:teuthology.orchestra.run.smithi097.stdout:38654705685 2024-09-13T18:40:35.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.244+0000 7fbfab2c0640 1 -- 172.21.15.97:0/1064321428 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbfa405e0b0 con 0x7fbfa40a0230 2024-09-13T18:40:35.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.244+0000 7fbf997fa640 1 -- 172.21.15.97:0/1064321428 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf94037090 con 0x7fbfa40a0230 2024-09-13T18:40:35.246 INFO:teuthology.orchestra.run.smithi097.stdout:38654705685 2024-09-13T18:40:35.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.245+0000 7f579fe94640 1 -- 172.21.15.97:0/4002670524 >> v1:172.21.15.97:6816/34603 conn(0x7f577c031160 legacy=0x7f577c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.245+0000 7f579fe94640 1 -- 172.21.15.97:0/4002670524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5798069080 msgr2=0x7f579813ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.245+0000 7f579fe94640 1 --2- 172.21.15.97:0/4002670524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5798069080 0x7f579813ebf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f579402a630 tx=0x7f5794032000 comp rx=0 tx=0).stop 2024-09-13T18:40:35.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.245+0000 7f579fe94640 1 -- 172.21.15.97:0/4002670524 shutdown_connections 2024-09-13T18:40:35.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.245+0000 7f579fe94640 1 --2- 172.21.15.97:0/4002670524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f579812fed0 0x7f57981190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.245+0000 7f579fe94640 1 --2- 172.21.15.97:0/4002670524 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f57980a32b0 0x7f579813f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.245+0000 7f579fe94640 1 --2- 172.21.15.97:0/4002670524 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f5798069080 0x7f579813ebf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.245+0000 7f579fe94640 1 -- 172.21.15.97:0/4002670524 >> 172.21.15.97:0/4002670524 conn(0x7f579806eef0 msgr2=0x7f579812e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:35.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.245+0000 7f579fe94640 1 -- 172.21.15.97:0/4002670524 shutdown_connections 2024-09-13T18:40:35.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.245+0000 7f579fe94640 1 -- 172.21.15.97:0/4002670524 wait complete. 2024-09-13T18:40:35.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.247+0000 7fbfab2c0640 1 -- 172.21.15.97:0/1064321428 >> v1:172.21.15.97:6816/34603 conn(0x7fbf88031160 legacy=0x7fbf88033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.247+0000 7fbfab2c0640 1 -- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbfa40a0230 msgr2=0x7fbfa411c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.247+0000 7fbfab2c0640 1 --2- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbfa40a0230 0x7fbfa411c320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf94031000 tx=0x7fbf94032000 comp rx=0 tx=0).stop 2024-09-13T18:40:35.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.247+0000 7fbfab2c0640 1 -- 172.21.15.97:0/1064321428 shutdown_connections 2024-09-13T18:40:35.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.247+0000 7fbfab2c0640 1 --2- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfa40a1320 0x7fbfa413e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.247+0000 7fbfab2c0640 1 --2- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbfa40a0230 0x7fbfa411c320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.247+0000 7fbfab2c0640 1 --2- 172.21.15.97:0/1064321428 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbfa409e740 0x7fbfa411bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.247+0000 7fbfab2c0640 1 -- 172.21.15.97:0/1064321428 >> 172.21.15.97:0/1064321428 conn(0x7fbfa40a0840 msgr2=0x7fbfa412e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:35.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.247+0000 7fbfab2c0640 1 -- 172.21.15.97:0/1064321428 shutdown_connections 2024-09-13T18:40:35.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.247+0000 7fbfab2c0640 1 -- 172.21.15.97:0/1064321428 wait complete. 2024-09-13T18:40:35.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705685 got 38654705684 for osd.1 2024-09-13T18:40:35.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705686 got 38654705685 for osd.3 2024-09-13T18:40:35.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705686 got 38654705685 for osd.0 2024-09-13T18:40:35.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.264+0000 7fe83555d640 1 -- 172.21.15.97:0/190235378 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe83008b7d0 con 0x7fe8300976c0 2024-09-13T18:40:35.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.264+0000 7fe816ffd640 1 -- 172.21.15.97:0/190235378 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe824025350 con 0x7fe8300976c0 2024-09-13T18:40:35.267 INFO:teuthology.orchestra.run.smithi097.stdout:38654705686 2024-09-13T18:40:35.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.266+0000 7fe83555d640 1 -- 172.21.15.97:0/190235378 >> v1:172.21.15.97:6816/34603 conn(0x7fe81c0311b0 legacy=0x7fe81c033660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.266+0000 7fe83555d640 1 -- 172.21.15.97:0/190235378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8300976c0 msgr2=0x7fe830143390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:35.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.266+0000 7fe83555d640 1 --2- 172.21.15.97:0/190235378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8300976c0 0x7fe830143390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe82400d890 tx=0x7fe824008040 comp rx=0 tx=0).stop 2024-09-13T18:40:35.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.266+0000 7fe83555d640 1 -- 172.21.15.97:0/190235378 shutdown_connections 2024-09-13T18:40:35.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.266+0000 7fe83555d640 1 --2- 172.21.15.97:0/190235378 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe830134fc0 0x7fe830088610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.266+0000 7fe83555d640 1 --2- 172.21.15.97:0/190235378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8300976c0 0x7fe830143390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.266+0000 7fe83555d640 1 --2- 172.21.15.97:0/190235378 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe83005db50 0x7fe830142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:35.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.266+0000 7fe83555d640 1 -- 172.21.15.97:0/190235378 >> 172.21.15.97:0/190235378 conn(0x7fe83009f8a0 msgr2=0x7fe8300997f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:35.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.266+0000 7fe83555d640 1 -- 172.21.15.97:0/190235378 shutdown_connections 2024-09-13T18:40:35.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:35.266+0000 7fe83555d640 1 -- 172.21.15.97:0/190235378 wait complete. 2024-09-13T18:40:35.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705687 got 38654705686 for osd.2 2024-09-13T18:40:36.253 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:40:36.260 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:40:36.261 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:40:36.280 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:40:36.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.357+0000 7f0eba234640 1 Processor -- start 2024-09-13T18:40:36.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.357+0000 7f0eba234640 1 -- start start 2024-09-13T18:40:36.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eba234640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0eb40a1320 0x7f0eb412f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eba234640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb412fad0 0x7f0eb412fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eba234640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb406a030 con 0x7f0eb409e740 2024-09-13T18:40:36.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eba234640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40a16f0 con 0x7f0eb40a1320 2024-09-13T18:40:36.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eba234640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb409fc10 con 0x7f0eb412fad0 2024-09-13T18:40:36.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eb2ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb412fad0 0x7f0eb412fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eb2ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb412fad0 0x7f0eb412fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47320/0 (socket says 172.21.15.97:47320) 2024-09-13T18:40:36.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eb37fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0eb40a1320 0x7f0eb412f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eb2ffd640 1 -- 172.21.15.97:0/697991616 learned_addr learned my addr 172.21.15.97:0/697991616 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:36.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eb37fe640 1 -- 172.21.15.97:0/697991616 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb412fad0 msgr2=0x7f0eb412fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:36.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eb37fe640 1 --2- 172.21.15.97:0/697991616 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb412fad0 0x7f0eb412fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eb37fe640 1 -- 172.21.15.97:0/697991616 >> v1:172.21.15.97:6789/0 conn(0x7f0eb409e740 legacy=0x7f0eb409ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eb37fe640 1 -- 172.21.15.97:0/697991616 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4068eb0 con 0x7f0eb40a1320 2024-09-13T18:40:36.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.358+0000 7f0eb2ffd640 1 --2- 172.21.15.97:0/697991616 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb412fad0 0x7f0eb412fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.360+0000 7f0eb37fe640 1 --2- 172.21.15.97:0/697991616 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0eb40a1320 0x7f0eb412f590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009880 tx=0x7f0ea40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12c1d1bc1a5a293c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.360+0000 7f0eb27fc640 1 -- 172.21.15.97:0/697991616 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea402ad60 con 0x7f0eb40a1320 2024-09-13T18:40:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.360+0000 7f0eb27fc640 1 -- 172.21.15.97:0/697991616 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea4032440 con 0x7f0eb40a1320 2024-09-13T18:40:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.360+0000 7f0eb27fc640 1 -- 172.21.15.97:0/697991616 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4032820 con 0x7f0eb40a1320 2024-09-13T18:40:36.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.361+0000 7f0eba234640 1 -- 172.21.15.97:0/697991616 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0eb40a1320 msgr2=0x7f0eb412f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.361+0000 7f0eba234640 1 --2- 172.21.15.97:0/697991616 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0eb40a1320 0x7f0eb412f590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009880 tx=0x7f0ea40090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.361+0000 7f0eba234640 1 -- 172.21.15.97:0/697991616 shutdown_connections 2024-09-13T18:40:36.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.361+0000 7f0eba234640 1 --2- 172.21.15.97:0/697991616 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb412fad0 0x7f0eb412fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.361+0000 7f0eba234640 1 --2- 172.21.15.97:0/697991616 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0eb40a1320 0x7f0eb412f590 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.361+0000 7f0eba234640 1 -- 172.21.15.97:0/697991616 >> 172.21.15.97:0/697991616 conn(0x7f0eb40a0840 msgr2=0x7f0eb40a0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:36.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.361+0000 7f0eba234640 1 -- 172.21.15.97:0/697991616 shutdown_connections 2024-09-13T18:40:36.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.361+0000 7f0eba234640 1 -- 172.21.15.97:0/697991616 wait complete. 2024-09-13T18:40:36.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.362+0000 7f0eba234640 1 Processor -- start 2024-09-13T18:40:36.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.362+0000 7f0eba234640 1 -- start start 2024-09-13T18:40:36.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.363+0000 7f0eba234640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb409e740 0x7f0eb412c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.363+0000 7f0eba234640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0eb40a1320 0x7f0eb41186c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.363+0000 7f0eba234640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0eb412fad0 0x7f0eb4118c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.363+0000 7f0eba234640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb411c130 con 0x7f0eb412fad0 2024-09-13T18:40:36.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.363+0000 7f0eba234640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb411a290 con 0x7f0eb40a1320 2024-09-13T18:40:36.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.363+0000 7f0eba234640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb412eaf0 con 0x7f0eb409e740 2024-09-13T18:40:36.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.363+0000 7f0eb37fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb409e740 0x7f0eb412c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.363+0000 7f0eb37fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb409e740 0x7f0eb412c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47328/0 (socket says 172.21.15.97:47328) 2024-09-13T18:40:36.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.363+0000 7f0eb2ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0eb40a1320 0x7f0eb41186c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.363+0000 7f0eb37fe640 1 -- 172.21.15.97:0/2879901603 learned_addr learned my addr 172.21.15.97:0/2879901603 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:36.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.363+0000 7f0eb3fff640 1 --2- 172.21.15.97:0/2879901603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0eb412fad0 0x7f0eb4118c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.364+0000 7f0eb37fe640 1 -- 172.21.15.97:0/2879901603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0eb40a1320 msgr2=0x7f0eb41186c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.364+0000 7f0eb37fe640 1 --2- 172.21.15.97:0/2879901603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0eb40a1320 0x7f0eb41186c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.364+0000 7f0eb37fe640 1 -- 172.21.15.97:0/2879901603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0eb412fad0 msgr2=0x7f0eb4118c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.364+0000 7f0eb37fe640 1 --2- 172.21.15.97:0/2879901603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0eb412fad0 0x7f0eb4118c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.364+0000 7f0eb37fe640 1 -- 172.21.15.97:0/2879901603 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea8009450 con 0x7f0eb409e740 2024-09-13T18:40:36.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.364+0000 7f0eb3fff640 1 --2- 172.21.15.97:0/2879901603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0eb412fad0 0x7f0eb4118c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:36.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.364+0000 7f0eb2ffd640 1 --2- 172.21.15.97:0/2879901603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0eb40a1320 0x7f0eb41186c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:36.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.364+0000 7f0eb37fe640 1 --2- 172.21.15.97:0/2879901603 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb409e740 0x7f0eb412c690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009360 tx=0x7f0ea4032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:36.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.364+0000 7f0e9b7fe640 1 -- 172.21.15.97:0/2879901603 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4031d20 con 0x7f0eb409e740 2024-09-13T18:40:36.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.364+0000 7f0e9b7fe640 1 -- 172.21.15.97:0/2879901603 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea4031e80 con 0x7f0eb409e740 2024-09-13T18:40:36.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.364+0000 7f0eba234640 1 -- 172.21.15.97:0/2879901603 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea4009390 con 0x7f0eb409e740 2024-09-13T18:40:36.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.364+0000 7f0e9b7fe640 1 -- 172.21.15.97:0/2879901603 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea403d690 con 0x7f0eb409e740 2024-09-13T18:40:36.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.364+0000 7f0eba234640 1 -- 172.21.15.97:0/2879901603 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb411c7f0 con 0x7f0eb409e740 2024-09-13T18:40:36.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.365+0000 7f0e9b7fe640 1 -- 172.21.15.97:0/2879901603 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f0ea4039040 con 0x7f0eb409e740 2024-09-13T18:40:36.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.366+0000 7f0eba234640 1 -- 172.21.15.97:0/2879901603 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb4064000 con 0x7f0eb409e740 2024-09-13T18:40:36.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.366+0000 7f0e9b7fe640 1 -- 172.21.15.97:0/2879901603 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f0ea40622c0 con 0x7f0eb409e740 2024-09-13T18:40:36.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.371+0000 7f0e9b7fe640 1 -- 172.21.15.97:0/2879901603 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f0ea402f4d0 con 0x7f0eb409e740 2024-09-13T18:40:36.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.397+0000 7f27bbd9d640 1 Processor -- start 2024-09-13T18:40:36.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.397+0000 7ff5a566f640 1 Processor -- start 2024-09-13T18:40:36.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.397+0000 7f8839ea8640 1 Processor -- start 2024-09-13T18:40:36.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.397+0000 7ff5a566f640 1 -- start start 2024-09-13T18:40:36.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.397+0000 7f8839ea8640 1 -- start start 2024-09-13T18:40:36.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.397+0000 7f27bbd9d640 1 -- start start 2024-09-13T18:40:36.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7ff5a566f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff5a009e630 0x7ff5a00991c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f27bbd9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f27b409de70 0x7f27b4134720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f27bbd9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27b4134c60 0x7f27b4137040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f8839ea8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8834130490 0x7f8834132870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f8839ea8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8834132db0 0x7f8834135190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f8839ea8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883409cca0 con 0x7f883409cea0 2024-09-13T18:40:36.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f8839ea8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883409cac0 con 0x7f8834130490 2024-09-13T18:40:36.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f8839ea8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f883406a350 con 0x7f8834132db0 2024-09-13T18:40:36.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f8832ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8834130490 0x7f8834132870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7ff5a566f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5a0099700 0x7ff5a012c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7ff5a566f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ff5a012c590 0x7ff5a012ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7ff5a566f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a009efe0 con 0x7ff5a009e630 2024-09-13T18:40:36.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7ff5a566f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0099ad0 con 0x7ff5a0099700 2024-09-13T18:40:36.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7ff5a566f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0096a10 con 0x7ff5a012c590 2024-09-13T18:40:36.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f8832ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8834130490 0x7f8834132870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36548/0 (socket says 172.21.15.97:36548) 2024-09-13T18:40:36.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f8832ffd640 1 -- 172.21.15.97:0/2449024238 learned_addr learned my addr 172.21.15.97:0/2449024238 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:36.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f8833fff640 1 --2- 172.21.15.97:0/2449024238 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8834132db0 0x7f8834135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f27b9b39640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f27b4068970 0x7f27b409d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54520/0 (socket says 172.21.15.97:54520) 2024-09-13T18:40:36.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f27ba33a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27b4134c60 0x7f27b4137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7ff59effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff5a009e630 0x7ff5a00991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7ff59effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff5a009e630 0x7ff5a00991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36550/0 (socket says 172.21.15.97:36550) 2024-09-13T18:40:36.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7ff59effd640 1 -- 172.21.15.97:0/2330827034 learned_addr learned my addr 172.21.15.97:0/2330827034 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:36.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f27b9338640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f27b409de70 0x7f27b4134720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f27b9338640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f27b409de70 0x7f27b4134720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47344/0 (socket says 172.21.15.97:47344) 2024-09-13T18:40:36.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7ff59e7fc640 1 --2- 172.21.15.97:0/2330827034 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5a0099700 0x7ff5a012c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7ff59f7fe640 1 --2- 172.21.15.97:0/2330827034 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ff5a012c590 0x7ff5a012ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7ff59effd640 1 -- 172.21.15.97:0/2330827034 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ff5a012c590 msgr2=0x7ff5a012ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:36.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7ff59effd640 1 --2- 172.21.15.97:0/2330827034 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ff5a012c590 0x7ff5a012ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7ff59effd640 1 -- 172.21.15.97:0/2330827034 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5a0099700 msgr2=0x7ff5a012c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:36.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7ff59effd640 1 --2- 172.21.15.97:0/2330827034 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5a0099700 0x7ff5a012c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7ff59effd640 1 -- 172.21.15.97:0/2330827034 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0097890 con 0x7ff5a009e630 2024-09-13T18:40:36.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f27b9b39640 1 -- 172.21.15.97:0/367852202 learned_addr learned my addr 172.21.15.97:0/367852202 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:40:36.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f27bbd9d640 1 -- 172.21.15.97:0/367852202 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b4097480 con 0x7f27b4068970 2024-09-13T18:40:36.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f27bbd9d640 1 -- 172.21.15.97:0/367852202 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b4068d40 con 0x7f27b4134c60 2024-09-13T18:40:36.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.398+0000 7f27bbd9d640 1 -- 172.21.15.97:0/367852202 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27b409ce70 con 0x7f27b409de70 2024-09-13T18:40:36.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7f8832ffd640 1 -- 172.21.15.97:0/2449024238 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8834132db0 msgr2=0x7f8834135190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:36.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7f88327fc640 1 -- 172.21.15.97:0/2449024238 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354338803 0 0) 0x7f883409cca0 con 0x7f883409cea0 2024-09-13T18:40:36.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7f8832ffd640 1 --2- 172.21.15.97:0/2449024238 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8834132db0 0x7f8834135190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7f27b8b37640 1 -- 172.21.15.97:0/367852202 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282571711 0 0) 0x7f27b4097480 con 0x7f27b4068970 2024-09-13T18:40:36.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7f27b8b37640 1 -- 172.21.15.97:0/367852202 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27a00034e0 con 0x7f27b4068970 2024-09-13T18:40:36.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7f27ba33a640 1 -- 172.21.15.97:0/367852202 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f27b409de70 msgr2=0x7f27b4134720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:36.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7f27ba33a640 1 --2- 172.21.15.97:0/367852202 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f27b409de70 0x7f27b4134720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7f27ba33a640 1 -- 172.21.15.97:0/367852202 >> v1:172.21.15.97:6789/0 conn(0x7f27b4068970 legacy=0x7f27b409d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7f27ba33a640 1 -- 172.21.15.97:0/367852202 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40692b0 con 0x7f27b4134c60 2024-09-13T18:40:36.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7f8832ffd640 1 -- 172.21.15.97:0/2449024238 >> v1:172.21.15.97:6789/0 conn(0x7f883409cea0 legacy=0x7f883409d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7f8832ffd640 1 -- 172.21.15.97:0/2449024238 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883406e930 con 0x7f8834130490 2024-09-13T18:40:36.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7f8833fff640 1 --2- 172.21.15.97:0/2449024238 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8834132db0 0x7f8834135190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:36.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.399+0000 7ff59f7fe640 1 --2- 172.21.15.97:0/2330827034 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ff5a012c590 0x7ff5a012ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:36.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.400+0000 7ff59effd640 1 --2- 172.21.15.97:0/2330827034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5a009e630 0x7ff5a00991c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff59000bbc0 tx=0x7ff59000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d79ce81da2d38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:36.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.400+0000 7f8832ffd640 1 --2- 172.21.15.97:0/2449024238 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8834130490 0x7f8834132870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8828009910 tx=0x7f88280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ea6b3b8aa5397d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:36.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.400+0000 7f27ba33a640 1 --2- 172.21.15.97:0/367852202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27b4134c60 0x7f27b4137040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f27b4069440 tx=0x7f27ac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33ad774bb4311847 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:36.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.400+0000 7ff59dffb640 1 -- 172.21.15.97:0/2330827034 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590032590 con 0x7ff5a009e630 2024-09-13T18:40:36.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.400+0000 7f88327fc640 1 -- 172.21.15.97:0/2449024238 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882802ad20 con 0x7f8834130490 2024-09-13T18:40:36.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.400+0000 7f88327fc640 1 -- 172.21.15.97:0/2449024238 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882802ae80 con 0x7f8834130490 2024-09-13T18:40:36.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.400+0000 7ff59dffb640 1 -- 172.21.15.97:0/2330827034 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5900326f0 con 0x7ff5a009e630 2024-09-13T18:40:36.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.400+0000 7f88327fc640 1 -- 172.21.15.97:0/2449024238 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828032670 con 0x7f8834130490 2024-09-13T18:40:36.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.400+0000 7ff59dffb640 1 -- 172.21.15.97:0/2330827034 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590032a90 con 0x7ff5a009e630 2024-09-13T18:40:36.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.400+0000 7f27b8b37640 1 -- 172.21.15.97:0/367852202 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac031400 con 0x7f27b4134c60 2024-09-13T18:40:36.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.400+0000 7f27b8b37640 1 -- 172.21.15.97:0/367852202 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac02d050 con 0x7f27b4134c60 2024-09-13T18:40:36.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.400+0000 7f27b8b37640 1 -- 172.21.15.97:0/367852202 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0317d0 con 0x7f27b4134c60 2024-09-13T18:40:36.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7ff5a566f640 1 -- 172.21.15.97:0/2330827034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5a009e630 msgr2=0x7ff5a00991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7ff5a566f640 1 --2- 172.21.15.97:0/2330827034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5a009e630 0x7ff5a00991c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff59000bbc0 tx=0x7ff59000b460 comp rx=0 tx=0).stop 2024-09-13T18:40:36.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f8839ea8640 1 -- 172.21.15.97:0/2449024238 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8834130490 msgr2=0x7f8834132870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7ff5a566f640 1 -- 172.21.15.97:0/2330827034 shutdown_connections 2024-09-13T18:40:36.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7ff5a566f640 1 --2- 172.21.15.97:0/2330827034 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ff5a012c590 0x7ff5a012ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7ff5a566f640 1 --2- 172.21.15.97:0/2330827034 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5a0099700 0x7ff5a012c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f8839ea8640 1 --2- 172.21.15.97:0/2449024238 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8834130490 0x7f8834132870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8828009910 tx=0x7f88280091d0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7ff5a566f640 1 --2- 172.21.15.97:0/2330827034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5a009e630 0x7ff5a00991c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7ff5a566f640 1 -- 172.21.15.97:0/2330827034 >> 172.21.15.97:0/2330827034 conn(0x7ff5a005e5d0 msgr2=0x7ff5a009f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:36.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f27bbd9d640 1 -- 172.21.15.97:0/367852202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27b4134c60 msgr2=0x7f27b4137040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f27bbd9d640 1 --2- 172.21.15.97:0/367852202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27b4134c60 0x7f27b4137040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f27b4069440 tx=0x7f27ac009780 comp rx=0 tx=0).stop 2024-09-13T18:40:36.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f8839ea8640 1 -- 172.21.15.97:0/2449024238 shutdown_connections 2024-09-13T18:40:36.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f8839ea8640 1 --2- 172.21.15.97:0/2449024238 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8834130490 0x7f8834132870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f8839ea8640 1 --2- 172.21.15.97:0/2449024238 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8834132db0 0x7f8834135190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f8839ea8640 1 -- 172.21.15.97:0/2449024238 >> 172.21.15.97:0/2449024238 conn(0x7f883409b200 msgr2=0x7f883409b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:36.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f27bbd9d640 1 -- 172.21.15.97:0/367852202 shutdown_connections 2024-09-13T18:40:36.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f27bbd9d640 1 --2- 172.21.15.97:0/367852202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27b4134c60 0x7f27b4137040 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f27bbd9d640 1 --2- 172.21.15.97:0/367852202 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f27b409de70 0x7f27b4134720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7ff5a566f640 1 -- 172.21.15.97:0/2330827034 shutdown_connections 2024-09-13T18:40:36.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7ff5a566f640 1 -- 172.21.15.97:0/2330827034 wait complete. 2024-09-13T18:40:36.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f27bbd9d640 1 -- 172.21.15.97:0/367852202 >> 172.21.15.97:0/367852202 conn(0x7f27b406ef20 msgr2=0x7f27b40a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:36.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f8839ea8640 1 -- 172.21.15.97:0/2449024238 shutdown_connections 2024-09-13T18:40:36.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f27bbd9d640 1 -- 172.21.15.97:0/367852202 shutdown_connections 2024-09-13T18:40:36.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.401+0000 7f27bbd9d640 1 -- 172.21.15.97:0/367852202 wait complete. 2024-09-13T18:40:36.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.402+0000 7f8839ea8640 1 -- 172.21.15.97:0/2449024238 wait complete. 2024-09-13T18:40:36.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.402+0000 7ff5a566f640 1 Processor -- start 2024-09-13T18:40:36.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.402+0000 7ff5a566f640 1 -- start start 2024-09-13T18:40:36.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.402+0000 7f27bbd9d640 1 Processor -- start 2024-09-13T18:40:36.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.402+0000 7f27bbd9d640 1 -- start start 2024-09-13T18:40:36.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f8839ea8640 1 Processor -- start 2024-09-13T18:40:36.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff5a566f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5a0099700 0x7ff5a013eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff5a566f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5a012c590 0x7ff5a013f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27bbd9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27b4068970 0x7f27b4099e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff5a566f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ff5a013f5a0 0x7ff5a0128eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27bbd9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f27b409de70 0x7f27b409a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27bbd9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27b4134c60 0x7f27b409a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27bbd9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b406e690 con 0x7f27b4068970 2024-09-13T18:40:36.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27bbd9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b40a1c00 con 0x7f27b4134c60 2024-09-13T18:40:36.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27bbd9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27b406a8d0 con 0x7f27b409de70 2024-09-13T18:40:36.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27b9338640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f27b409de70 0x7f27b409a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff5a566f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0130780 con 0x7ff5a0099700 2024-09-13T18:40:36.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff5a566f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0130b40 con 0x7ff5a012c590 2024-09-13T18:40:36.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff59e7fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5a012c590 0x7ff5a013f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff5a566f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0131580 con 0x7ff5a013f5a0 2024-09-13T18:40:36.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27b9b39640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27b4068970 0x7f27b4099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27b9338640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f27b409de70 0x7f27b409a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47358/0 (socket says 172.21.15.97:47358) 2024-09-13T18:40:36.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27b9338640 1 -- 172.21.15.97:0/1375716879 learned_addr learned my addr 172.21.15.97:0/1375716879 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:36.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff59f7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ff5a013f5a0 0x7ff5a0128eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27ba33a640 1 --2- 172.21.15.97:0/1375716879 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27b4134c60 0x7f27b409a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff59e7fc640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5a012c590 0x7ff5a013f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:52440/0 (socket says 172.21.15.97:52440) 2024-09-13T18:40:36.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff59f7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ff5a013f5a0 0x7ff5a0128eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47368/0 (socket says 172.21.15.97:47368) 2024-09-13T18:40:36.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff59e7fc640 1 -- 172.21.15.97:0/3162882077 learned_addr learned my addr 172.21.15.97:0/3162882077 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:36.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff59e7fc640 1 -- 172.21.15.97:0/3162882077 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ff5a013f5a0 msgr2=0x7ff5a0128eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff59effd640 1 --2- 172.21.15.97:0/3162882077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5a0099700 0x7ff5a013eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27ba33a640 1 -- 172.21.15.97:0/1375716879 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f27b409de70 msgr2=0x7f27b409a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27ba33a640 1 --2- 172.21.15.97:0/1375716879 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f27b409de70 0x7f27b409a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27ba33a640 1 -- 172.21.15.97:0/1375716879 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27b4068970 msgr2=0x7f27b4099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27ba33a640 1 --2- 172.21.15.97:0/1375716879 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27b4068970 0x7f27b4099e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff59e7fc640 1 --2- 172.21.15.97:0/3162882077 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ff5a013f5a0 0x7ff5a0128eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27ba33a640 1 -- 172.21.15.97:0/1375716879 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac009a20 con 0x7f27b4134c60 2024-09-13T18:40:36.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff59e7fc640 1 -- 172.21.15.97:0/3162882077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5a0099700 msgr2=0x7ff5a013eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff59e7fc640 1 --2- 172.21.15.97:0/3162882077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5a0099700 0x7ff5a013eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f27b9b39640 1 --2- 172.21.15.97:0/1375716879 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27b4068970 0x7f27b4099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:36.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7f8839ea8640 1 -- start start 2024-09-13T18:40:36.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.403+0000 7ff59e7fc640 1 -- 172.21.15.97:0/3162882077 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59000b700 con 0x7ff5a012c590 2024-09-13T18:40:36.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f27ba33a640 1 --2- 172.21.15.97:0/1375716879 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27b4134c60 0x7f27b409a8d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f27ac031000 tx=0x7f27ac037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:36.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7ff59e7fc640 1 --2- 172.21.15.97:0/3162882077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5a012c590 0x7ff5a013f060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff59400ea50 tx=0x7ff5940090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:36.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f27a9ffb640 1 -- 172.21.15.97:0/1375716879 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac03baf0 con 0x7f27b4134c60 2024-09-13T18:40:36.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7ff59effd640 1 --2- 172.21.15.97:0/3162882077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5a0099700 0x7ff5a013eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:36.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7ff59f7fe640 1 --2- 172.21.15.97:0/3162882077 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ff5a013f5a0 0x7ff5a0128eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:36.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7ff586ffd640 1 -- 172.21.15.97:0/3162882077 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400ca10 con 0x7ff5a012c590 2024-09-13T18:40:36.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f27a9ffb640 1 -- 172.21.15.97:0/1375716879 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac040070 con 0x7f27b4134c60 2024-09-13T18:40:36.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f27a9ffb640 1 -- 172.21.15.97:0/1375716879 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac047480 con 0x7f27b4134c60 2024-09-13T18:40:36.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7ff586ffd640 1 -- 172.21.15.97:0/3162882077 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59400cb70 con 0x7ff5a012c590 2024-09-13T18:40:36.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7ff586ffd640 1 -- 172.21.15.97:0/3162882077 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594013470 con 0x7ff5a012c590 2024-09-13T18:40:36.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f27bbd9d640 1 -- 172.21.15.97:0/1375716879 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b406afe0 con 0x7f27b4134c60 2024-09-13T18:40:36.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f8839ea8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f883409cea0 0x7f8834133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f8839ea8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8834130490 0x7f8834134210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f8839ea8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8834132db0 0x7f8834134750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f88337fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f883409cea0 0x7f8834133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f8839ea8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834069a80 con 0x7f883409cea0 2024-09-13T18:40:36.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f88337fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f883409cea0 0x7f8834133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36570/0 (socket says 172.21.15.97:36570) 2024-09-13T18:40:36.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f88337fe640 1 -- 172.21.15.97:0/2374638449 learned_addr learned my addr 172.21.15.97:0/2374638449 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:36.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f8839ea8640 1 -- 172.21.15.97:0/2374638449 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883411f090 con 0x7f8834130490 2024-09-13T18:40:36.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f8833fff640 1 --2- 172.21.15.97:0/2374638449 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8834132db0 0x7f8834134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f27bbd9d640 1 -- 172.21.15.97:0/1375716879 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b406bcd0 con 0x7f27b4134c60 2024-09-13T18:40:36.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f8839ea8640 1 -- 172.21.15.97:0/2374638449 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8834132880 con 0x7f8834132db0 2024-09-13T18:40:36.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7ff5a566f640 1 -- 172.21.15.97:0/3162882077 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a0096e90 con 0x7ff5a012c590 2024-09-13T18:40:36.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.405+0000 7ff5a566f640 1 -- 172.21.15.97:0/3162882077 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a0132230 con 0x7ff5a012c590 2024-09-13T18:40:36.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.404+0000 7f8832ffd640 1 --2- 172.21.15.97:0/2374638449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8834130490 0x7f8834134210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.405+0000 7f88337fe640 1 -- 172.21.15.97:0/2374638449 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8834132db0 msgr2=0x7f8834134750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.405+0000 7f88337fe640 1 --2- 172.21.15.97:0/2374638449 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8834132db0 0x7f8834134750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.405+0000 7f88337fe640 1 -- 172.21.15.97:0/2374638449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8834130490 msgr2=0x7f8834134210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.405+0000 7f88337fe640 1 --2- 172.21.15.97:0/2374638449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8834130490 0x7f8834134210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.405+0000 7f88337fe640 1 -- 172.21.15.97:0/2374638449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c009a20 con 0x7f883409cea0 2024-09-13T18:40:36.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.405+0000 7f88337fe640 1 --2- 172.21.15.97:0/2374638449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f883409cea0 0x7f8834133cd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f88240011e0 tx=0x7f8824007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:36.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.405+0000 7f881b7fe640 1 -- 172.21.15.97:0/2374638449 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824011590 con 0x7f883409cea0 2024-09-13T18:40:36.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.405+0000 7f881b7fe640 1 -- 172.21.15.97:0/2374638449 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88240116f0 con 0x7f883409cea0 2024-09-13T18:40:36.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.405+0000 7f881b7fe640 1 -- 172.21.15.97:0/2374638449 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824011a70 con 0x7f883409cea0 2024-09-13T18:40:36.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.406+0000 7f8839ea8640 1 -- 172.21.15.97:0/2374638449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8828009450 con 0x7f883409cea0 2024-09-13T18:40:36.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.406+0000 7f8839ea8640 1 -- 172.21.15.97:0/2374638449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883411e780 con 0x7f883409cea0 2024-09-13T18:40:36.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.406+0000 7ff586ffd640 1 -- 172.21.15.97:0/3162882077 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7ff594013820 con 0x7ff5a012c590 2024-09-13T18:40:36.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.406+0000 7f27a9ffb640 1 -- 172.21.15.97:0/1375716879 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f27ac047830 con 0x7f27b4134c60 2024-09-13T18:40:36.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.406+0000 7f27a9ffb640 1 -- 172.21.15.97:0/1375716879 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f27ac042070 con 0x7f27b4134c60 2024-09-13T18:40:36.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.406+0000 7ff5a566f640 1 -- 172.21.15.97:0/3162882077 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a0064600 con 0x7ff5a012c590 2024-09-13T18:40:36.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.406+0000 7ff586ffd640 1 -- 172.21.15.97:0/3162882077 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7ff594013ad0 con 0x7ff5a012c590 2024-09-13T18:40:36.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.407+0000 7f881b7fe640 1 -- 172.21.15.97:0/2374638449 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f8824012420 con 0x7f883409cea0 2024-09-13T18:40:36.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.407+0000 7f881b7fe640 1 -- 172.21.15.97:0/2374638449 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f88240416d0 con 0x7f883409cea0 2024-09-13T18:40:36.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.407+0000 7f27bbd9d640 1 -- 172.21.15.97:0/1375716879 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b4064000 con 0x7f27b4134c60 2024-09-13T18:40:36.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.407+0000 7f8839ea8640 1 -- 172.21.15.97:0/2374638449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8834064000 con 0x7f883409cea0 2024-09-13T18:40:36.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.412+0000 7f881b7fe640 1 -- 172.21.15.97:0/2374638449 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f8824017080 con 0x7f883409cea0 2024-09-13T18:40:36.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.415+0000 7ff586ffd640 1 -- 172.21.15.97:0/3162882077 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7ff5940128b0 con 0x7ff5a012c590 2024-09-13T18:40:36.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.424+0000 7f27a9ffb640 1 -- 172.21.15.97:0/1375716879 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f27ac038530 con 0x7f27b4134c60 2024-09-13T18:40:36.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.541+0000 7f0eba234640 1 -- 172.21.15.97:0/2879901603 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0eb411bbf0 con 0x7f0eb409e740 2024-09-13T18:40:36.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.541+0000 7f0e9b7fe640 1 -- 172.21.15.97:0/2879901603 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0eb411bbf0 con 0x7f0eb409e740 2024-09-13T18:40:36.544 INFO:teuthology.orchestra.run.smithi097.stdout:38654705685 2024-09-13T18:40:36.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.543+0000 7f0eba234640 1 -- 172.21.15.97:0/2879901603 >> v1:172.21.15.97:6816/34603 conn(0x7f0ea0031190 legacy=0x7f0ea0033640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.543+0000 7f0eba234640 1 -- 172.21.15.97:0/2879901603 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb409e740 msgr2=0x7f0eb412c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.543+0000 7f0eba234640 1 --2- 172.21.15.97:0/2879901603 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb409e740 0x7f0eb412c690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009360 tx=0x7f0ea4032000 comp rx=0 tx=0).stop 2024-09-13T18:40:36.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.543+0000 7f0eba234640 1 -- 172.21.15.97:0/2879901603 shutdown_connections 2024-09-13T18:40:36.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.543+0000 7f0eba234640 1 --2- 172.21.15.97:0/2879901603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0eb412fad0 0x7f0eb4118c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.543+0000 7f0eba234640 1 --2- 172.21.15.97:0/2879901603 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0eb40a1320 0x7f0eb41186c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.543+0000 7f0eba234640 1 --2- 172.21.15.97:0/2879901603 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0eb409e740 0x7f0eb412c690 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.543+0000 7f0eba234640 1 -- 172.21.15.97:0/2879901603 >> 172.21.15.97:0/2879901603 conn(0x7f0eb40a0840 msgr2=0x7f0eb4132520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:36.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.543+0000 7f0eba234640 1 -- 172.21.15.97:0/2879901603 shutdown_connections 2024-09-13T18:40:36.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.543+0000 7f0eba234640 1 -- 172.21.15.97:0/2879901603 wait complete. 2024-09-13T18:40:36.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705685 got 38654705685 for osd.1 2024-09-13T18:40:36.557 DEBUG:teuthology.parallel:result is None 2024-09-13T18:40:36.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.574+0000 7ff5a566f640 1 -- 172.21.15.97:0/3162882077 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff5a012ac90 con 0x7ff5a012c590 2024-09-13T18:40:36.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.574+0000 7ff586ffd640 1 -- 172.21.15.97:0/3162882077 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff5940128b0 con 0x7ff5a012c590 2024-09-13T18:40:36.577 INFO:teuthology.orchestra.run.smithi097.stdout:38654705686 2024-09-13T18:40:36.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.576+0000 7ff5a566f640 1 -- 172.21.15.97:0/3162882077 >> v1:172.21.15.97:6816/34603 conn(0x7ff58c031160 legacy=0x7ff58c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.576+0000 7ff5a566f640 1 -- 172.21.15.97:0/3162882077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5a012c590 msgr2=0x7ff5a013f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.576+0000 7ff5a566f640 1 --2- 172.21.15.97:0/3162882077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5a012c590 0x7ff5a013f060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff59400ea50 tx=0x7ff5940090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.576+0000 7ff5a566f640 1 -- 172.21.15.97:0/3162882077 shutdown_connections 2024-09-13T18:40:36.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.576+0000 7ff5a566f640 1 --2- 172.21.15.97:0/3162882077 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7ff5a013f5a0 0x7ff5a0128eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.576+0000 7ff5a566f640 1 --2- 172.21.15.97:0/3162882077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7ff5a012c590 0x7ff5a013f060 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.576+0000 7ff5a566f640 1 --2- 172.21.15.97:0/3162882077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5a0099700 0x7ff5a013eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.576+0000 7ff5a566f640 1 -- 172.21.15.97:0/3162882077 >> 172.21.15.97:0/3162882077 conn(0x7ff5a005e5d0 msgr2=0x7ff5a009c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:36.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.576+0000 7ff5a566f640 1 -- 172.21.15.97:0/3162882077 shutdown_connections 2024-09-13T18:40:36.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.576+0000 7ff5a566f640 1 -- 172.21.15.97:0/3162882077 wait complete. 2024-09-13T18:40:36.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705686 got 38654705686 for osd.0 2024-09-13T18:40:36.590 DEBUG:teuthology.parallel:result is None 2024-09-13T18:40:36.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.626+0000 7f8839ea8640 1 -- 172.21.15.97:0/2374638449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f883406e500 con 0x7f883409cea0 2024-09-13T18:40:36.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.626+0000 7f881b7fe640 1 -- 172.21.15.97:0/2374638449 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8824018260 con 0x7f883409cea0 2024-09-13T18:40:36.629 INFO:teuthology.orchestra.run.smithi097.stdout:38654705686 2024-09-13T18:40:36.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.628+0000 7f8839ea8640 1 -- 172.21.15.97:0/2374638449 >> v1:172.21.15.97:6816/34603 conn(0x7f8820031160 legacy=0x7f8820033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.628+0000 7f8839ea8640 1 -- 172.21.15.97:0/2374638449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f883409cea0 msgr2=0x7f8834133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.628+0000 7f8839ea8640 1 --2- 172.21.15.97:0/2374638449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f883409cea0 0x7f8834133cd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f88240011e0 tx=0x7f8824007d10 comp rx=0 tx=0).stop 2024-09-13T18:40:36.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.628+0000 7f8839ea8640 1 -- 172.21.15.97:0/2374638449 shutdown_connections 2024-09-13T18:40:36.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.628+0000 7f8839ea8640 1 --2- 172.21.15.97:0/2374638449 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8834132db0 0x7f8834134750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.628+0000 7f8839ea8640 1 --2- 172.21.15.97:0/2374638449 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8834130490 0x7f8834134210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.628+0000 7f8839ea8640 1 --2- 172.21.15.97:0/2374638449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f883409cea0 0x7f8834133cd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.628+0000 7f8839ea8640 1 -- 172.21.15.97:0/2374638449 >> 172.21.15.97:0/2374638449 conn(0x7f883409b200 msgr2=0x7f8834099170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:36.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.628+0000 7f8839ea8640 1 -- 172.21.15.97:0/2374638449 shutdown_connections 2024-09-13T18:40:36.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.628+0000 7f8839ea8640 1 -- 172.21.15.97:0/2374638449 wait complete. 2024-09-13T18:40:36.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.638+0000 7f27bbd9d640 1 -- 172.21.15.97:0/1375716879 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f27b4133b50 con 0x7f27b4134c60 2024-09-13T18:40:36.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705686 got 38654705686 for osd.3 2024-09-13T18:40:36.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.638+0000 7f27a9ffb640 1 -- 172.21.15.97:0/1375716879 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27ac045b70 con 0x7f27b4134c60 2024-09-13T18:40:36.642 INFO:teuthology.orchestra.run.smithi097.stdout:38654705687 2024-09-13T18:40:36.642 DEBUG:teuthology.parallel:result is None 2024-09-13T18:40:36.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.640+0000 7f27bbd9d640 1 -- 172.21.15.97:0/1375716879 >> v1:172.21.15.97:6816/34603 conn(0x7f27980311b0 legacy=0x7f2798033660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.640+0000 7f27bbd9d640 1 -- 172.21.15.97:0/1375716879 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27b4134c60 msgr2=0x7f27b409a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.640+0000 7f27bbd9d640 1 --2- 172.21.15.97:0/1375716879 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27b4134c60 0x7f27b409a8d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f27ac031000 tx=0x7f27ac037000 comp rx=0 tx=0).stop 2024-09-13T18:40:36.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.640+0000 7f27bbd9d640 1 -- 172.21.15.97:0/1375716879 shutdown_connections 2024-09-13T18:40:36.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.640+0000 7f27bbd9d640 1 --2- 172.21.15.97:0/1375716879 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f27b4134c60 0x7f27b409a8d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.640+0000 7f27bbd9d640 1 --2- 172.21.15.97:0/1375716879 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f27b409de70 0x7f27b409a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.640+0000 7f27bbd9d640 1 --2- 172.21.15.97:0/1375716879 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f27b4068970 0x7f27b4099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.640+0000 7f27bbd9d640 1 -- 172.21.15.97:0/1375716879 >> 172.21.15.97:0/1375716879 conn(0x7f27b406ef20 msgr2=0x7f27b412d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:36.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.640+0000 7f27bbd9d640 1 -- 172.21.15.97:0/1375716879 shutdown_connections 2024-09-13T18:40:36.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.640+0000 7f27bbd9d640 1 -- 172.21.15.97:0/1375716879 wait complete. 2024-09-13T18:40:36.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705687 got 38654705687 for osd.2 2024-09-13T18:40:36.653 DEBUG:teuthology.parallel:result is None 2024-09-13T18:40:36.653 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:40:36.653 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:40:36.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.787+0000 7fd7c402b640 1 Processor -- start 2024-09-13T18:40:36.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.787+0000 7fd7c402b640 1 -- start start 2024-09-13T18:40:36.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c402b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7bc097690 0x7fd7bc131350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c402b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7bc0969d0 0x7fd7bc1338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c402b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7bc06a190 con 0x7fd7bc09dfb0 2024-09-13T18:40:36.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c402b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc09e380 con 0x7fd7bc097690 2024-09-13T18:40:36.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c402b640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc098870 con 0x7fd7bc0969d0 2024-09-13T18:40:36.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c15c6640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7bc097690 0x7fd7bc131350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c25c8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7bc0969d0 0x7fd7bc1338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c1dc7640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd7bc09dfb0 0x7fd7bc096f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:54522/0 (socket says 172.21.15.97:54522) 2024-09-13T18:40:36.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c1dc7640 1 -- 172.21.15.97:0/1768512121 learned_addr learned my addr 172.21.15.97:0/1768512121 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:40:36.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c0dc5640 1 -- 172.21.15.97:0/1768512121 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3384604745 0 0) 0x7fd7bc06a190 con 0x7fd7bc09dfb0 2024-09-13T18:40:36.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c15c6640 1 -- 172.21.15.97:0/1768512121 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7bc0969d0 msgr2=0x7fd7bc1338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:36.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c15c6640 1 --2- 172.21.15.97:0/1768512121 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7bc0969d0 0x7fd7bc1338a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c15c6640 1 -- 172.21.15.97:0/1768512121 >> v1:172.21.15.97:6789/0 conn(0x7fd7bc09dfb0 legacy=0x7fd7bc096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c15c6640 1 -- 172.21.15.97:0/1768512121 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc098e10 con 0x7fd7bc097690 2024-09-13T18:40:36.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.788+0000 7fd7c25c8640 1 --2- 172.21.15.97:0/1768512121 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7bc0969d0 0x7fd7bc1338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:36.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.789+0000 7fd7c15c6640 1 --2- 172.21.15.97:0/1768512121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7bc097690 0x7fd7bc131350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009880 tx=0x7fd7ac0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c25b2a20d4ec26be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:36.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.789+0000 7fd7c0dc5640 1 -- 172.21.15.97:0/1768512121 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac02ac50 con 0x7fd7bc097690 2024-09-13T18:40:36.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.789+0000 7fd7c0dc5640 1 -- 172.21.15.97:0/1768512121 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac02adb0 con 0x7fd7bc097690 2024-09-13T18:40:36.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.789+0000 7fd7c0dc5640 1 -- 172.21.15.97:0/1768512121 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac032670 con 0x7fd7bc097690 2024-09-13T18:40:36.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.789+0000 7fd7c402b640 1 -- 172.21.15.97:0/1768512121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7bc097690 msgr2=0x7fd7bc131350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.789+0000 7fd7c402b640 1 --2- 172.21.15.97:0/1768512121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7bc097690 0x7fd7bc131350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009880 tx=0x7fd7ac0090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.789+0000 7fd7c402b640 1 -- 172.21.15.97:0/1768512121 shutdown_connections 2024-09-13T18:40:36.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.789+0000 7fd7c402b640 1 --2- 172.21.15.97:0/1768512121 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7bc097690 0x7fd7bc131350 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.789+0000 7fd7c402b640 1 --2- 172.21.15.97:0/1768512121 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7bc0969d0 0x7fd7bc1338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.789+0000 7fd7c402b640 1 -- 172.21.15.97:0/1768512121 >> 172.21.15.97:0/1768512121 conn(0x7fd7bc09b200 msgr2=0x7fd7bc09b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:36.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.790+0000 7fd7c402b640 1 -- 172.21.15.97:0/1768512121 shutdown_connections 2024-09-13T18:40:36.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.790+0000 7fd7c402b640 1 -- 172.21.15.97:0/1768512121 wait complete. 2024-09-13T18:40:36.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.790+0000 7fd7c402b640 1 Processor -- start 2024-09-13T18:40:36.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.790+0000 7fd7c402b640 1 -- start start 2024-09-13T18:40:36.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c402b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7bc0969d0 0x7fd7bc11c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c402b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7bc097690 0x7fd7bc118b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c402b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7bc09dfb0 0x7fd7bc119090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:36.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c402b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc11b830 con 0x7fd7bc097690 2024-09-13T18:40:36.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c402b640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc09a620 con 0x7fd7bc0969d0 2024-09-13T18:40:36.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c402b640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc11a6b0 con 0x7fd7bc09dfb0 2024-09-13T18:40:36.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c15c6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7bc097690 0x7fd7bc118b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c1dc7640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7bc0969d0 0x7fd7bc11c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c25c8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7bc09dfb0 0x7fd7bc119090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:36.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c15c6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7bc097690 0x7fd7bc118b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36586/0 (socket says 172.21.15.97:36586) 2024-09-13T18:40:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c15c6640 1 -- 172.21.15.97:0/1036839354 learned_addr learned my addr 172.21.15.97:0/1036839354 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c15c6640 1 -- 172.21.15.97:0/1036839354 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7bc09dfb0 msgr2=0x7fd7bc119090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c15c6640 1 --2- 172.21.15.97:0/1036839354 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7bc09dfb0 0x7fd7bc119090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c15c6640 1 -- 172.21.15.97:0/1036839354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7bc0969d0 msgr2=0x7fd7bc11c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c15c6640 1 --2- 172.21.15.97:0/1036839354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7bc0969d0 0x7fd7bc11c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c15c6640 1 -- 172.21.15.97:0/1036839354 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4009a20 con 0x7fd7bc097690 2024-09-13T18:40:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c25c8640 1 --2- 172.21.15.97:0/1036839354 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7bc09dfb0 0x7fd7bc119090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c1dc7640 1 --2- 172.21.15.97:0/1036839354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7bc0969d0 0x7fd7bc11c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c15c6640 1 --2- 172.21.15.97:0/1036839354 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7bc097690 0x7fd7bc118b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac02a650 tx=0x7fd7ac032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7b1ffb640 1 -- 172.21.15.97:0/1036839354 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac031780 con 0x7fd7bc097690 2024-09-13T18:40:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7b1ffb640 1 -- 172.21.15.97:0/1036839354 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac0318e0 con 0x7fd7bc097690 2024-09-13T18:40:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.791+0000 7fd7c402b640 1 -- 172.21.15.97:0/1036839354 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ac009390 con 0x7fd7bc097690 2024-09-13T18:40:36.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.792+0000 7fd7b1ffb640 1 -- 172.21.15.97:0/1036839354 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac031c80 con 0x7fd7bc097690 2024-09-13T18:40:36.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.792+0000 7fd7c402b640 1 -- 172.21.15.97:0/1036839354 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7bc1195d0 con 0x7fd7bc097690 2024-09-13T18:40:36.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.792+0000 7fd7b1ffb640 1 -- 172.21.15.97:0/1036839354 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fd7ac03c610 con 0x7fd7bc097690 2024-09-13T18:40:36.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.793+0000 7fd7b1ffb640 1 -- 172.21.15.97:0/1036839354 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fd7ac062670 con 0x7fd7bc097690 2024-09-13T18:40:36.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.793+0000 7fd7c402b640 1 -- 172.21.15.97:0/1036839354 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7bc1198b0 con 0x7fd7bc097690 2024-09-13T18:40:36.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.797+0000 7fd7b1ffb640 1 -- 172.21.15.97:0/1036839354 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fd7ac049080 con 0x7fd7bc097690 2024-09-13T18:40:36.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.945+0000 7fd7c402b640 1 -- 172.21.15.97:0/1036839354 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7bc11a060 con 0x7fd7a0031160 2024-09-13T18:40:36.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.952+0000 7fd7b1ffb640 1 -- 172.21.15.97:0/1036839354 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276626 (unknown 2965378022 0 251854174) 0x7fd7bc11a060 con 0x7fd7a0031160 2024-09-13T18:40:37.003 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:40:37.089 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:40:37.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.954+0000 7fd7c402b640 1 -- 172.21.15.97:0/1036839354 >> v1:172.21.15.97:6816/34603 conn(0x7fd7a0031160 legacy=0x7fd7a0033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.954+0000 7fd7c402b640 1 -- 172.21.15.97:0/1036839354 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7bc097690 msgr2=0x7fd7bc118b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.954+0000 7fd7c402b640 1 --2- 172.21.15.97:0/1036839354 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7bc097690 0x7fd7bc118b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac02a650 tx=0x7fd7ac032000 comp rx=0 tx=0).stop 2024-09-13T18:40:37.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.955+0000 7fd7c402b640 1 -- 172.21.15.97:0/1036839354 shutdown_connections 2024-09-13T18:40:37.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.955+0000 7fd7c402b640 1 --2- 172.21.15.97:0/1036839354 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd7bc09dfb0 0x7fd7bc119090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.955+0000 7fd7c402b640 1 --2- 172.21.15.97:0/1036839354 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7bc097690 0x7fd7bc118b50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.955+0000 7fd7c402b640 1 --2- 172.21.15.97:0/1036839354 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd7bc0969d0 0x7fd7bc11c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.955+0000 7fd7c402b640 1 -- 172.21.15.97:0/1036839354 >> 172.21.15.97:0/1036839354 conn(0x7fd7bc09b200 msgr2=0x7fd7bc06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:37.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.955+0000 7fd7c402b640 1 -- 172.21.15.97:0/1036839354 shutdown_connections 2024-09-13T18:40:37.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:36.955+0000 7fd7c402b640 1 -- 172.21.15.97:0/1036839354 wait complete. 2024-09-13T18:40:37.098 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-13T18:40:35.368165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594114,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":130,"num_write_kb":1125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1191440,"kb_used_data":2000,"kb_used_omap":6,"kb_used_meta":1189369,"kb_avail":376295920,"statfs":{"total":386547056640,"available":385327022080,"internally_reserved":0,"allocated":2048000,"data_stored":1460124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1217914208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003575"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660477+0000","last_change":"2024-09-13T18:39:14.592723+0000","last_active":"2024-09-13T18:39:53.660477+0000","last_peered":"2024-09-13T18:39:53.660477+0000","last_clean":"2024-09-13T18:39:53.660477+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:39:53.660477+0000","last_undegraded":"2024-09-13T18:39:53.660477+0000","last_fullsized":"2024-09-13T18:39:53.660477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:09.304808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660272+0000","last_change":"2024-09-13T18:39:14.581266+0000","last_active":"2024-09-13T18:39:53.660272+0000","last_peered":"2024-09-13T18:39:53.660272+0000","last_clean":"2024-09-13T18:39:53.660272+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:39:53.660272+0000","last_undegraded":"2024-09-13T18:39:53.660272+0000","last_fullsized":"2024-09-13T18:39:53.660272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666044+0000","last_change":"2024-09-13T18:39:14.586254+0000","last_active":"2024-09-13T18:39:53.666044+0000","last_peered":"2024-09-13T18:39:53.666044+0000","last_clean":"2024-09-13T18:39:53.666044+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:39:53.666044+0000","last_undegraded":"2024-09-13T18:39:53.666044+0000","last_fullsized":"2024-09-13T18:39:53.666044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665881+0000","last_change":"2024-09-13T18:39:14.583960+0000","last_active":"2024-09-13T18:39:53.665881+0000","last_peered":"2024-09-13T18:39:53.665881+0000","last_clean":"2024-09-13T18:39:53.665881+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:39:53.665881+0000","last_undegraded":"2024-09-13T18:39:53.665881+0000","last_fullsized":"2024-09-13T18:39:53.665881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666647+0000","last_change":"2024-09-13T18:39:14.577865+0000","last_active":"2024-09-13T18:39:53.666647+0000","last_peered":"2024-09-13T18:39:53.666647+0000","last_clean":"2024-09-13T18:39:53.666647+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:39:53.666647+0000","last_undegraded":"2024-09-13T18:39:53.666647+0000","last_fullsized":"2024-09-13T18:39:53.666647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663709+0000","last_change":"2024-09-13T18:39:14.590785+0000","last_active":"2024-09-13T18:39:53.663709+0000","last_peered":"2024-09-13T18:39:53.663709+0000","last_clean":"2024-09-13T18:39:53.663709+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:39:53.663709+0000","last_undegraded":"2024-09-13T18:39:53.663709+0000","last_fullsized":"2024-09-13T18:39:53.663709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:24.453184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662075+0000","last_change":"2024-09-13T18:39:14.590893+0000","last_active":"2024-09-13T18:39:53.662075+0000","last_peered":"2024-09-13T18:39:53.662075+0000","last_clean":"2024-09-13T18:39:53.662075+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:39:53.662075+0000","last_undegraded":"2024-09-13T18:39:53.662075+0000","last_fullsized":"2024-09-13T18:39:53.662075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:57.986187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660672+0000","last_change":"2024-09-13T18:39:14.595160+0000","last_active":"2024-09-13T18:39:53.660672+0000","last_peered":"2024-09-13T18:39:53.660672+0000","last_clean":"2024-09-13T18:39:53.660672+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:39:53.660672+0000","last_undegraded":"2024-09-13T18:39:53.660672+0000","last_fullsized":"2024-09-13T18:39:53.660672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666320+0000","last_change":"2024-09-13T18:39:14.586790+0000","last_active":"2024-09-13T18:39:53.666320+0000","last_peered":"2024-09-13T18:39:53.666320+0000","last_clean":"2024-09-13T18:39:53.666320+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:39:53.666320+0000","last_undegraded":"2024-09-13T18:39:53.666320+0000","last_fullsized":"2024-09-13T18:39:53.666320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:49.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662698+0000","last_change":"2024-09-13T18:39:14.591231+0000","last_active":"2024-09-13T18:39:53.662698+0000","last_peered":"2024-09-13T18:39:53.662698+0000","last_clean":"2024-09-13T18:39:53.662698+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:39:53.662698+0000","last_undegraded":"2024-09-13T18:39:53.662698+0000","last_fullsized":"2024-09-13T18:39:53.662698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663588+0000","last_change":"2024-09-13T18:39:14.589017+0000","last_active":"2024-09-13T18:39:53.663588+0000","last_peered":"2024-09-13T18:39:53.663588+0000","last_clean":"2024-09-13T18:39:53.663588+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:39:53.663588+0000","last_undegraded":"2024-09-13T18:39:53.663588+0000","last_fullsized":"2024-09-13T18:39:53.663588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662383+0000","last_change":"2024-09-13T18:39:14.592629+0000","last_active":"2024-09-13T18:39:53.662383+0000","last_peered":"2024-09-13T18:39:53.662383+0000","last_clean":"2024-09-13T18:39:53.662383+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:39:53.662383+0000","last_undegraded":"2024-09-13T18:39:53.662383+0000","last_fullsized":"2024-09-13T18:39:53.662383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.659836+0000","last_change":"2024-09-13T18:39:14.597709+0000","last_active":"2024-09-13T18:39:53.659836+0000","last_peered":"2024-09-13T18:39:53.659836+0000","last_clean":"2024-09-13T18:39:53.659836+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:39:53.659836+0000","last_undegraded":"2024-09-13T18:39:53.659836+0000","last_fullsized":"2024-09-13T18:39:53.659836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.367739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.659834+0000","last_change":"2024-09-13T18:39:14.572267+0000","last_active":"2024-09-13T18:39:53.659834+0000","last_peered":"2024-09-13T18:39:53.659834+0000","last_clean":"2024-09-13T18:39:53.659834+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:39:53.659834+0000","last_undegraded":"2024-09-13T18:39:53.659834+0000","last_fullsized":"2024-09-13T18:39:53.659834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665313+0000","last_change":"2024-09-13T18:39:14.583318+0000","last_active":"2024-09-13T18:39:53.665313+0000","last_peered":"2024-09-13T18:39:53.665313+0000","last_clean":"2024-09-13T18:39:53.665313+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:39:53.665313+0000","last_undegraded":"2024-09-13T18:39:53.665313+0000","last_fullsized":"2024-09-13T18:39:53.665313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660118+0000","last_change":"2024-09-13T18:39:14.592378+0000","last_active":"2024-09-13T18:39:53.660118+0000","last_peered":"2024-09-13T18:39:53.660118+0000","last_clean":"2024-09-13T18:39:53.660118+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:39:53.660118+0000","last_undegraded":"2024-09-13T18:39:53.660118+0000","last_fullsized":"2024-09-13T18:39:53.660118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:02.414361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665959+0000","last_change":"2024-09-13T18:39:14.586945+0000","last_active":"2024-09-13T18:39:53.665959+0000","last_peered":"2024-09-13T18:39:53.665959+0000","last_clean":"2024-09-13T18:39:53.665959+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:39:53.665959+0000","last_undegraded":"2024-09-13T18:39:53.665959+0000","last_fullsized":"2024-09-13T18:39:53.665959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:57.889039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666343+0000","last_change":"2024-09-13T18:39:14.587172+0000","last_active":"2024-09-13T18:39:53.666343+0000","last_peered":"2024-09-13T18:39:53.666343+0000","last_clean":"2024-09-13T18:39:53.666343+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:39:53.666343+0000","last_undegraded":"2024-09-13T18:39:53.666343+0000","last_fullsized":"2024-09-13T18:39:53.666343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660662+0000","last_change":"2024-09-13T18:39:14.594291+0000","last_active":"2024-09-13T18:39:53.660662+0000","last_peered":"2024-09-13T18:39:53.660662+0000","last_clean":"2024-09-13T18:39:53.660662+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:39:53.660662+0000","last_undegraded":"2024-09-13T18:39:53.660662+0000","last_fullsized":"2024-09-13T18:39:53.660662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:29.208875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660771+0000","last_change":"2024-09-13T18:39:14.585973+0000","last_active":"2024-09-13T18:39:53.660771+0000","last_peered":"2024-09-13T18:39:53.660771+0000","last_clean":"2024-09-13T18:39:53.660771+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:39:53.660771+0000","last_undegraded":"2024-09-13T18:39:53.660771+0000","last_fullsized":"2024-09-13T18:39:53.660771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:48.875040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660535+0000","last_change":"2024-09-13T18:39:14.595451+0000","last_active":"2024-09-13T18:39:53.660535+0000","last_peered":"2024-09-13T18:39:53.660535+0000","last_clean":"2024-09-13T18:39:53.660535+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:39:53.660535+0000","last_undegraded":"2024-09-13T18:39:53.660535+0000","last_fullsized":"2024-09-13T18:39:53.660535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:45.368802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665541+0000","last_change":"2024-09-13T18:39:14.583590+0000","last_active":"2024-09-13T18:39:53.665541+0000","last_peered":"2024-09-13T18:39:53.665541+0000","last_clean":"2024-09-13T18:39:53.665541+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:39:53.665541+0000","last_undegraded":"2024-09-13T18:39:53.665541+0000","last_fullsized":"2024-09-13T18:39:53.665541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662154+0000","last_change":"2024-09-13T18:39:14.590724+0000","last_active":"2024-09-13T18:39:53.662154+0000","last_peered":"2024-09-13T18:39:53.662154+0000","last_clean":"2024-09-13T18:39:53.662154+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:39:53.662154+0000","last_undegraded":"2024-09-13T18:39:53.662154+0000","last_fullsized":"2024-09-13T18:39:53.662154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:09.353955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660739+0000","last_change":"2024-09-13T18:39:14.577642+0000","last_active":"2024-09-13T18:39:53.660739+0000","last_peered":"2024-09-13T18:39:53.660739+0000","last_clean":"2024-09-13T18:39:53.660739+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:39:53.660739+0000","last_undegraded":"2024-09-13T18:39:53.660739+0000","last_fullsized":"2024-09-13T18:39:53.660739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662261+0000","last_change":"2024-09-13T18:39:14.592432+0000","last_active":"2024-09-13T18:39:53.662261+0000","last_peered":"2024-09-13T18:39:53.662261+0000","last_clean":"2024-09-13T18:39:53.662261+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:39:53.662261+0000","last_undegraded":"2024-09-13T18:39:53.662261+0000","last_fullsized":"2024-09-13T18:39:53.662261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:43.945214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662789+0000","last_change":"2024-09-13T18:39:14.571893+0000","last_active":"2024-09-13T18:39:53.662789+0000","last_peered":"2024-09-13T18:39:53.662789+0000","last_clean":"2024-09-13T18:39:53.662789+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:39:53.662789+0000","last_undegraded":"2024-09-13T18:39:53.662789+0000","last_fullsized":"2024-09-13T18:39:53.662789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667691+0000","last_change":"2024-09-13T18:39:14.594222+0000","last_active":"2024-09-13T18:39:53.667691+0000","last_peered":"2024-09-13T18:39:53.667691+0000","last_clean":"2024-09-13T18:39:53.667691+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:39:53.667691+0000","last_undegraded":"2024-09-13T18:39:53.667691+0000","last_fullsized":"2024-09-13T18:39:53.667691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:20.265556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661533+0000","last_change":"2024-09-13T18:39:14.576203+0000","last_active":"2024-09-13T18:39:53.661533+0000","last_peered":"2024-09-13T18:39:53.661533+0000","last_clean":"2024-09-13T18:39:53.661533+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:39:53.661533+0000","last_undegraded":"2024-09-13T18:39:53.661533+0000","last_fullsized":"2024-09-13T18:39:53.661533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660077+0000","last_change":"2024-09-13T18:39:14.586374+0000","last_active":"2024-09-13T18:39:53.660077+0000","last_peered":"2024-09-13T18:39:53.660077+0000","last_clean":"2024-09-13T18:39:53.660077+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:39:53.660077+0000","last_undegraded":"2024-09-13T18:39:53.660077+0000","last_fullsized":"2024-09-13T18:39:53.660077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:03.191196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665685+0000","last_change":"2024-09-13T18:39:14.577392+0000","last_active":"2024-09-13T18:39:53.665685+0000","last_peered":"2024-09-13T18:39:53.665685+0000","last_clean":"2024-09-13T18:39:53.665685+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:39:53.665685+0000","last_undegraded":"2024-09-13T18:39:53.665685+0000","last_fullsized":"2024-09-13T18:39:53.665685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:26.709807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662231+0000","last_change":"2024-09-13T18:39:14.580898+0000","last_active":"2024-09-13T18:39:53.662231+0000","last_peered":"2024-09-13T18:39:53.662231+0000","last_clean":"2024-09-13T18:39:53.662231+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:39:53.662231+0000","last_undegraded":"2024-09-13T18:39:53.662231+0000","last_fullsized":"2024-09-13T18:39:53.662231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:23.630337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660807+0000","last_change":"2024-09-13T18:39:14.574811+0000","last_active":"2024-09-13T18:39:53.660807+0000","last_peered":"2024-09-13T18:39:53.660807+0000","last_clean":"2024-09-13T18:39:53.660807+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:39:53.660807+0000","last_undegraded":"2024-09-13T18:39:53.660807+0000","last_fullsized":"2024-09-13T18:39:53.660807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660860+0000","last_change":"2024-09-13T18:39:14.579494+0000","last_active":"2024-09-13T18:39:53.660860+0000","last_peered":"2024-09-13T18:39:53.660860+0000","last_clean":"2024-09-13T18:39:53.660860+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:39:53.660860+0000","last_undegraded":"2024-09-13T18:39:53.660860+0000","last_fullsized":"2024-09-13T18:39:53.660860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:19.432936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660311+0000","last_change":"2024-09-13T18:39:13.575179+0000","last_active":"2024-09-13T18:39:53.660311+0000","last_peered":"2024-09-13T18:39:53.660311+0000","last_clean":"2024-09-13T18:39:53.660311+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:39:53.660311+0000","last_undegraded":"2024-09-13T18:39:53.660311+0000","last_fullsized":"2024-09-13T18:39:53.660311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:25.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666578+0000","last_change":"2024-09-13T18:39:14.594066+0000","last_active":"2024-09-13T18:39:53.666578+0000","last_peered":"2024-09-13T18:39:53.666578+0000","last_clean":"2024-09-13T18:39:53.666578+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:39:53.666578+0000","last_undegraded":"2024-09-13T18:39:53.666578+0000","last_fullsized":"2024-09-13T18:39:53.666578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:14.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665780+0000","last_change":"2024-09-13T18:39:13.570778+0000","last_active":"2024-09-13T18:39:53.665780+0000","last_peered":"2024-09-13T18:39:53.665780+0000","last_clean":"2024-09-13T18:39:53.665780+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:39:53.665780+0000","last_undegraded":"2024-09-13T18:39:53.665780+0000","last_fullsized":"2024-09-13T18:39:53.665780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.668508+0000","last_change":"2024-09-13T18:39:54.668508+0000","last_active":"2024-09-13T18:39:54.668508+0000","last_peered":"2024-09-13T18:39:54.668508+0000","last_clean":"2024-09-13T18:39:54.668508+0000","last_became_active":"2024-09-13T18:39:54.668035+0000","last_became_peered":"2024-09-13T18:39:54.668035+0000","last_unstale":"2024-09-13T18:39:54.668508+0000","last_undegraded":"2024-09-13T18:39:54.668508+0000","last_fullsized":"2024-09-13T18:39:54.668508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:40.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663232+0000","last_change":"2024-09-13T18:39:13.575436+0000","last_active":"2024-09-13T18:39:53.663232+0000","last_peered":"2024-09-13T18:39:53.663232+0000","last_clean":"2024-09-13T18:39:53.663232+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:39:53.663232+0000","last_undegraded":"2024-09-13T18:39:53.663232+0000","last_fullsized":"2024-09-13T18:39:53.663232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:34.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663189+0000","last_change":"2024-09-13T18:39:14.584791+0000","last_active":"2024-09-13T18:39:53.663189+0000","last_peered":"2024-09-13T18:39:53.663189+0000","last_clean":"2024-09-13T18:39:53.663189+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:39:53.663189+0000","last_undegraded":"2024-09-13T18:39:53.663189+0000","last_fullsized":"2024-09-13T18:39:53.663189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:08.799126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660889+0000","last_change":"2024-09-13T18:39:13.578940+0000","last_active":"2024-09-13T18:39:53.660889+0000","last_peered":"2024-09-13T18:39:53.660889+0000","last_clean":"2024-09-13T18:39:53.660889+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:39:53.660889+0000","last_undegraded":"2024-09-13T18:39:53.660889+0000","last_fullsized":"2024-09-13T18:39:53.660889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:34.109209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666409+0000","last_change":"2024-09-13T18:39:13.583184+0000","last_active":"2024-09-13T18:39:53.666409+0000","last_peered":"2024-09-13T18:39:53.666409+0000","last_clean":"2024-09-13T18:39:53.666409+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:39:53.666409+0000","last_undegraded":"2024-09-13T18:39:53.666409+0000","last_fullsized":"2024-09-13T18:39:53.666409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.668672+0000","last_change":"2024-09-13T18:39:54.668672+0000","last_active":"2024-09-13T18:39:54.668672+0000","last_peered":"2024-09-13T18:39:54.668672+0000","last_clean":"2024-09-13T18:39:54.668672+0000","last_became_active":"2024-09-13T18:39:54.668322+0000","last_became_peered":"2024-09-13T18:39:54.668322+0000","last_unstale":"2024-09-13T18:39:54.668672+0000","last_undegraded":"2024-09-13T18:39:54.668672+0000","last_fullsized":"2024-09-13T18:39:54.668672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:43.914025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662667+0000","last_change":"2024-09-13T18:39:13.571043+0000","last_active":"2024-09-13T18:39:53.662667+0000","last_peered":"2024-09-13T18:39:53.662667+0000","last_clean":"2024-09-13T18:39:53.662667+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:39:53.662667+0000","last_undegraded":"2024-09-13T18:39:53.662667+0000","last_fullsized":"2024-09-13T18:39:53.662667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.757855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660035+0000","last_change":"2024-09-13T18:39:14.577177+0000","last_active":"2024-09-13T18:39:53.660035+0000","last_peered":"2024-09-13T18:39:53.660035+0000","last_clean":"2024-09-13T18:39:53.660035+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:39:53.660035+0000","last_undegraded":"2024-09-13T18:39:53.660035+0000","last_fullsized":"2024-09-13T18:39:53.660035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667326+0000","last_change":"2024-09-13T18:39:13.581627+0000","last_active":"2024-09-13T18:39:53.667326+0000","last_peered":"2024-09-13T18:39:53.667326+0000","last_clean":"2024-09-13T18:39:53.667326+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:39:53.667326+0000","last_undegraded":"2024-09-13T18:39:53.667326+0000","last_fullsized":"2024-09-13T18:39:53.667326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:48.023626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662050+0000","last_change":"2024-09-13T18:39:14.596602+0000","last_active":"2024-09-13T18:39:53.662050+0000","last_peered":"2024-09-13T18:39:53.662050+0000","last_clean":"2024-09-13T18:39:53.662050+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:39:53.662050+0000","last_undegraded":"2024-09-13T18:39:53.662050+0000","last_fullsized":"2024-09-13T18:39:53.662050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:35.414913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666092+0000","last_change":"2024-09-13T18:39:13.570169+0000","last_active":"2024-09-13T18:39:53.666092+0000","last_peered":"2024-09-13T18:39:53.666092+0000","last_clean":"2024-09-13T18:39:53.666092+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:39:53.666092+0000","last_undegraded":"2024-09-13T18:39:53.666092+0000","last_fullsized":"2024-09-13T18:39:53.666092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666477+0000","last_change":"2024-09-13T18:39:14.584580+0000","last_active":"2024-09-13T18:39:53.666477+0000","last_peered":"2024-09-13T18:39:53.666477+0000","last_clean":"2024-09-13T18:39:53.666477+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:39:53.666477+0000","last_undegraded":"2024-09-13T18:39:53.666477+0000","last_fullsized":"2024-09-13T18:39:53.666477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660457+0000","last_change":"2024-09-13T18:39:13.575713+0000","last_active":"2024-09-13T18:39:53.660457+0000","last_peered":"2024-09-13T18:39:53.660457+0000","last_clean":"2024-09-13T18:39:53.660457+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:39:53.660457+0000","last_undegraded":"2024-09-13T18:39:53.660457+0000","last_fullsized":"2024-09-13T18:39:53.660457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:59.985917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665989+0000","last_change":"2024-09-13T18:39:14.577151+0000","last_active":"2024-09-13T18:39:53.665989+0000","last_peered":"2024-09-13T18:39:53.665989+0000","last_clean":"2024-09-13T18:39:53.665989+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:39:53.665989+0000","last_undegraded":"2024-09-13T18:39:53.665989+0000","last_fullsized":"2024-09-13T18:39:53.665989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663898+0000","last_change":"2024-09-13T18:39:13.581445+0000","last_active":"2024-09-13T18:39:53.663898+0000","last_peered":"2024-09-13T18:39:53.663898+0000","last_clean":"2024-09-13T18:39:53.663898+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:39:53.663898+0000","last_undegraded":"2024-09-13T18:39:53.663898+0000","last_fullsized":"2024-09-13T18:39:53.663898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:39.003339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664987+0000","last_change":"2024-09-13T18:39:14.584122+0000","last_active":"2024-09-13T18:39:53.664987+0000","last_peered":"2024-09-13T18:39:53.664987+0000","last_clean":"2024-09-13T18:39:53.664987+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:39:53.664987+0000","last_undegraded":"2024-09-13T18:39:53.664987+0000","last_fullsized":"2024-09-13T18:39:53.664987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:30.405734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663324+0000","last_change":"2024-09-13T18:39:13.575316+0000","last_active":"2024-09-13T18:39:53.663324+0000","last_peered":"2024-09-13T18:39:53.663324+0000","last_clean":"2024-09-13T18:39:53.663324+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:39:53.663324+0000","last_undegraded":"2024-09-13T18:39:53.663324+0000","last_fullsized":"2024-09-13T18:39:53.663324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:06.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660352+0000","last_change":"2024-09-13T18:39:14.593058+0000","last_active":"2024-09-13T18:39:53.660352+0000","last_peered":"2024-09-13T18:39:53.660352+0000","last_clean":"2024-09-13T18:39:53.660352+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:39:53.660352+0000","last_undegraded":"2024-09-13T18:39:53.660352+0000","last_fullsized":"2024-09-13T18:39:53.660352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:24.454698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661099+0000","last_change":"2024-09-13T18:39:13.581217+0000","last_active":"2024-09-13T18:39:53.661099+0000","last_peered":"2024-09-13T18:39:53.661099+0000","last_clean":"2024-09-13T18:39:53.661099+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:39:53.661099+0000","last_undegraded":"2024-09-13T18:39:53.661099+0000","last_fullsized":"2024-09-13T18:39:53.661099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:27.361025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662343+0000","last_change":"2024-09-13T18:39:14.596597+0000","last_active":"2024-09-13T18:39:53.662343+0000","last_peered":"2024-09-13T18:39:53.662343+0000","last_clean":"2024-09-13T18:39:53.662343+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:39:53.662343+0000","last_undegraded":"2024-09-13T18:39:53.662343+0000","last_fullsized":"2024-09-13T18:39:53.662343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:47.680908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":87,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661174+0000","last_change":"2024-09-13T18:39:03.413753+0000","last_active":"2024-09-13T18:39:53.661174+0000","last_peered":"2024-09-13T18:39:53.661174+0000","last_clean":"2024-09-13T18:39:53.661174+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:39:53.661174+0000","last_undegraded":"2024-09-13T18:39:53.661174+0000","last_fullsized":"2024-09-13T18:39:53.661174+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.425159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:05.703287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660538+0000","last_change":"2024-09-13T18:39:09.531787+0000","last_active":"2024-09-13T18:39:53.660538+0000","last_peered":"2024-09-13T18:39:53.660538+0000","last_clean":"2024-09-13T18:39:53.660538+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:39:53.660538+0000","last_undegraded":"2024-09-13T18:39:53.660538+0000","last_fullsized":"2024-09-13T18:39:53.660538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:21.652872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664040+0000","last_change":"2024-09-13T18:39:13.575940+0000","last_active":"2024-09-13T18:39:53.664040+0000","last_peered":"2024-09-13T18:39:53.664040+0000","last_clean":"2024-09-13T18:39:53.664040+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:39:53.664040+0000","last_undegraded":"2024-09-13T18:39:53.664040+0000","last_fullsized":"2024-09-13T18:39:53.664040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:23.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.668486+0000","last_change":"2024-09-13T18:39:54.668486+0000","last_active":"2024-09-13T18:39:54.668486+0000","last_peered":"2024-09-13T18:39:54.668486+0000","last_clean":"2024-09-13T18:39:54.668486+0000","last_became_active":"2024-09-13T18:39:54.668177+0000","last_became_peered":"2024-09-13T18:39:54.668177+0000","last_unstale":"2024-09-13T18:39:54.668486+0000","last_undegraded":"2024-09-13T18:39:54.668486+0000","last_fullsized":"2024-09-13T18:39:54.668486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:01.415577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661120+0000","last_change":"2024-09-13T18:39:09.531377+0000","last_active":"2024-09-13T18:39:53.661120+0000","last_peered":"2024-09-13T18:39:53.661120+0000","last_clean":"2024-09-13T18:39:53.661120+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:39:53.661120+0000","last_undegraded":"2024-09-13T18:39:53.661120+0000","last_fullsized":"2024-09-13T18:39:53.661120+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665394+0000","last_change":"2024-09-13T18:39:13.563570+0000","last_active":"2024-09-13T18:39:53.665394+0000","last_peered":"2024-09-13T18:39:53.665394+0000","last_clean":"2024-09-13T18:39:53.665394+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:39:53.665394+0000","last_undegraded":"2024-09-13T18:39:53.665394+0000","last_fullsized":"2024-09-13T18:39:53.665394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666443+0000","last_change":"2024-09-13T18:39:14.587017+0000","last_active":"2024-09-13T18:39:53.666443+0000","last_peered":"2024-09-13T18:39:53.666443+0000","last_clean":"2024-09-13T18:39:53.666443+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:39:53.666443+0000","last_undegraded":"2024-09-13T18:39:53.666443+0000","last_fullsized":"2024-09-13T18:39:53.666443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661881+0000","last_change":"2024-09-13T18:39:09.533004+0000","last_active":"2024-09-13T18:39:53.661881+0000","last_peered":"2024-09-13T18:39:53.661881+0000","last_clean":"2024-09-13T18:39:53.661881+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:39:53.661881+0000","last_undegraded":"2024-09-13T18:39:53.661881+0000","last_fullsized":"2024-09-13T18:39:53.661881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:41.079838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660963+0000","last_change":"2024-09-13T18:39:13.579066+0000","last_active":"2024-09-13T18:39:53.660963+0000","last_peered":"2024-09-13T18:39:53.660963+0000","last_clean":"2024-09-13T18:39:53.660963+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:39:53.660963+0000","last_undegraded":"2024-09-13T18:39:53.660963+0000","last_fullsized":"2024-09-13T18:39:53.660963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662418+0000","last_change":"2024-09-13T18:39:14.589734+0000","last_active":"2024-09-13T18:39:53.662418+0000","last_peered":"2024-09-13T18:39:53.662418+0000","last_clean":"2024-09-13T18:39:53.662418+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:39:53.662418+0000","last_undegraded":"2024-09-13T18:39:53.662418+0000","last_fullsized":"2024-09-13T18:39:53.662418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664123+0000","last_change":"2024-09-13T18:39:09.532311+0000","last_active":"2024-09-13T18:39:53.664123+0000","last_peered":"2024-09-13T18:39:53.664123+0000","last_clean":"2024-09-13T18:39:53.664123+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:39:53.664123+0000","last_undegraded":"2024-09-13T18:39:53.664123+0000","last_fullsized":"2024-09-13T18:39:53.664123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:53.060128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666753+0000","last_change":"2024-09-13T18:39:13.571488+0000","last_active":"2024-09-13T18:39:53.666753+0000","last_peered":"2024-09-13T18:39:53.666753+0000","last_clean":"2024-09-13T18:39:53.666753+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:39:53.666753+0000","last_undegraded":"2024-09-13T18:39:53.666753+0000","last_fullsized":"2024-09-13T18:39:53.666753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:44.121699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660837+0000","last_change":"2024-09-13T18:39:14.579779+0000","last_active":"2024-09-13T18:39:53.660837+0000","last_peered":"2024-09-13T18:39:53.660837+0000","last_clean":"2024-09-13T18:39:53.660837+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:39:53.660837+0000","last_undegraded":"2024-09-13T18:39:53.660837+0000","last_fullsized":"2024-09-13T18:39:53.660837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660742+0000","last_change":"2024-09-13T18:39:13.577844+0000","last_active":"2024-09-13T18:39:53.660742+0000","last_peered":"2024-09-13T18:39:53.660742+0000","last_clean":"2024-09-13T18:39:53.660742+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:39:53.660742+0000","last_undegraded":"2024-09-13T18:39:53.660742+0000","last_fullsized":"2024-09-13T18:39:53.660742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661619+0000","last_change":"2024-09-13T18:39:09.533091+0000","last_active":"2024-09-13T18:39:53.661619+0000","last_peered":"2024-09-13T18:39:53.661619+0000","last_clean":"2024-09-13T18:39:53.661619+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:39:53.661619+0000","last_undegraded":"2024-09-13T18:39:53.661619+0000","last_fullsized":"2024-09-13T18:39:53.661619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.659909+0000","last_change":"2024-09-13T18:39:14.597238+0000","last_active":"2024-09-13T18:39:53.659909+0000","last_peered":"2024-09-13T18:39:53.659909+0000","last_clean":"2024-09-13T18:39:53.659909+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:39:53.659909+0000","last_undegraded":"2024-09-13T18:39:53.659909+0000","last_fullsized":"2024-09-13T18:39:53.659909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.849783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660988+0000","last_change":"2024-09-13T18:39:13.583071+0000","last_active":"2024-09-13T18:39:53.660988+0000","last_peered":"2024-09-13T18:39:53.660988+0000","last_clean":"2024-09-13T18:39:53.660988+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:39:53.660988+0000","last_undegraded":"2024-09-13T18:39:53.660988+0000","last_fullsized":"2024-09-13T18:39:53.660988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667429+0000","last_change":"2024-09-13T18:39:09.532042+0000","last_active":"2024-09-13T18:39:53.667429+0000","last_peered":"2024-09-13T18:39:53.667429+0000","last_clean":"2024-09-13T18:39:53.667429+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:39:53.667429+0000","last_undegraded":"2024-09-13T18:39:53.667429+0000","last_fullsized":"2024-09-13T18:39:53.667429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:24.541036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666566+0000","last_change":"2024-09-13T18:39:14.584428+0000","last_active":"2024-09-13T18:39:53.666566+0000","last_peered":"2024-09-13T18:39:53.666566+0000","last_clean":"2024-09-13T18:39:53.666566+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:39:53.666566+0000","last_undegraded":"2024-09-13T18:39:53.666566+0000","last_fullsized":"2024-09-13T18:39:53.666566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663464+0000","last_change":"2024-09-13T18:39:13.583868+0000","last_active":"2024-09-13T18:39:53.663464+0000","last_peered":"2024-09-13T18:39:53.663464+0000","last_clean":"2024-09-13T18:39:53.663464+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:39:53.663464+0000","last_undegraded":"2024-09-13T18:39:53.663464+0000","last_fullsized":"2024-09-13T18:39:53.663464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:52.540883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662865+0000","last_change":"2024-09-13T18:39:09.532757+0000","last_active":"2024-09-13T18:39:53.662865+0000","last_peered":"2024-09-13T18:39:53.662865+0000","last_clean":"2024-09-13T18:39:53.662865+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:39:53.662865+0000","last_undegraded":"2024-09-13T18:39:53.662865+0000","last_fullsized":"2024-09-13T18:39:53.662865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:32.617744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660965+0000","last_change":"2024-09-13T18:39:14.582490+0000","last_active":"2024-09-13T18:39:53.660965+0000","last_peered":"2024-09-13T18:39:53.660965+0000","last_clean":"2024-09-13T18:39:53.660965+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:39:53.660965+0000","last_undegraded":"2024-09-13T18:39:53.660965+0000","last_fullsized":"2024-09-13T18:39:53.660965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:44.239715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666549+0000","last_change":"2024-09-13T18:39:13.583929+0000","last_active":"2024-09-13T18:39:53.666549+0000","last_peered":"2024-09-13T18:39:53.666549+0000","last_clean":"2024-09-13T18:39:53.666549+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:39:53.666549+0000","last_undegraded":"2024-09-13T18:39:53.666549+0000","last_fullsized":"2024-09-13T18:39:53.666549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:57.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663547+0000","last_change":"2024-09-13T18:39:09.531717+0000","last_active":"2024-09-13T18:39:53.663547+0000","last_peered":"2024-09-13T18:39:53.663547+0000","last_clean":"2024-09-13T18:39:53.663547+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:39:53.663547+0000","last_undegraded":"2024-09-13T18:39:53.663547+0000","last_fullsized":"2024-09-13T18:39:53.663547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:33.878130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.667668+0000","last_change":"2024-09-13T18:39:54.667668+0000","last_active":"2024-09-13T18:39:54.667668+0000","last_peered":"2024-09-13T18:39:54.667668+0000","last_clean":"2024-09-13T18:39:54.667668+0000","last_became_active":"2024-09-13T18:39:54.667244+0000","last_became_peered":"2024-09-13T18:39:54.667244+0000","last_unstale":"2024-09-13T18:39:54.667668+0000","last_undegraded":"2024-09-13T18:39:54.667668+0000","last_fullsized":"2024-09-13T18:39:54.667668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:56.127916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.659974+0000","last_change":"2024-09-13T18:39:14.593754+0000","last_active":"2024-09-13T18:39:53.659974+0000","last_peered":"2024-09-13T18:39:53.659974+0000","last_clean":"2024-09-13T18:39:53.659974+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:39:53.659974+0000","last_undegraded":"2024-09-13T18:39:53.659974+0000","last_fullsized":"2024-09-13T18:39:53.659974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:07.651837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661177+0000","last_change":"2024-09-13T18:39:13.575507+0000","last_active":"2024-09-13T18:39:53.661177+0000","last_peered":"2024-09-13T18:39:53.661177+0000","last_clean":"2024-09-13T18:39:53.661177+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:39:53.661177+0000","last_undegraded":"2024-09-13T18:39:53.661177+0000","last_fullsized":"2024-09-13T18:39:53.661177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:42.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2941,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661172+0000","last_change":"2024-09-13T18:39:14.598160+0000","last_active":"2024-09-13T18:39:53.661172+0000","last_peered":"2024-09-13T18:39:53.661172+0000","last_clean":"2024-09-13T18:39:53.661172+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:39:53.661172+0000","last_undegraded":"2024-09-13T18:39:53.661172+0000","last_fullsized":"2024-09-13T18:39:53.661172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666134+0000","last_change":"2024-09-13T18:39:13.572017+0000","last_active":"2024-09-13T18:39:53.666134+0000","last_peered":"2024-09-13T18:39:53.666134+0000","last_clean":"2024-09-13T18:39:53.666134+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:39:53.666134+0000","last_undegraded":"2024-09-13T18:39:53.666134+0000","last_fullsized":"2024-09-13T18:39:53.666134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:25.536255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662584+0000","last_change":"2024-09-13T18:39:13.571792+0000","last_active":"2024-09-13T18:39:53.662584+0000","last_peered":"2024-09-13T18:39:53.662584+0000","last_clean":"2024-09-13T18:39:53.662584+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:39:53.662584+0000","last_undegraded":"2024-09-13T18:39:53.662584+0000","last_fullsized":"2024-09-13T18:39:53.662584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662308+0000","last_change":"2024-09-13T18:39:14.590748+0000","last_active":"2024-09-13T18:39:53.662308+0000","last_peered":"2024-09-13T18:39:53.662308+0000","last_clean":"2024-09-13T18:39:53.662308+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:39:53.662308+0000","last_undegraded":"2024-09-13T18:39:53.662308+0000","last_fullsized":"2024-09-13T18:39:53.662308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:49.557245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666243+0000","last_change":"2024-09-13T18:39:13.569863+0000","last_active":"2024-09-13T18:39:53.666243+0000","last_peered":"2024-09-13T18:39:53.666243+0000","last_clean":"2024-09-13T18:39:53.666243+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:39:53.666243+0000","last_undegraded":"2024-09-13T18:39:53.666243+0000","last_fullsized":"2024-09-13T18:39:53.666243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660186+0000","last_change":"2024-09-13T18:39:14.582205+0000","last_active":"2024-09-13T18:39:53.660186+0000","last_peered":"2024-09-13T18:39:53.660186+0000","last_clean":"2024-09-13T18:39:53.660186+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:39:53.660186+0000","last_undegraded":"2024-09-13T18:39:53.660186+0000","last_fullsized":"2024-09-13T18:39:53.660186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.186210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.668351+0000","last_change":"2024-09-13T18:39:54.668351+0000","last_active":"2024-09-13T18:39:54.668351+0000","last_peered":"2024-09-13T18:39:54.668351+0000","last_clean":"2024-09-13T18:39:54.668351+0000","last_became_active":"2024-09-13T18:39:54.667809+0000","last_became_peered":"2024-09-13T18:39:54.667809+0000","last_unstale":"2024-09-13T18:39:54.668351+0000","last_undegraded":"2024-09-13T18:39:54.668351+0000","last_fullsized":"2024-09-13T18:39:54.668351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:40.114429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661053+0000","last_change":"2024-09-13T18:39:13.573803+0000","last_active":"2024-09-13T18:39:53.661053+0000","last_peered":"2024-09-13T18:39:53.661053+0000","last_clean":"2024-09-13T18:39:53.661053+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:39:53.661053+0000","last_undegraded":"2024-09-13T18:39:53.661053+0000","last_fullsized":"2024-09-13T18:39:53.661053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:08.298094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666540+0000","last_change":"2024-09-13T18:39:14.586848+0000","last_active":"2024-09-13T18:39:53.666540+0000","last_peered":"2024-09-13T18:39:53.666540+0000","last_clean":"2024-09-13T18:39:53.666540+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:39:53.666540+0000","last_undegraded":"2024-09-13T18:39:53.666540+0000","last_fullsized":"2024-09-13T18:39:53.666540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660115+0000","last_change":"2024-09-13T18:39:13.586123+0000","last_active":"2024-09-13T18:39:53.660115+0000","last_peered":"2024-09-13T18:39:53.660115+0000","last_clean":"2024-09-13T18:39:53.660115+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:39:53.660115+0000","last_undegraded":"2024-09-13T18:39:53.660115+0000","last_fullsized":"2024-09-13T18:39:53.660115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.668883+0000","last_change":"2024-09-13T18:39:54.668883+0000","last_active":"2024-09-13T18:39:54.668883+0000","last_peered":"2024-09-13T18:39:54.668883+0000","last_clean":"2024-09-13T18:39:54.668883+0000","last_became_active":"2024-09-13T18:39:54.668613+0000","last_became_peered":"2024-09-13T18:39:54.668613+0000","last_unstale":"2024-09-13T18:39:54.668883+0000","last_undegraded":"2024-09-13T18:39:54.668883+0000","last_fullsized":"2024-09-13T18:39:54.668883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:31.076844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661254+0000","last_change":"2024-09-13T18:39:13.575435+0000","last_active":"2024-09-13T18:39:53.661254+0000","last_peered":"2024-09-13T18:39:53.661254+0000","last_clean":"2024-09-13T18:39:53.661254+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:39:53.661254+0000","last_undegraded":"2024-09-13T18:39:53.661254+0000","last_fullsized":"2024-09-13T18:39:53.661254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662464+0000","last_change":"2024-09-13T18:39:14.580846+0000","last_active":"2024-09-13T18:39:53.662464+0000","last_peered":"2024-09-13T18:39:53.662464+0000","last_clean":"2024-09-13T18:39:53.662464+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:39:53.662464+0000","last_undegraded":"2024-09-13T18:39:53.662464+0000","last_fullsized":"2024-09-13T18:39:53.662464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.010053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666752+0000","last_change":"2024-09-13T18:39:13.571042+0000","last_active":"2024-09-13T18:39:53.666752+0000","last_peered":"2024-09-13T18:39:53.666752+0000","last_clean":"2024-09-13T18:39:53.666752+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:39:53.666752+0000","last_undegraded":"2024-09-13T18:39:53.666752+0000","last_fullsized":"2024-09-13T18:39:53.666752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.288993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.659906+0000","last_change":"2024-09-13T18:39:14.593258+0000","last_active":"2024-09-13T18:39:53.659906+0000","last_peered":"2024-09-13T18:39:53.659906+0000","last_clean":"2024-09-13T18:39:53.659906+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:39:53.659906+0000","last_undegraded":"2024-09-13T18:39:53.659906+0000","last_fullsized":"2024-09-13T18:39:53.659906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:21.972039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660913+0000","last_change":"2024-09-13T18:39:13.584903+0000","last_active":"2024-09-13T18:39:53.660913+0000","last_peered":"2024-09-13T18:39:53.660913+0000","last_clean":"2024-09-13T18:39:53.660913+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:39:53.660913+0000","last_undegraded":"2024-09-13T18:39:53.660913+0000","last_fullsized":"2024-09-13T18:39:53.660913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:46.551317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.667465+0000","last_change":"2024-09-13T18:39:54.667465+0000","last_active":"2024-09-13T18:39:54.667465+0000","last_peered":"2024-09-13T18:39:54.667465+0000","last_clean":"2024-09-13T18:39:54.667465+0000","last_became_active":"2024-09-13T18:39:54.667188+0000","last_became_peered":"2024-09-13T18:39:54.667188+0000","last_unstale":"2024-09-13T18:39:54.667465+0000","last_undegraded":"2024-09-13T18:39:54.667465+0000","last_fullsized":"2024-09-13T18:39:54.667465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:40.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666677+0000","last_change":"2024-09-13T18:39:13.574044+0000","last_active":"2024-09-13T18:39:53.666677+0000","last_peered":"2024-09-13T18:39:53.666677+0000","last_clean":"2024-09-13T18:39:53.666677+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:39:53.666677+0000","last_undegraded":"2024-09-13T18:39:53.666677+0000","last_fullsized":"2024-09-13T18:39:53.666677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:12.168801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663454+0000","last_change":"2024-09-13T18:39:14.591381+0000","last_active":"2024-09-13T18:39:53.663454+0000","last_peered":"2024-09-13T18:39:53.663454+0000","last_clean":"2024-09-13T18:39:53.663454+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:39:53.663454+0000","last_undegraded":"2024-09-13T18:39:53.663454+0000","last_fullsized":"2024-09-13T18:39:53.663454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:17.239023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661826+0000","last_change":"2024-09-13T18:39:13.575357+0000","last_active":"2024-09-13T18:39:53.661826+0000","last_peered":"2024-09-13T18:39:53.661826+0000","last_clean":"2024-09-13T18:39:53.661826+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:39:53.661826+0000","last_undegraded":"2024-09-13T18:39:53.661826+0000","last_fullsized":"2024-09-13T18:39:53.661826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:20.965325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.659676+0000","last_change":"2024-09-13T18:39:14.580750+0000","last_active":"2024-09-13T18:39:53.659676+0000","last_peered":"2024-09-13T18:39:53.659676+0000","last_clean":"2024-09-13T18:39:53.659676+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:39:53.659676+0000","last_undegraded":"2024-09-13T18:39:53.659676+0000","last_fullsized":"2024-09-13T18:39:53.659676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:08.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666153+0000","last_change":"2024-09-13T18:39:13.583221+0000","last_active":"2024-09-13T18:39:53.666153+0000","last_peered":"2024-09-13T18:39:53.666153+0000","last_clean":"2024-09-13T18:39:53.666153+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:39:53.666153+0000","last_undegraded":"2024-09-13T18:39:53.666153+0000","last_fullsized":"2024-09-13T18:39:53.666153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3727,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705686,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":225280,"data_stored":71128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32100000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.35499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705687,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":208896,"data_stored":70915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:03 2024","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.26400000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:40:03 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.311},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.25}]},{"osd":3,"last update":"Fri Sep 13 18:40:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.27500000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705685,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":806912,"data_stored":659023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.434,"5min":0.434,"15min":0.434},"last":0.371}]},{"osd":2,"last update":"Fri Sep 13 18:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.441},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.496}]}]},{"osd":0,"up_from":9,"seq":38654705686,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":806912,"data_stored":659058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:40:01 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.26400000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:40:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.22700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:40:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.314}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:40:37.103 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:40:37.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd99f9d640 1 Processor -- start 2024-09-13T18:40:37.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd99f9d640 1 -- start start 2024-09-13T18:40:37.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd99f9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd9409dfb0 0x7efd94096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd99f9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd940969d0 0x7efd940974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd99f9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7efd9412bf70 0x7efd9412c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd99f9d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd9409e380 con 0x7efd9409dfb0 2024-09-13T18:40:37.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd99f9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9406a190 con 0x7efd940969d0 2024-09-13T18:40:37.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd99f9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd94098870 con 0x7efd9412bf70 2024-09-13T18:40:37.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd937fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd9409dfb0 0x7efd94096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd93fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7efd9412bf70 0x7efd9412c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd92ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd940969d0 0x7efd940974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd93fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7efd9412bf70 0x7efd9412c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:47398/0 (socket says 172.21.15.97:47398) 2024-09-13T18:40:37.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd937fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd9409dfb0 0x7efd94096f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36602/0 (socket says 172.21.15.97:36602) 2024-09-13T18:40:37.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd92ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd940969d0 0x7efd940974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:52462/0 (socket says 172.21.15.97:52462) 2024-09-13T18:40:37.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.210+0000 7efd93fff640 1 -- 172.21.15.97:0/1021341667 learned_addr learned my addr 172.21.15.97:0/1021341667 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:37.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.211+0000 7efd92ffd640 1 -- 172.21.15.97:0/1021341667 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7efd9412bf70 msgr2=0x7efd9412c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:37.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.211+0000 7efd92ffd640 1 --2- 172.21.15.97:0/1021341667 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7efd9412bf70 0x7efd9412c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.211+0000 7efd92ffd640 1 -- 172.21.15.97:0/1021341667 >> v2:172.21.15.97:3300/0 conn(0x7efd9409dfb0 msgr2=0x7efd94096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:37.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.211+0000 7efd92ffd640 1 --2- 172.21.15.97:0/1021341667 >> v2:172.21.15.97:3300/0 conn(0x7efd9409dfb0 0x7efd94096f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.211+0000 7efd92ffd640 1 -- 172.21.15.97:0/1021341667 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd94098e10 con 0x7efd940969d0 2024-09-13T18:40:37.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.211+0000 7efd93fff640 1 --2- 172.21.15.97:0/1021341667 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7efd9412bf70 0x7efd9412c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:37.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.211+0000 7efd937fe640 1 --2- 172.21.15.97:0/1021341667 >> v2:172.21.15.97:3300/0 conn(0x7efd9409dfb0 0x7efd94096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.211+0000 7efd92ffd640 1 --2- 172.21.15.97:0/1021341667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd940969d0 0x7efd940974c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efd88009880 tx=0x7efd880090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6156578f51ffe1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.212+0000 7efd927fc640 1 -- 172.21.15.97:0/1021341667 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8802ce50 con 0x7efd940969d0 2024-09-13T18:40:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.212+0000 7efd927fc640 1 -- 172.21.15.97:0/1021341667 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd88034440 con 0x7efd940969d0 2024-09-13T18:40:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.212+0000 7efd927fc640 1 -- 172.21.15.97:0/1021341667 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd88034820 con 0x7efd940969d0 2024-09-13T18:40:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.212+0000 7efd99f9d640 1 -- 172.21.15.97:0/1021341667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd940969d0 msgr2=0x7efd940974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.212+0000 7efd99f9d640 1 --2- 172.21.15.97:0/1021341667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd940969d0 0x7efd940974c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efd88009880 tx=0x7efd880090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.212+0000 7efd99f9d640 1 -- 172.21.15.97:0/1021341667 shutdown_connections 2024-09-13T18:40:37.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.212+0000 7efd99f9d640 1 --2- 172.21.15.97:0/1021341667 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7efd9412bf70 0x7efd9412c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.212+0000 7efd99f9d640 1 --2- 172.21.15.97:0/1021341667 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd940969d0 0x7efd940974c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.212+0000 7efd99f9d640 1 --2- 172.21.15.97:0/1021341667 >> v2:172.21.15.97:3300/0 conn(0x7efd9409dfb0 0x7efd94096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.212+0000 7efd99f9d640 1 -- 172.21.15.97:0/1021341667 >> 172.21.15.97:0/1021341667 conn(0x7efd9409b200 msgr2=0x7efd9409b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.212+0000 7efd99f9d640 1 -- 172.21.15.97:0/1021341667 shutdown_connections 2024-09-13T18:40:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.212+0000 7efd99f9d640 1 -- 172.21.15.97:0/1021341667 wait complete. 2024-09-13T18:40:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.213+0000 7efd99f9d640 1 Processor -- start 2024-09-13T18:40:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.213+0000 7efd99f9d640 1 -- start start 2024-09-13T18:40:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.213+0000 7efd99f9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd940969d0 0x7efd9411b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.213+0000 7efd99f9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd9409dfb0 0x7efd94117bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.213+0000 7efd99f9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7efd9412bf70 0x7efd94118110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.213+0000 7efd99f9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd94099850 con 0x7efd940969d0 2024-09-13T18:40:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd99f9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9411a840 con 0x7efd9409dfb0 2024-09-13T18:40:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd99f9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd94117830 con 0x7efd9412bf70 2024-09-13T18:40:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd937fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd940969d0 0x7efd9411b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd92ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd9409dfb0 0x7efd94117bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd93fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7efd9412bf70 0x7efd94118110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd937fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd940969d0 0x7efd9411b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36612/0 (socket says 172.21.15.97:36612) 2024-09-13T18:40:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd937fe640 1 -- 172.21.15.97:0/1832956097 learned_addr learned my addr 172.21.15.97:0/1832956097 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd93fff640 1 -- 172.21.15.97:0/1832956097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd9409dfb0 msgr2=0x7efd94117bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd93fff640 1 --2- 172.21.15.97:0/1832956097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd9409dfb0 0x7efd94117bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd93fff640 1 -- 172.21.15.97:0/1832956097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd940969d0 msgr2=0x7efd9411b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd93fff640 1 --2- 172.21.15.97:0/1832956097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd940969d0 0x7efd9411b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd93fff640 1 -- 172.21.15.97:0/1832956097 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84009390 con 0x7efd9412bf70 2024-09-13T18:40:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd92ffd640 1 --2- 172.21.15.97:0/1832956097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd9409dfb0 0x7efd94117bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd937fe640 1 --2- 172.21.15.97:0/1832956097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd940969d0 0x7efd9411b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd93fff640 1 --2- 172.21.15.97:0/1832956097 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7efd9412bf70 0x7efd94118110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009f10 tx=0x7efd8c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:37.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd7b7fe640 1 -- 172.21.15.97:0/1832956097 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c018070 con 0x7efd9412bf70 2024-09-13T18:40:37.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd7b7fe640 1 -- 172.21.15.97:0/1832956097 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8c00f040 con 0x7efd9412bf70 2024-09-13T18:40:37.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd99f9d640 1 -- 172.21.15.97:0/1832956097 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8c009ae0 con 0x7efd9412bf70 2024-09-13T18:40:37.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd7b7fe640 1 -- 172.21.15.97:0/1832956097 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0092e0 con 0x7efd9412bf70 2024-09-13T18:40:37.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.214+0000 7efd99f9d640 1 -- 172.21.15.97:0/1832956097 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd88009390 con 0x7efd9412bf70 2024-09-13T18:40:37.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.215+0000 7efd7b7fe640 1 -- 172.21.15.97:0/1832956097 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7efd8c003020 con 0x7efd9412bf70 2024-09-13T18:40:37.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.215+0000 7efd7b7fe640 1 -- 172.21.15.97:0/1832956097 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7efd8c0421c0 con 0x7efd9412bf70 2024-09-13T18:40:37.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.215+0000 7efd99f9d640 1 -- 172.21.15.97:0/1832956097 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9411aa60 con 0x7efd9412bf70 2024-09-13T18:40:37.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.219+0000 7efd7b7fe640 1 -- 172.21.15.97:0/1832956097 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7efd8c01d410 con 0x7efd9412bf70 2024-09-13T18:40:37.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.369+0000 7efd99f9d640 1 -- 172.21.15.97:0/1832956097 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd94064000 con 0x7efd80031160 2024-09-13T18:40:37.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.375+0000 7efd7b7fe640 1 -- 172.21.15.97:0/1832956097 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276611 (unknown 2965378022 0 129400939) 0x7efd94064000 con 0x7efd80031160 2024-09-13T18:40:37.379 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:40:37.384 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:40:37.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.378+0000 7efd99f9d640 1 -- 172.21.15.97:0/1832956097 >> v1:172.21.15.97:6816/34603 conn(0x7efd80031160 legacy=0x7efd80033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.378+0000 7efd99f9d640 1 -- 172.21.15.97:0/1832956097 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7efd9412bf70 msgr2=0x7efd94118110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.378+0000 7efd99f9d640 1 --2- 172.21.15.97:0/1832956097 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7efd9412bf70 0x7efd94118110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009f10 tx=0x7efd8c00b040 comp rx=0 tx=0).stop 2024-09-13T18:40:37.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.378+0000 7efd99f9d640 1 -- 172.21.15.97:0/1832956097 shutdown_connections 2024-09-13T18:40:37.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.378+0000 7efd99f9d640 1 --2- 172.21.15.97:0/1832956097 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7efd9412bf70 0x7efd94118110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.378+0000 7efd99f9d640 1 --2- 172.21.15.97:0/1832956097 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7efd9409dfb0 0x7efd94117bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.378+0000 7efd99f9d640 1 --2- 172.21.15.97:0/1832956097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd940969d0 0x7efd9411b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.378+0000 7efd99f9d640 1 -- 172.21.15.97:0/1832956097 >> 172.21.15.97:0/1832956097 conn(0x7efd9409b200 msgr2=0x7efd9406a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:37.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.378+0000 7efd99f9d640 1 -- 172.21.15.97:0/1832956097 shutdown_connections 2024-09-13T18:40:37.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.378+0000 7efd99f9d640 1 -- 172.21.15.97:0/1832956097 wait complete. 2024-09-13T18:40:37.391 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-13T18:40:37.368593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594114,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":130,"num_write_kb":1125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1191440,"kb_used_data":2000,"kb_used_omap":6,"kb_used_meta":1189369,"kb_avail":376295920,"statfs":{"total":386547056640,"available":385327022080,"internally_reserved":0,"allocated":2048000,"data_stored":1460124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1217914208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003207"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660477+0000","last_change":"2024-09-13T18:39:14.592723+0000","last_active":"2024-09-13T18:39:53.660477+0000","last_peered":"2024-09-13T18:39:53.660477+0000","last_clean":"2024-09-13T18:39:53.660477+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:39:53.660477+0000","last_undegraded":"2024-09-13T18:39:53.660477+0000","last_fullsized":"2024-09-13T18:39:53.660477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:09.304808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660272+0000","last_change":"2024-09-13T18:39:14.581266+0000","last_active":"2024-09-13T18:39:53.660272+0000","last_peered":"2024-09-13T18:39:53.660272+0000","last_clean":"2024-09-13T18:39:53.660272+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:39:53.660272+0000","last_undegraded":"2024-09-13T18:39:53.660272+0000","last_fullsized":"2024-09-13T18:39:53.660272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666044+0000","last_change":"2024-09-13T18:39:14.586254+0000","last_active":"2024-09-13T18:39:53.666044+0000","last_peered":"2024-09-13T18:39:53.666044+0000","last_clean":"2024-09-13T18:39:53.666044+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:39:53.666044+0000","last_undegraded":"2024-09-13T18:39:53.666044+0000","last_fullsized":"2024-09-13T18:39:53.666044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665881+0000","last_change":"2024-09-13T18:39:14.583960+0000","last_active":"2024-09-13T18:39:53.665881+0000","last_peered":"2024-09-13T18:39:53.665881+0000","last_clean":"2024-09-13T18:39:53.665881+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:39:53.665881+0000","last_undegraded":"2024-09-13T18:39:53.665881+0000","last_fullsized":"2024-09-13T18:39:53.665881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666647+0000","last_change":"2024-09-13T18:39:14.577865+0000","last_active":"2024-09-13T18:39:53.666647+0000","last_peered":"2024-09-13T18:39:53.666647+0000","last_clean":"2024-09-13T18:39:53.666647+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:39:53.666647+0000","last_undegraded":"2024-09-13T18:39:53.666647+0000","last_fullsized":"2024-09-13T18:39:53.666647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663709+0000","last_change":"2024-09-13T18:39:14.590785+0000","last_active":"2024-09-13T18:39:53.663709+0000","last_peered":"2024-09-13T18:39:53.663709+0000","last_clean":"2024-09-13T18:39:53.663709+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:39:53.663709+0000","last_undegraded":"2024-09-13T18:39:53.663709+0000","last_fullsized":"2024-09-13T18:39:53.663709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:24.453184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662075+0000","last_change":"2024-09-13T18:39:14.590893+0000","last_active":"2024-09-13T18:39:53.662075+0000","last_peered":"2024-09-13T18:39:53.662075+0000","last_clean":"2024-09-13T18:39:53.662075+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:39:53.662075+0000","last_undegraded":"2024-09-13T18:39:53.662075+0000","last_fullsized":"2024-09-13T18:39:53.662075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:57.986187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660672+0000","last_change":"2024-09-13T18:39:14.595160+0000","last_active":"2024-09-13T18:39:53.660672+0000","last_peered":"2024-09-13T18:39:53.660672+0000","last_clean":"2024-09-13T18:39:53.660672+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:39:53.660672+0000","last_undegraded":"2024-09-13T18:39:53.660672+0000","last_fullsized":"2024-09-13T18:39:53.660672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666320+0000","last_change":"2024-09-13T18:39:14.586790+0000","last_active":"2024-09-13T18:39:53.666320+0000","last_peered":"2024-09-13T18:39:53.666320+0000","last_clean":"2024-09-13T18:39:53.666320+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:39:53.666320+0000","last_undegraded":"2024-09-13T18:39:53.666320+0000","last_fullsized":"2024-09-13T18:39:53.666320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:49.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662698+0000","last_change":"2024-09-13T18:39:14.591231+0000","last_active":"2024-09-13T18:39:53.662698+0000","last_peered":"2024-09-13T18:39:53.662698+0000","last_clean":"2024-09-13T18:39:53.662698+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:39:53.662698+0000","last_undegraded":"2024-09-13T18:39:53.662698+0000","last_fullsized":"2024-09-13T18:39:53.662698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663588+0000","last_change":"2024-09-13T18:39:14.589017+0000","last_active":"2024-09-13T18:39:53.663588+0000","last_peered":"2024-09-13T18:39:53.663588+0000","last_clean":"2024-09-13T18:39:53.663588+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:39:53.663588+0000","last_undegraded":"2024-09-13T18:39:53.663588+0000","last_fullsized":"2024-09-13T18:39:53.663588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662383+0000","last_change":"2024-09-13T18:39:14.592629+0000","last_active":"2024-09-13T18:39:53.662383+0000","last_peered":"2024-09-13T18:39:53.662383+0000","last_clean":"2024-09-13T18:39:53.662383+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:39:53.662383+0000","last_undegraded":"2024-09-13T18:39:53.662383+0000","last_fullsized":"2024-09-13T18:39:53.662383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.659836+0000","last_change":"2024-09-13T18:39:14.597709+0000","last_active":"2024-09-13T18:39:53.659836+0000","last_peered":"2024-09-13T18:39:53.659836+0000","last_clean":"2024-09-13T18:39:53.659836+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:39:53.659836+0000","last_undegraded":"2024-09-13T18:39:53.659836+0000","last_fullsized":"2024-09-13T18:39:53.659836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.367739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.659834+0000","last_change":"2024-09-13T18:39:14.572267+0000","last_active":"2024-09-13T18:39:53.659834+0000","last_peered":"2024-09-13T18:39:53.659834+0000","last_clean":"2024-09-13T18:39:53.659834+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:39:53.659834+0000","last_undegraded":"2024-09-13T18:39:53.659834+0000","last_fullsized":"2024-09-13T18:39:53.659834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665313+0000","last_change":"2024-09-13T18:39:14.583318+0000","last_active":"2024-09-13T18:39:53.665313+0000","last_peered":"2024-09-13T18:39:53.665313+0000","last_clean":"2024-09-13T18:39:53.665313+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:39:53.665313+0000","last_undegraded":"2024-09-13T18:39:53.665313+0000","last_fullsized":"2024-09-13T18:39:53.665313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660118+0000","last_change":"2024-09-13T18:39:14.592378+0000","last_active":"2024-09-13T18:39:53.660118+0000","last_peered":"2024-09-13T18:39:53.660118+0000","last_clean":"2024-09-13T18:39:53.660118+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:39:53.660118+0000","last_undegraded":"2024-09-13T18:39:53.660118+0000","last_fullsized":"2024-09-13T18:39:53.660118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:02.414361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665959+0000","last_change":"2024-09-13T18:39:14.586945+0000","last_active":"2024-09-13T18:39:53.665959+0000","last_peered":"2024-09-13T18:39:53.665959+0000","last_clean":"2024-09-13T18:39:53.665959+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:39:53.665959+0000","last_undegraded":"2024-09-13T18:39:53.665959+0000","last_fullsized":"2024-09-13T18:39:53.665959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:57.889039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666343+0000","last_change":"2024-09-13T18:39:14.587172+0000","last_active":"2024-09-13T18:39:53.666343+0000","last_peered":"2024-09-13T18:39:53.666343+0000","last_clean":"2024-09-13T18:39:53.666343+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:39:53.666343+0000","last_undegraded":"2024-09-13T18:39:53.666343+0000","last_fullsized":"2024-09-13T18:39:53.666343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660662+0000","last_change":"2024-09-13T18:39:14.594291+0000","last_active":"2024-09-13T18:39:53.660662+0000","last_peered":"2024-09-13T18:39:53.660662+0000","last_clean":"2024-09-13T18:39:53.660662+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:39:53.660662+0000","last_undegraded":"2024-09-13T18:39:53.660662+0000","last_fullsized":"2024-09-13T18:39:53.660662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:29.208875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660771+0000","last_change":"2024-09-13T18:39:14.585973+0000","last_active":"2024-09-13T18:39:53.660771+0000","last_peered":"2024-09-13T18:39:53.660771+0000","last_clean":"2024-09-13T18:39:53.660771+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:39:53.660771+0000","last_undegraded":"2024-09-13T18:39:53.660771+0000","last_fullsized":"2024-09-13T18:39:53.660771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:48.875040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660535+0000","last_change":"2024-09-13T18:39:14.595451+0000","last_active":"2024-09-13T18:39:53.660535+0000","last_peered":"2024-09-13T18:39:53.660535+0000","last_clean":"2024-09-13T18:39:53.660535+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:39:53.660535+0000","last_undegraded":"2024-09-13T18:39:53.660535+0000","last_fullsized":"2024-09-13T18:39:53.660535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:45.368802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665541+0000","last_change":"2024-09-13T18:39:14.583590+0000","last_active":"2024-09-13T18:39:53.665541+0000","last_peered":"2024-09-13T18:39:53.665541+0000","last_clean":"2024-09-13T18:39:53.665541+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:39:53.665541+0000","last_undegraded":"2024-09-13T18:39:53.665541+0000","last_fullsized":"2024-09-13T18:39:53.665541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662154+0000","last_change":"2024-09-13T18:39:14.590724+0000","last_active":"2024-09-13T18:39:53.662154+0000","last_peered":"2024-09-13T18:39:53.662154+0000","last_clean":"2024-09-13T18:39:53.662154+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:39:53.662154+0000","last_undegraded":"2024-09-13T18:39:53.662154+0000","last_fullsized":"2024-09-13T18:39:53.662154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:09.353955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660739+0000","last_change":"2024-09-13T18:39:14.577642+0000","last_active":"2024-09-13T18:39:53.660739+0000","last_peered":"2024-09-13T18:39:53.660739+0000","last_clean":"2024-09-13T18:39:53.660739+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:39:53.660739+0000","last_undegraded":"2024-09-13T18:39:53.660739+0000","last_fullsized":"2024-09-13T18:39:53.660739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662261+0000","last_change":"2024-09-13T18:39:14.592432+0000","last_active":"2024-09-13T18:39:53.662261+0000","last_peered":"2024-09-13T18:39:53.662261+0000","last_clean":"2024-09-13T18:39:53.662261+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:39:53.662261+0000","last_undegraded":"2024-09-13T18:39:53.662261+0000","last_fullsized":"2024-09-13T18:39:53.662261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:43.945214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662789+0000","last_change":"2024-09-13T18:39:14.571893+0000","last_active":"2024-09-13T18:39:53.662789+0000","last_peered":"2024-09-13T18:39:53.662789+0000","last_clean":"2024-09-13T18:39:53.662789+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:39:53.662789+0000","last_undegraded":"2024-09-13T18:39:53.662789+0000","last_fullsized":"2024-09-13T18:39:53.662789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667691+0000","last_change":"2024-09-13T18:39:14.594222+0000","last_active":"2024-09-13T18:39:53.667691+0000","last_peered":"2024-09-13T18:39:53.667691+0000","last_clean":"2024-09-13T18:39:53.667691+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:39:53.667691+0000","last_undegraded":"2024-09-13T18:39:53.667691+0000","last_fullsized":"2024-09-13T18:39:53.667691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:20.265556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661533+0000","last_change":"2024-09-13T18:39:14.576203+0000","last_active":"2024-09-13T18:39:53.661533+0000","last_peered":"2024-09-13T18:39:53.661533+0000","last_clean":"2024-09-13T18:39:53.661533+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:39:53.661533+0000","last_undegraded":"2024-09-13T18:39:53.661533+0000","last_fullsized":"2024-09-13T18:39:53.661533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660077+0000","last_change":"2024-09-13T18:39:14.586374+0000","last_active":"2024-09-13T18:39:53.660077+0000","last_peered":"2024-09-13T18:39:53.660077+0000","last_clean":"2024-09-13T18:39:53.660077+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:39:53.660077+0000","last_undegraded":"2024-09-13T18:39:53.660077+0000","last_fullsized":"2024-09-13T18:39:53.660077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:03.191196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665685+0000","last_change":"2024-09-13T18:39:14.577392+0000","last_active":"2024-09-13T18:39:53.665685+0000","last_peered":"2024-09-13T18:39:53.665685+0000","last_clean":"2024-09-13T18:39:53.665685+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:39:53.665685+0000","last_undegraded":"2024-09-13T18:39:53.665685+0000","last_fullsized":"2024-09-13T18:39:53.665685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:26.709807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662231+0000","last_change":"2024-09-13T18:39:14.580898+0000","last_active":"2024-09-13T18:39:53.662231+0000","last_peered":"2024-09-13T18:39:53.662231+0000","last_clean":"2024-09-13T18:39:53.662231+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:39:53.662231+0000","last_undegraded":"2024-09-13T18:39:53.662231+0000","last_fullsized":"2024-09-13T18:39:53.662231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:23.630337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660807+0000","last_change":"2024-09-13T18:39:14.574811+0000","last_active":"2024-09-13T18:39:53.660807+0000","last_peered":"2024-09-13T18:39:53.660807+0000","last_clean":"2024-09-13T18:39:53.660807+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:39:53.660807+0000","last_undegraded":"2024-09-13T18:39:53.660807+0000","last_fullsized":"2024-09-13T18:39:53.660807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660860+0000","last_change":"2024-09-13T18:39:14.579494+0000","last_active":"2024-09-13T18:39:53.660860+0000","last_peered":"2024-09-13T18:39:53.660860+0000","last_clean":"2024-09-13T18:39:53.660860+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:39:53.660860+0000","last_undegraded":"2024-09-13T18:39:53.660860+0000","last_fullsized":"2024-09-13T18:39:53.660860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:19.432936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660311+0000","last_change":"2024-09-13T18:39:13.575179+0000","last_active":"2024-09-13T18:39:53.660311+0000","last_peered":"2024-09-13T18:39:53.660311+0000","last_clean":"2024-09-13T18:39:53.660311+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:39:53.660311+0000","last_undegraded":"2024-09-13T18:39:53.660311+0000","last_fullsized":"2024-09-13T18:39:53.660311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:25.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666578+0000","last_change":"2024-09-13T18:39:14.594066+0000","last_active":"2024-09-13T18:39:53.666578+0000","last_peered":"2024-09-13T18:39:53.666578+0000","last_clean":"2024-09-13T18:39:53.666578+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:39:53.666578+0000","last_undegraded":"2024-09-13T18:39:53.666578+0000","last_fullsized":"2024-09-13T18:39:53.666578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:14.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665780+0000","last_change":"2024-09-13T18:39:13.570778+0000","last_active":"2024-09-13T18:39:53.665780+0000","last_peered":"2024-09-13T18:39:53.665780+0000","last_clean":"2024-09-13T18:39:53.665780+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:39:53.665780+0000","last_undegraded":"2024-09-13T18:39:53.665780+0000","last_fullsized":"2024-09-13T18:39:53.665780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.668508+0000","last_change":"2024-09-13T18:39:54.668508+0000","last_active":"2024-09-13T18:39:54.668508+0000","last_peered":"2024-09-13T18:39:54.668508+0000","last_clean":"2024-09-13T18:39:54.668508+0000","last_became_active":"2024-09-13T18:39:54.668035+0000","last_became_peered":"2024-09-13T18:39:54.668035+0000","last_unstale":"2024-09-13T18:39:54.668508+0000","last_undegraded":"2024-09-13T18:39:54.668508+0000","last_fullsized":"2024-09-13T18:39:54.668508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:40.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663232+0000","last_change":"2024-09-13T18:39:13.575436+0000","last_active":"2024-09-13T18:39:53.663232+0000","last_peered":"2024-09-13T18:39:53.663232+0000","last_clean":"2024-09-13T18:39:53.663232+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:39:53.663232+0000","last_undegraded":"2024-09-13T18:39:53.663232+0000","last_fullsized":"2024-09-13T18:39:53.663232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:34.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663189+0000","last_change":"2024-09-13T18:39:14.584791+0000","last_active":"2024-09-13T18:39:53.663189+0000","last_peered":"2024-09-13T18:39:53.663189+0000","last_clean":"2024-09-13T18:39:53.663189+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:39:53.663189+0000","last_undegraded":"2024-09-13T18:39:53.663189+0000","last_fullsized":"2024-09-13T18:39:53.663189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:08.799126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660889+0000","last_change":"2024-09-13T18:39:13.578940+0000","last_active":"2024-09-13T18:39:53.660889+0000","last_peered":"2024-09-13T18:39:53.660889+0000","last_clean":"2024-09-13T18:39:53.660889+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:39:53.660889+0000","last_undegraded":"2024-09-13T18:39:53.660889+0000","last_fullsized":"2024-09-13T18:39:53.660889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:34.109209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666409+0000","last_change":"2024-09-13T18:39:13.583184+0000","last_active":"2024-09-13T18:39:53.666409+0000","last_peered":"2024-09-13T18:39:53.666409+0000","last_clean":"2024-09-13T18:39:53.666409+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:39:53.666409+0000","last_undegraded":"2024-09-13T18:39:53.666409+0000","last_fullsized":"2024-09-13T18:39:53.666409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.668672+0000","last_change":"2024-09-13T18:39:54.668672+0000","last_active":"2024-09-13T18:39:54.668672+0000","last_peered":"2024-09-13T18:39:54.668672+0000","last_clean":"2024-09-13T18:39:54.668672+0000","last_became_active":"2024-09-13T18:39:54.668322+0000","last_became_peered":"2024-09-13T18:39:54.668322+0000","last_unstale":"2024-09-13T18:39:54.668672+0000","last_undegraded":"2024-09-13T18:39:54.668672+0000","last_fullsized":"2024-09-13T18:39:54.668672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:43.914025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662667+0000","last_change":"2024-09-13T18:39:13.571043+0000","last_active":"2024-09-13T18:39:53.662667+0000","last_peered":"2024-09-13T18:39:53.662667+0000","last_clean":"2024-09-13T18:39:53.662667+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:39:53.662667+0000","last_undegraded":"2024-09-13T18:39:53.662667+0000","last_fullsized":"2024-09-13T18:39:53.662667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.757855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660035+0000","last_change":"2024-09-13T18:39:14.577177+0000","last_active":"2024-09-13T18:39:53.660035+0000","last_peered":"2024-09-13T18:39:53.660035+0000","last_clean":"2024-09-13T18:39:53.660035+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:39:53.660035+0000","last_undegraded":"2024-09-13T18:39:53.660035+0000","last_fullsized":"2024-09-13T18:39:53.660035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667326+0000","last_change":"2024-09-13T18:39:13.581627+0000","last_active":"2024-09-13T18:39:53.667326+0000","last_peered":"2024-09-13T18:39:53.667326+0000","last_clean":"2024-09-13T18:39:53.667326+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:39:53.667326+0000","last_undegraded":"2024-09-13T18:39:53.667326+0000","last_fullsized":"2024-09-13T18:39:53.667326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:48.023626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662050+0000","last_change":"2024-09-13T18:39:14.596602+0000","last_active":"2024-09-13T18:39:53.662050+0000","last_peered":"2024-09-13T18:39:53.662050+0000","last_clean":"2024-09-13T18:39:53.662050+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:39:53.662050+0000","last_undegraded":"2024-09-13T18:39:53.662050+0000","last_fullsized":"2024-09-13T18:39:53.662050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:35.414913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666092+0000","last_change":"2024-09-13T18:39:13.570169+0000","last_active":"2024-09-13T18:39:53.666092+0000","last_peered":"2024-09-13T18:39:53.666092+0000","last_clean":"2024-09-13T18:39:53.666092+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:39:53.666092+0000","last_undegraded":"2024-09-13T18:39:53.666092+0000","last_fullsized":"2024-09-13T18:39:53.666092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666477+0000","last_change":"2024-09-13T18:39:14.584580+0000","last_active":"2024-09-13T18:39:53.666477+0000","last_peered":"2024-09-13T18:39:53.666477+0000","last_clean":"2024-09-13T18:39:53.666477+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:39:53.666477+0000","last_undegraded":"2024-09-13T18:39:53.666477+0000","last_fullsized":"2024-09-13T18:39:53.666477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660457+0000","last_change":"2024-09-13T18:39:13.575713+0000","last_active":"2024-09-13T18:39:53.660457+0000","last_peered":"2024-09-13T18:39:53.660457+0000","last_clean":"2024-09-13T18:39:53.660457+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:39:53.660457+0000","last_undegraded":"2024-09-13T18:39:53.660457+0000","last_fullsized":"2024-09-13T18:39:53.660457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:59.985917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665989+0000","last_change":"2024-09-13T18:39:14.577151+0000","last_active":"2024-09-13T18:39:53.665989+0000","last_peered":"2024-09-13T18:39:53.665989+0000","last_clean":"2024-09-13T18:39:53.665989+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:39:53.665989+0000","last_undegraded":"2024-09-13T18:39:53.665989+0000","last_fullsized":"2024-09-13T18:39:53.665989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663898+0000","last_change":"2024-09-13T18:39:13.581445+0000","last_active":"2024-09-13T18:39:53.663898+0000","last_peered":"2024-09-13T18:39:53.663898+0000","last_clean":"2024-09-13T18:39:53.663898+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:39:53.663898+0000","last_undegraded":"2024-09-13T18:39:53.663898+0000","last_fullsized":"2024-09-13T18:39:53.663898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:39.003339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664987+0000","last_change":"2024-09-13T18:39:14.584122+0000","last_active":"2024-09-13T18:39:53.664987+0000","last_peered":"2024-09-13T18:39:53.664987+0000","last_clean":"2024-09-13T18:39:53.664987+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:39:53.664987+0000","last_undegraded":"2024-09-13T18:39:53.664987+0000","last_fullsized":"2024-09-13T18:39:53.664987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:30.405734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663324+0000","last_change":"2024-09-13T18:39:13.575316+0000","last_active":"2024-09-13T18:39:53.663324+0000","last_peered":"2024-09-13T18:39:53.663324+0000","last_clean":"2024-09-13T18:39:53.663324+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:39:53.663324+0000","last_undegraded":"2024-09-13T18:39:53.663324+0000","last_fullsized":"2024-09-13T18:39:53.663324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:06.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660352+0000","last_change":"2024-09-13T18:39:14.593058+0000","last_active":"2024-09-13T18:39:53.660352+0000","last_peered":"2024-09-13T18:39:53.660352+0000","last_clean":"2024-09-13T18:39:53.660352+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:39:53.660352+0000","last_undegraded":"2024-09-13T18:39:53.660352+0000","last_fullsized":"2024-09-13T18:39:53.660352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:24.454698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661099+0000","last_change":"2024-09-13T18:39:13.581217+0000","last_active":"2024-09-13T18:39:53.661099+0000","last_peered":"2024-09-13T18:39:53.661099+0000","last_clean":"2024-09-13T18:39:53.661099+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:39:53.661099+0000","last_undegraded":"2024-09-13T18:39:53.661099+0000","last_fullsized":"2024-09-13T18:39:53.661099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:27.361025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662343+0000","last_change":"2024-09-13T18:39:14.596597+0000","last_active":"2024-09-13T18:39:53.662343+0000","last_peered":"2024-09-13T18:39:53.662343+0000","last_clean":"2024-09-13T18:39:53.662343+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:39:53.662343+0000","last_undegraded":"2024-09-13T18:39:53.662343+0000","last_fullsized":"2024-09-13T18:39:53.662343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:47.680908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":87,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661174+0000","last_change":"2024-09-13T18:39:03.413753+0000","last_active":"2024-09-13T18:39:53.661174+0000","last_peered":"2024-09-13T18:39:53.661174+0000","last_clean":"2024-09-13T18:39:53.661174+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:39:53.661174+0000","last_undegraded":"2024-09-13T18:39:53.661174+0000","last_fullsized":"2024-09-13T18:39:53.661174+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.425159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:05.703287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660538+0000","last_change":"2024-09-13T18:39:09.531787+0000","last_active":"2024-09-13T18:39:53.660538+0000","last_peered":"2024-09-13T18:39:53.660538+0000","last_clean":"2024-09-13T18:39:53.660538+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:39:53.660538+0000","last_undegraded":"2024-09-13T18:39:53.660538+0000","last_fullsized":"2024-09-13T18:39:53.660538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:21.652872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664040+0000","last_change":"2024-09-13T18:39:13.575940+0000","last_active":"2024-09-13T18:39:53.664040+0000","last_peered":"2024-09-13T18:39:53.664040+0000","last_clean":"2024-09-13T18:39:53.664040+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:39:53.664040+0000","last_undegraded":"2024-09-13T18:39:53.664040+0000","last_fullsized":"2024-09-13T18:39:53.664040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:23.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.668486+0000","last_change":"2024-09-13T18:39:54.668486+0000","last_active":"2024-09-13T18:39:54.668486+0000","last_peered":"2024-09-13T18:39:54.668486+0000","last_clean":"2024-09-13T18:39:54.668486+0000","last_became_active":"2024-09-13T18:39:54.668177+0000","last_became_peered":"2024-09-13T18:39:54.668177+0000","last_unstale":"2024-09-13T18:39:54.668486+0000","last_undegraded":"2024-09-13T18:39:54.668486+0000","last_fullsized":"2024-09-13T18:39:54.668486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:01.415577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661120+0000","last_change":"2024-09-13T18:39:09.531377+0000","last_active":"2024-09-13T18:39:53.661120+0000","last_peered":"2024-09-13T18:39:53.661120+0000","last_clean":"2024-09-13T18:39:53.661120+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:39:53.661120+0000","last_undegraded":"2024-09-13T18:39:53.661120+0000","last_fullsized":"2024-09-13T18:39:53.661120+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665394+0000","last_change":"2024-09-13T18:39:13.563570+0000","last_active":"2024-09-13T18:39:53.665394+0000","last_peered":"2024-09-13T18:39:53.665394+0000","last_clean":"2024-09-13T18:39:53.665394+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:39:53.665394+0000","last_undegraded":"2024-09-13T18:39:53.665394+0000","last_fullsized":"2024-09-13T18:39:53.665394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666443+0000","last_change":"2024-09-13T18:39:14.587017+0000","last_active":"2024-09-13T18:39:53.666443+0000","last_peered":"2024-09-13T18:39:53.666443+0000","last_clean":"2024-09-13T18:39:53.666443+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:39:53.666443+0000","last_undegraded":"2024-09-13T18:39:53.666443+0000","last_fullsized":"2024-09-13T18:39:53.666443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661881+0000","last_change":"2024-09-13T18:39:09.533004+0000","last_active":"2024-09-13T18:39:53.661881+0000","last_peered":"2024-09-13T18:39:53.661881+0000","last_clean":"2024-09-13T18:39:53.661881+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:39:53.661881+0000","last_undegraded":"2024-09-13T18:39:53.661881+0000","last_fullsized":"2024-09-13T18:39:53.661881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:41.079838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660963+0000","last_change":"2024-09-13T18:39:13.579066+0000","last_active":"2024-09-13T18:39:53.660963+0000","last_peered":"2024-09-13T18:39:53.660963+0000","last_clean":"2024-09-13T18:39:53.660963+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:39:53.660963+0000","last_undegraded":"2024-09-13T18:39:53.660963+0000","last_fullsized":"2024-09-13T18:39:53.660963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662418+0000","last_change":"2024-09-13T18:39:14.589734+0000","last_active":"2024-09-13T18:39:53.662418+0000","last_peered":"2024-09-13T18:39:53.662418+0000","last_clean":"2024-09-13T18:39:53.662418+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:39:53.662418+0000","last_undegraded":"2024-09-13T18:39:53.662418+0000","last_fullsized":"2024-09-13T18:39:53.662418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664123+0000","last_change":"2024-09-13T18:39:09.532311+0000","last_active":"2024-09-13T18:39:53.664123+0000","last_peered":"2024-09-13T18:39:53.664123+0000","last_clean":"2024-09-13T18:39:53.664123+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:39:53.664123+0000","last_undegraded":"2024-09-13T18:39:53.664123+0000","last_fullsized":"2024-09-13T18:39:53.664123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:53.060128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666753+0000","last_change":"2024-09-13T18:39:13.571488+0000","last_active":"2024-09-13T18:39:53.666753+0000","last_peered":"2024-09-13T18:39:53.666753+0000","last_clean":"2024-09-13T18:39:53.666753+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:39:53.666753+0000","last_undegraded":"2024-09-13T18:39:53.666753+0000","last_fullsized":"2024-09-13T18:39:53.666753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:44.121699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660837+0000","last_change":"2024-09-13T18:39:14.579779+0000","last_active":"2024-09-13T18:39:53.660837+0000","last_peered":"2024-09-13T18:39:53.660837+0000","last_clean":"2024-09-13T18:39:53.660837+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:39:53.660837+0000","last_undegraded":"2024-09-13T18:39:53.660837+0000","last_fullsized":"2024-09-13T18:39:53.660837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660742+0000","last_change":"2024-09-13T18:39:13.577844+0000","last_active":"2024-09-13T18:39:53.660742+0000","last_peered":"2024-09-13T18:39:53.660742+0000","last_clean":"2024-09-13T18:39:53.660742+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:39:53.660742+0000","last_undegraded":"2024-09-13T18:39:53.660742+0000","last_fullsized":"2024-09-13T18:39:53.660742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661619+0000","last_change":"2024-09-13T18:39:09.533091+0000","last_active":"2024-09-13T18:39:53.661619+0000","last_peered":"2024-09-13T18:39:53.661619+0000","last_clean":"2024-09-13T18:39:53.661619+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:39:53.661619+0000","last_undegraded":"2024-09-13T18:39:53.661619+0000","last_fullsized":"2024-09-13T18:39:53.661619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.659909+0000","last_change":"2024-09-13T18:39:14.597238+0000","last_active":"2024-09-13T18:39:53.659909+0000","last_peered":"2024-09-13T18:39:53.659909+0000","last_clean":"2024-09-13T18:39:53.659909+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:39:53.659909+0000","last_undegraded":"2024-09-13T18:39:53.659909+0000","last_fullsized":"2024-09-13T18:39:53.659909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.849783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660988+0000","last_change":"2024-09-13T18:39:13.583071+0000","last_active":"2024-09-13T18:39:53.660988+0000","last_peered":"2024-09-13T18:39:53.660988+0000","last_clean":"2024-09-13T18:39:53.660988+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:39:53.660988+0000","last_undegraded":"2024-09-13T18:39:53.660988+0000","last_fullsized":"2024-09-13T18:39:53.660988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667429+0000","last_change":"2024-09-13T18:39:09.532042+0000","last_active":"2024-09-13T18:39:53.667429+0000","last_peered":"2024-09-13T18:39:53.667429+0000","last_clean":"2024-09-13T18:39:53.667429+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:39:53.667429+0000","last_undegraded":"2024-09-13T18:39:53.667429+0000","last_fullsized":"2024-09-13T18:39:53.667429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:24.541036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666566+0000","last_change":"2024-09-13T18:39:14.584428+0000","last_active":"2024-09-13T18:39:53.666566+0000","last_peered":"2024-09-13T18:39:53.666566+0000","last_clean":"2024-09-13T18:39:53.666566+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:39:53.666566+0000","last_undegraded":"2024-09-13T18:39:53.666566+0000","last_fullsized":"2024-09-13T18:39:53.666566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663464+0000","last_change":"2024-09-13T18:39:13.583868+0000","last_active":"2024-09-13T18:39:53.663464+0000","last_peered":"2024-09-13T18:39:53.663464+0000","last_clean":"2024-09-13T18:39:53.663464+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:39:53.663464+0000","last_undegraded":"2024-09-13T18:39:53.663464+0000","last_fullsized":"2024-09-13T18:39:53.663464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:52.540883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662865+0000","last_change":"2024-09-13T18:39:09.532757+0000","last_active":"2024-09-13T18:39:53.662865+0000","last_peered":"2024-09-13T18:39:53.662865+0000","last_clean":"2024-09-13T18:39:53.662865+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:39:53.662865+0000","last_undegraded":"2024-09-13T18:39:53.662865+0000","last_fullsized":"2024-09-13T18:39:53.662865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:32.617744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660965+0000","last_change":"2024-09-13T18:39:14.582490+0000","last_active":"2024-09-13T18:39:53.660965+0000","last_peered":"2024-09-13T18:39:53.660965+0000","last_clean":"2024-09-13T18:39:53.660965+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:39:53.660965+0000","last_undegraded":"2024-09-13T18:39:53.660965+0000","last_fullsized":"2024-09-13T18:39:53.660965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:44.239715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666549+0000","last_change":"2024-09-13T18:39:13.583929+0000","last_active":"2024-09-13T18:39:53.666549+0000","last_peered":"2024-09-13T18:39:53.666549+0000","last_clean":"2024-09-13T18:39:53.666549+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:39:53.666549+0000","last_undegraded":"2024-09-13T18:39:53.666549+0000","last_fullsized":"2024-09-13T18:39:53.666549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:57.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663547+0000","last_change":"2024-09-13T18:39:09.531717+0000","last_active":"2024-09-13T18:39:53.663547+0000","last_peered":"2024-09-13T18:39:53.663547+0000","last_clean":"2024-09-13T18:39:53.663547+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:39:53.663547+0000","last_undegraded":"2024-09-13T18:39:53.663547+0000","last_fullsized":"2024-09-13T18:39:53.663547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:33.878130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.667668+0000","last_change":"2024-09-13T18:39:54.667668+0000","last_active":"2024-09-13T18:39:54.667668+0000","last_peered":"2024-09-13T18:39:54.667668+0000","last_clean":"2024-09-13T18:39:54.667668+0000","last_became_active":"2024-09-13T18:39:54.667244+0000","last_became_peered":"2024-09-13T18:39:54.667244+0000","last_unstale":"2024-09-13T18:39:54.667668+0000","last_undegraded":"2024-09-13T18:39:54.667668+0000","last_fullsized":"2024-09-13T18:39:54.667668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:56.127916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.659974+0000","last_change":"2024-09-13T18:39:14.593754+0000","last_active":"2024-09-13T18:39:53.659974+0000","last_peered":"2024-09-13T18:39:53.659974+0000","last_clean":"2024-09-13T18:39:53.659974+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:39:53.659974+0000","last_undegraded":"2024-09-13T18:39:53.659974+0000","last_fullsized":"2024-09-13T18:39:53.659974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:07.651837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661177+0000","last_change":"2024-09-13T18:39:13.575507+0000","last_active":"2024-09-13T18:39:53.661177+0000","last_peered":"2024-09-13T18:39:53.661177+0000","last_clean":"2024-09-13T18:39:53.661177+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:39:53.661177+0000","last_undegraded":"2024-09-13T18:39:53.661177+0000","last_fullsized":"2024-09-13T18:39:53.661177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:42.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2941,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661172+0000","last_change":"2024-09-13T18:39:14.598160+0000","last_active":"2024-09-13T18:39:53.661172+0000","last_peered":"2024-09-13T18:39:53.661172+0000","last_clean":"2024-09-13T18:39:53.661172+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:39:53.661172+0000","last_undegraded":"2024-09-13T18:39:53.661172+0000","last_fullsized":"2024-09-13T18:39:53.661172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666134+0000","last_change":"2024-09-13T18:39:13.572017+0000","last_active":"2024-09-13T18:39:53.666134+0000","last_peered":"2024-09-13T18:39:53.666134+0000","last_clean":"2024-09-13T18:39:53.666134+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:39:53.666134+0000","last_undegraded":"2024-09-13T18:39:53.666134+0000","last_fullsized":"2024-09-13T18:39:53.666134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:25.536255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662584+0000","last_change":"2024-09-13T18:39:13.571792+0000","last_active":"2024-09-13T18:39:53.662584+0000","last_peered":"2024-09-13T18:39:53.662584+0000","last_clean":"2024-09-13T18:39:53.662584+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:39:53.662584+0000","last_undegraded":"2024-09-13T18:39:53.662584+0000","last_fullsized":"2024-09-13T18:39:53.662584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662308+0000","last_change":"2024-09-13T18:39:14.590748+0000","last_active":"2024-09-13T18:39:53.662308+0000","last_peered":"2024-09-13T18:39:53.662308+0000","last_clean":"2024-09-13T18:39:53.662308+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:39:53.662308+0000","last_undegraded":"2024-09-13T18:39:53.662308+0000","last_fullsized":"2024-09-13T18:39:53.662308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:49.557245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666243+0000","last_change":"2024-09-13T18:39:13.569863+0000","last_active":"2024-09-13T18:39:53.666243+0000","last_peered":"2024-09-13T18:39:53.666243+0000","last_clean":"2024-09-13T18:39:53.666243+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:39:53.666243+0000","last_undegraded":"2024-09-13T18:39:53.666243+0000","last_fullsized":"2024-09-13T18:39:53.666243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660186+0000","last_change":"2024-09-13T18:39:14.582205+0000","last_active":"2024-09-13T18:39:53.660186+0000","last_peered":"2024-09-13T18:39:53.660186+0000","last_clean":"2024-09-13T18:39:53.660186+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:39:53.660186+0000","last_undegraded":"2024-09-13T18:39:53.660186+0000","last_fullsized":"2024-09-13T18:39:53.660186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.186210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.668351+0000","last_change":"2024-09-13T18:39:54.668351+0000","last_active":"2024-09-13T18:39:54.668351+0000","last_peered":"2024-09-13T18:39:54.668351+0000","last_clean":"2024-09-13T18:39:54.668351+0000","last_became_active":"2024-09-13T18:39:54.667809+0000","last_became_peered":"2024-09-13T18:39:54.667809+0000","last_unstale":"2024-09-13T18:39:54.668351+0000","last_undegraded":"2024-09-13T18:39:54.668351+0000","last_fullsized":"2024-09-13T18:39:54.668351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:40.114429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661053+0000","last_change":"2024-09-13T18:39:13.573803+0000","last_active":"2024-09-13T18:39:53.661053+0000","last_peered":"2024-09-13T18:39:53.661053+0000","last_clean":"2024-09-13T18:39:53.661053+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:39:53.661053+0000","last_undegraded":"2024-09-13T18:39:53.661053+0000","last_fullsized":"2024-09-13T18:39:53.661053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:08.298094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666540+0000","last_change":"2024-09-13T18:39:14.586848+0000","last_active":"2024-09-13T18:39:53.666540+0000","last_peered":"2024-09-13T18:39:53.666540+0000","last_clean":"2024-09-13T18:39:53.666540+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:39:53.666540+0000","last_undegraded":"2024-09-13T18:39:53.666540+0000","last_fullsized":"2024-09-13T18:39:53.666540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660115+0000","last_change":"2024-09-13T18:39:13.586123+0000","last_active":"2024-09-13T18:39:53.660115+0000","last_peered":"2024-09-13T18:39:53.660115+0000","last_clean":"2024-09-13T18:39:53.660115+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:39:53.660115+0000","last_undegraded":"2024-09-13T18:39:53.660115+0000","last_fullsized":"2024-09-13T18:39:53.660115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.668883+0000","last_change":"2024-09-13T18:39:54.668883+0000","last_active":"2024-09-13T18:39:54.668883+0000","last_peered":"2024-09-13T18:39:54.668883+0000","last_clean":"2024-09-13T18:39:54.668883+0000","last_became_active":"2024-09-13T18:39:54.668613+0000","last_became_peered":"2024-09-13T18:39:54.668613+0000","last_unstale":"2024-09-13T18:39:54.668883+0000","last_undegraded":"2024-09-13T18:39:54.668883+0000","last_fullsized":"2024-09-13T18:39:54.668883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:31.076844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661254+0000","last_change":"2024-09-13T18:39:13.575435+0000","last_active":"2024-09-13T18:39:53.661254+0000","last_peered":"2024-09-13T18:39:53.661254+0000","last_clean":"2024-09-13T18:39:53.661254+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:39:53.661254+0000","last_undegraded":"2024-09-13T18:39:53.661254+0000","last_fullsized":"2024-09-13T18:39:53.661254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662464+0000","last_change":"2024-09-13T18:39:14.580846+0000","last_active":"2024-09-13T18:39:53.662464+0000","last_peered":"2024-09-13T18:39:53.662464+0000","last_clean":"2024-09-13T18:39:53.662464+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:39:53.662464+0000","last_undegraded":"2024-09-13T18:39:53.662464+0000","last_fullsized":"2024-09-13T18:39:53.662464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.010053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666752+0000","last_change":"2024-09-13T18:39:13.571042+0000","last_active":"2024-09-13T18:39:53.666752+0000","last_peered":"2024-09-13T18:39:53.666752+0000","last_clean":"2024-09-13T18:39:53.666752+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:39:53.666752+0000","last_undegraded":"2024-09-13T18:39:53.666752+0000","last_fullsized":"2024-09-13T18:39:53.666752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.288993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.659906+0000","last_change":"2024-09-13T18:39:14.593258+0000","last_active":"2024-09-13T18:39:53.659906+0000","last_peered":"2024-09-13T18:39:53.659906+0000","last_clean":"2024-09-13T18:39:53.659906+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:39:53.659906+0000","last_undegraded":"2024-09-13T18:39:53.659906+0000","last_fullsized":"2024-09-13T18:39:53.659906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:21.972039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660913+0000","last_change":"2024-09-13T18:39:13.584903+0000","last_active":"2024-09-13T18:39:53.660913+0000","last_peered":"2024-09-13T18:39:53.660913+0000","last_clean":"2024-09-13T18:39:53.660913+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:39:53.660913+0000","last_undegraded":"2024-09-13T18:39:53.660913+0000","last_fullsized":"2024-09-13T18:39:53.660913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:46.551317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.667465+0000","last_change":"2024-09-13T18:39:54.667465+0000","last_active":"2024-09-13T18:39:54.667465+0000","last_peered":"2024-09-13T18:39:54.667465+0000","last_clean":"2024-09-13T18:39:54.667465+0000","last_became_active":"2024-09-13T18:39:54.667188+0000","last_became_peered":"2024-09-13T18:39:54.667188+0000","last_unstale":"2024-09-13T18:39:54.667465+0000","last_undegraded":"2024-09-13T18:39:54.667465+0000","last_fullsized":"2024-09-13T18:39:54.667465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:40.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666677+0000","last_change":"2024-09-13T18:39:13.574044+0000","last_active":"2024-09-13T18:39:53.666677+0000","last_peered":"2024-09-13T18:39:53.666677+0000","last_clean":"2024-09-13T18:39:53.666677+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:39:53.666677+0000","last_undegraded":"2024-09-13T18:39:53.666677+0000","last_fullsized":"2024-09-13T18:39:53.666677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:12.168801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663454+0000","last_change":"2024-09-13T18:39:14.591381+0000","last_active":"2024-09-13T18:39:53.663454+0000","last_peered":"2024-09-13T18:39:53.663454+0000","last_clean":"2024-09-13T18:39:53.663454+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:39:53.663454+0000","last_undegraded":"2024-09-13T18:39:53.663454+0000","last_fullsized":"2024-09-13T18:39:53.663454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:17.239023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661826+0000","last_change":"2024-09-13T18:39:13.575357+0000","last_active":"2024-09-13T18:39:53.661826+0000","last_peered":"2024-09-13T18:39:53.661826+0000","last_clean":"2024-09-13T18:39:53.661826+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:39:53.661826+0000","last_undegraded":"2024-09-13T18:39:53.661826+0000","last_fullsized":"2024-09-13T18:39:53.661826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:20.965325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.659676+0000","last_change":"2024-09-13T18:39:14.580750+0000","last_active":"2024-09-13T18:39:53.659676+0000","last_peered":"2024-09-13T18:39:53.659676+0000","last_clean":"2024-09-13T18:39:53.659676+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:39:53.659676+0000","last_undegraded":"2024-09-13T18:39:53.659676+0000","last_fullsized":"2024-09-13T18:39:53.659676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:08.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666153+0000","last_change":"2024-09-13T18:39:13.583221+0000","last_active":"2024-09-13T18:39:53.666153+0000","last_peered":"2024-09-13T18:39:53.666153+0000","last_clean":"2024-09-13T18:39:53.666153+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:39:53.666153+0000","last_undegraded":"2024-09-13T18:39:53.666153+0000","last_fullsized":"2024-09-13T18:39:53.666153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3727,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705687,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":225280,"data_stored":71128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32100000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.35499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705688,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":208896,"data_stored":70915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:03 2024","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.217}]},{"osd":1,"last update":"Fri Sep 13 18:40:03 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.31},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.25900000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:40:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.25},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.27000000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705686,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":806912,"data_stored":659023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.434,"5min":0.434,"15min":0.434},"last":0.371}]},{"osd":2,"last update":"Fri Sep 13 18:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.441},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.496}]}]},{"osd":0,"up_from":9,"seq":38654705687,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":806912,"data_stored":659058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:40:01 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.26400000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:40:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.22700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:40:01 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.314}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:40:37.396 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:40:37.396 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:40:37.396 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:40:37.396 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T18:40:37.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.522+0000 7faef7d1d640 1 Processor -- start 2024-09-13T18:40:37.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.523+0000 7faef7d1d640 1 -- start start 2024-09-13T18:40:37.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.523+0000 7faef7d1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faef009dfb0 0x7faef0096df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.523+0000 7faef7d1d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7faef0097700 0x7faef012c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.523+0000 7faef7d1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef009ca00 con 0x7faef0097330 2024-09-13T18:40:37.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.523+0000 7faef7d1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef009e380 con 0x7faef009dfb0 2024-09-13T18:40:37.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.523+0000 7faef7d1d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faef0098ef0 con 0x7faef0097700 2024-09-13T18:40:37.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.523+0000 7faef5ab9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faef009dfb0 0x7faef0096df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.523+0000 7faef62ba640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7faef0097700 0x7faef012c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.523+0000 7faef62ba640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7faef0097700 0x7faef012c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51510/0 (socket says 172.21.15.97:51510) 2024-09-13T18:40:37.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.523+0000 7faef5ab9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faef009dfb0 0x7faef0096df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37234/0 (socket says 172.21.15.97:37234) 2024-09-13T18:40:37.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.523+0000 7faef62ba640 1 -- 172.21.15.97:0/2988798823 learned_addr learned my addr 172.21.15.97:0/2988798823 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:37.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.523+0000 7faef52b8640 1 --1- 172.21.15.97:0/2988798823 >> v1:172.21.15.97:6789/0 conn(0x7faef0097330 0x7faef012c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58204/0 (socket says 172.21.15.97:58204) 2024-09-13T18:40:37.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.524+0000 7faef5ab9640 1 -- 172.21.15.97:0/2988798823 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7faef0097700 msgr2=0x7faef012c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:37.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.524+0000 7faef5ab9640 1 --2- 172.21.15.97:0/2988798823 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7faef0097700 0x7faef012c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.524+0000 7faef4ab7640 1 -- 172.21.15.97:0/2988798823 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684151052 0 0) 0x7faef009ca00 con 0x7faef0097330 2024-09-13T18:40:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.524+0000 7faef5ab9640 1 -- 172.21.15.97:0/2988798823 >> v1:172.21.15.97:6789/0 conn(0x7faef0097330 legacy=0x7faef012c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.524+0000 7faef5ab9640 1 -- 172.21.15.97:0/2988798823 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef00988e0 con 0x7faef009dfb0 2024-09-13T18:40:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.524+0000 7faef62ba640 1 --2- 172.21.15.97:0/2988798823 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7faef0097700 0x7faef012c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.524+0000 7faef5ab9640 1 --2- 172.21.15.97:0/2988798823 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faef009dfb0 0x7faef0096df0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faee4009880 tx=0x7faee40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdee567c5d2a8c18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.524+0000 7faef4ab7640 1 -- 172.21.15.97:0/2988798823 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee402ac50 con 0x7faef009dfb0 2024-09-13T18:40:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.524+0000 7faef4ab7640 1 -- 172.21.15.97:0/2988798823 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee402adb0 con 0x7faef009dfb0 2024-09-13T18:40:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.524+0000 7faef4ab7640 1 -- 172.21.15.97:0/2988798823 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4032670 con 0x7faef009dfb0 2024-09-13T18:40:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.525+0000 7faef7d1d640 1 -- 172.21.15.97:0/2988798823 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faef009dfb0 msgr2=0x7faef0096df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.525+0000 7faef7d1d640 1 --2- 172.21.15.97:0/2988798823 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faef009dfb0 0x7faef0096df0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faee4009880 tx=0x7faee40090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.525+0000 7faef7d1d640 1 -- 172.21.15.97:0/2988798823 shutdown_connections 2024-09-13T18:40:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.525+0000 7faef7d1d640 1 --2- 172.21.15.97:0/2988798823 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7faef0097700 0x7faef012c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.525+0000 7faef7d1d640 1 --2- 172.21.15.97:0/2988798823 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faef009dfb0 0x7faef0096df0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.525+0000 7faef7d1d640 1 -- 172.21.15.97:0/2988798823 >> 172.21.15.97:0/2988798823 conn(0x7faef005db50 msgr2=0x7faef005df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.525+0000 7faef7d1d640 1 -- 172.21.15.97:0/2988798823 shutdown_connections 2024-09-13T18:40:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.525+0000 7faef7d1d640 1 -- 172.21.15.97:0/2988798823 wait complete. 2024-09-13T18:40:37.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.526+0000 7faef7d1d640 1 Processor -- start 2024-09-13T18:40:37.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.526+0000 7faef7d1d640 1 -- start start 2024-09-13T18:40:37.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.526+0000 7faef7d1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef0097330 0x7faef012d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.526+0000 7faef7d1d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7faef0097700 0x7faef0126f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.526+0000 7faef7d1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faef009dfb0 0x7faef01274a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.526+0000 7faef7d1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef0129970 con 0x7faef0097330 2024-09-13T18:40:37.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.526+0000 7faef7d1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef01280f0 con 0x7faef009dfb0 2024-09-13T18:40:37.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.526+0000 7faef7d1d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faef0126c30 con 0x7faef0097700 2024-09-13T18:40:37.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.526+0000 7faef5ab9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef0097330 0x7faef012d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.526+0000 7faef52b8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7faef0097700 0x7faef0126f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.526+0000 7faef62ba640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faef009dfb0 0x7faef01274a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.526+0000 7faef5ab9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef0097330 0x7faef012d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44022/0 (socket says 172.21.15.97:44022) 2024-09-13T18:40:37.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.526+0000 7faef5ab9640 1 -- 172.21.15.97:0/1821742672 learned_addr learned my addr 172.21.15.97:0/1821742672 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:37.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.527+0000 7faef5ab9640 1 -- 172.21.15.97:0/1821742672 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7faef0097700 msgr2=0x7faef0126f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.527+0000 7faef5ab9640 1 --2- 172.21.15.97:0/1821742672 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7faef0097700 0x7faef0126f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.527+0000 7faef5ab9640 1 -- 172.21.15.97:0/1821742672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faef009dfb0 msgr2=0x7faef01274a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.527+0000 7faef5ab9640 1 --2- 172.21.15.97:0/1821742672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faef009dfb0 0x7faef01274a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.527+0000 7faef5ab9640 1 -- 172.21.15.97:0/1821742672 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee8009ae0 con 0x7faef0097330 2024-09-13T18:40:37.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.527+0000 7faef52b8640 1 --2- 172.21.15.97:0/1821742672 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7faef0097700 0x7faef0126f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:37.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.527+0000 7faef62ba640 1 --2- 172.21.15.97:0/1821742672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faef009dfb0 0x7faef01274a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:37.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.527+0000 7faef5ab9640 1 --2- 172.21.15.97:0/1821742672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef0097330 0x7faef012d750 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faee40098e0 tx=0x7faee4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:37.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.527+0000 7faee1ffb640 1 -- 172.21.15.97:0/1821742672 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4031780 con 0x7faef0097330 2024-09-13T18:40:37.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.527+0000 7faee1ffb640 1 -- 172.21.15.97:0/1821742672 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee40318e0 con 0x7faef0097330 2024-09-13T18:40:37.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.527+0000 7faef7d1d640 1 -- 172.21.15.97:0/1821742672 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee4009390 con 0x7faef0097330 2024-09-13T18:40:37.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.527+0000 7faee1ffb640 1 -- 172.21.15.97:0/1821742672 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4031ca0 con 0x7faef0097330 2024-09-13T18:40:37.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.527+0000 7faef7d1d640 1 -- 172.21.15.97:0/1821742672 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef0127a60 con 0x7faef0097330 2024-09-13T18:40:37.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.528+0000 7faee1ffb640 1 -- 172.21.15.97:0/1821742672 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7faee4039070 con 0x7faef0097330 2024-09-13T18:40:37.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.528+0000 7faee1ffb640 1 -- 172.21.15.97:0/1821742672 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7faee40626e0 con 0x7faef0097330 2024-09-13T18:40:37.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.528+0000 7faef7d1d640 1 -- 172.21.15.97:0/1821742672 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef0129ae0 con 0x7faef0097330 2024-09-13T18:40:37.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.532+0000 7faee1ffb640 1 -- 172.21.15.97:0/1821742672 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7faee4037080 con 0x7faef0097330 2024-09-13T18:40:37.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.711+0000 7faef7d1d640 1 -- 172.21.15.97:0/1821742672 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7faef0064000 con 0x7faef0097330 2024-09-13T18:40:37.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.711+0000 7faee1ffb640 1 -- 172.21.15.97:0/1821742672 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7faee404a080 con 0x7faef0097330 2024-09-13T18:40:37.714 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:40:37.714 INFO:teuthology.orchestra.run.smithi097.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:40:37.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.713+0000 7faef7d1d640 1 -- 172.21.15.97:0/1821742672 >> v1:172.21.15.97:6816/34603 conn(0x7faed4031160 legacy=0x7faed4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.713+0000 7faef7d1d640 1 -- 172.21.15.97:0/1821742672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef0097330 msgr2=0x7faef012d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.713+0000 7faef7d1d640 1 --2- 172.21.15.97:0/1821742672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef0097330 0x7faef012d750 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faee40098e0 tx=0x7faee4032000 comp rx=0 tx=0).stop 2024-09-13T18:40:37.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.713+0000 7faef7d1d640 1 -- 172.21.15.97:0/1821742672 shutdown_connections 2024-09-13T18:40:37.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.713+0000 7faef7d1d640 1 --2- 172.21.15.97:0/1821742672 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7faef009dfb0 0x7faef01274a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.713+0000 7faef7d1d640 1 --2- 172.21.15.97:0/1821742672 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7faef0097700 0x7faef0126f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.713+0000 7faef7d1d640 1 --2- 172.21.15.97:0/1821742672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faef0097330 0x7faef012d750 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.713+0000 7faef7d1d640 1 -- 172.21.15.97:0/1821742672 >> 172.21.15.97:0/1821742672 conn(0x7faef005db50 msgr2=0x7faef006a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:37.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.713+0000 7faef7d1d640 1 -- 172.21.15.97:0/1821742672 shutdown_connections 2024-09-13T18:40:37.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.713+0000 7faef7d1d640 1 -- 172.21.15.97:0/1821742672 wait complete. 2024-09-13T18:40:37.726 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:40:37.726 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:40:37.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.817+0000 7fd50b554640 1 Processor -- start 2024-09-13T18:40:37.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.817+0000 7fd50b554640 1 -- start start 2024-09-13T18:40:37.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.817+0000 7fd50b554640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd50409dfb0 0x7fd504096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.817+0000 7fd50b554640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5040969d0 0x7fd5040974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.817+0000 7fd50b554640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50406a190 con 0x7fd50412bf70 2024-09-13T18:40:37.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.817+0000 7fd50b554640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50409e380 con 0x7fd50409dfb0 2024-09-13T18:40:37.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.817+0000 7fd50b554640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd504098870 con 0x7fd5040969d0 2024-09-13T18:40:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.818+0000 7fd5092f0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd50409dfb0 0x7fd504096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.818+0000 7fd509af1640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd50412bf70 0x7fd50412c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58220/0 (socket says 172.21.15.97:58220) 2024-09-13T18:40:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.818+0000 7fd508aef640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5040969d0 0x7fd5040974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.818+0000 7fd509af1640 1 -- 172.21.15.97:0/3790540534 learned_addr learned my addr 172.21.15.97:0/3790540534 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:40:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.818+0000 7fd5092f0640 1 -- 172.21.15.97:0/3790540534 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5040969d0 msgr2=0x7fd5040974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.818+0000 7fd5092f0640 1 --2- 172.21.15.97:0/3790540534 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5040969d0 0x7fd5040974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.818+0000 7fd5092f0640 1 -- 172.21.15.97:0/3790540534 >> v1:172.21.15.97:6789/0 conn(0x7fd50412bf70 legacy=0x7fd50412c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.818+0000 7fd4fbfff640 1 -- 172.21.15.97:0/3790540534 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649818125 0 0) 0x7fd50406a190 con 0x7fd50412bf70 2024-09-13T18:40:37.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.818+0000 7fd5092f0640 1 -- 172.21.15.97:0/3790540534 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd504098e10 con 0x7fd50409dfb0 2024-09-13T18:40:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.818+0000 7fd508aef640 1 --2- 172.21.15.97:0/3790540534 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5040969d0 0x7fd5040974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.819+0000 7fd5092f0640 1 --2- 172.21.15.97:0/3790540534 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd50409dfb0 0x7fd504096f80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd500009880 tx=0x7fd5000090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67c4286f5f662fc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.819+0000 7fd4fbfff640 1 -- 172.21.15.97:0/3790540534 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50002ace0 con 0x7fd50409dfb0 2024-09-13T18:40:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.819+0000 7fd4fbfff640 1 -- 172.21.15.97:0/3790540534 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50002ae40 con 0x7fd50409dfb0 2024-09-13T18:40:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.819+0000 7fd4fbfff640 1 -- 172.21.15.97:0/3790540534 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500032670 con 0x7fd50409dfb0 2024-09-13T18:40:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.819+0000 7fd50b554640 1 -- 172.21.15.97:0/3790540534 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd50409dfb0 msgr2=0x7fd504096f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.819+0000 7fd50b554640 1 --2- 172.21.15.97:0/3790540534 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd50409dfb0 0x7fd504096f80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd500009880 tx=0x7fd5000090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.819+0000 7fd50b554640 1 -- 172.21.15.97:0/3790540534 shutdown_connections 2024-09-13T18:40:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.819+0000 7fd50b554640 1 --2- 172.21.15.97:0/3790540534 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5040969d0 0x7fd5040974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.819+0000 7fd50b554640 1 --2- 172.21.15.97:0/3790540534 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd50409dfb0 0x7fd504096f80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.819+0000 7fd50b554640 1 -- 172.21.15.97:0/3790540534 >> 172.21.15.97:0/3790540534 conn(0x7fd50409b200 msgr2=0x7fd50409b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.819+0000 7fd50b554640 1 -- 172.21.15.97:0/3790540534 shutdown_connections 2024-09-13T18:40:37.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.819+0000 7fd50b554640 1 -- 172.21.15.97:0/3790540534 wait complete. 2024-09-13T18:40:37.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.820+0000 7fd50b554640 1 Processor -- start 2024-09-13T18:40:37.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.820+0000 7fd50b554640 1 -- start start 2024-09-13T18:40:37.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd50b554640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5040969d0 0x7fd50413c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd50b554640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd50409dfb0 0x7fd50413cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd50b554640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd50412bf70 0x7fd504118280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:37.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd50b554640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50411a2f0 con 0x7fd50412bf70 2024-09-13T18:40:37.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd50b554640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50411b7b0 con 0x7fd50409dfb0 2024-09-13T18:40:37.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd50b554640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd504130570 con 0x7fd5040969d0 2024-09-13T18:40:37.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd5092f0640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5040969d0 0x7fd50413c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd508aef640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd50409dfb0 0x7fd50413cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd5092f0640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5040969d0 0x7fd50413c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51532/0 (socket says 172.21.15.97:51532) 2024-09-13T18:40:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd5092f0640 1 -- 172.21.15.97:0/2999429384 learned_addr learned my addr 172.21.15.97:0/2999429384 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd509af1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd50412bf70 0x7fd504118280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd5092f0640 1 -- 172.21.15.97:0/2999429384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd50409dfb0 msgr2=0x7fd50413cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd5092f0640 1 --2- 172.21.15.97:0/2999429384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd50409dfb0 0x7fd50413cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd5092f0640 1 -- 172.21.15.97:0/2999429384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd50412bf70 msgr2=0x7fd504118280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd5092f0640 1 --2- 172.21.15.97:0/2999429384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd50412bf70 0x7fd504118280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd5092f0640 1 -- 172.21.15.97:0/2999429384 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f4009390 con 0x7fd5040969d0 2024-09-13T18:40:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd508aef640 1 --2- 172.21.15.97:0/2999429384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd50409dfb0 0x7fd50413cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd5092f0640 1 --2- 172.21.15.97:0/2999429384 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5040969d0 0x7fd50413c7c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd50002a610 tx=0x7fd500032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd4f97fa640 1 -- 172.21.15.97:0/2999429384 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500031700 con 0x7fd5040969d0 2024-09-13T18:40:37.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd4f97fa640 1 -- 172.21.15.97:0/2999429384 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd500031860 con 0x7fd5040969d0 2024-09-13T18:40:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd50b554640 1 -- 172.21.15.97:0/2999429384 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd500009390 con 0x7fd5040969d0 2024-09-13T18:40:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd4f97fa640 1 -- 172.21.15.97:0/2999429384 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500031c20 con 0x7fd5040969d0 2024-09-13T18:40:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.821+0000 7fd50b554640 1 -- 172.21.15.97:0/2999429384 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50411a530 con 0x7fd5040969d0 2024-09-13T18:40:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.822+0000 7fd4f97fa640 1 -- 172.21.15.97:0/2999429384 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fd500039040 con 0x7fd5040969d0 2024-09-13T18:40:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.822+0000 7fd4f97fa640 1 -- 172.21.15.97:0/2999429384 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fd500041030 con 0x7fd5040969d0 2024-09-13T18:40:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.823+0000 7fd50b554640 1 -- 172.21.15.97:0/2999429384 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd504097e80 con 0x7fd5040969d0 2024-09-13T18:40:37.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.827+0000 7fd4f97fa640 1 -- 172.21.15.97:0/2999429384 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fd50004b080 con 0x7fd5040969d0 2024-09-13T18:40:37.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.979+0000 7fd50b554640 1 -- 172.21.15.97:0/2999429384 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd50411b8f0 con 0x7fd5040969d0 2024-09-13T18:40:37.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.980+0000 7fd4f97fa640 1 -- 172.21.15.97:0/2999429384 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+11626 (secure 0 0 0) 0x7fd500037020 con 0x7fd5040969d0 2024-09-13T18:40:37.983 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:40:37.983 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":23,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:54.652125+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.8","mappings":[{"from":1,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:37.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.982+0000 7fd50b554640 1 -- 172.21.15.97:0/2999429384 >> v1:172.21.15.97:6816/34603 conn(0x7fd4e8031160 legacy=0x7fd4e8033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.982+0000 7fd50b554640 1 -- 172.21.15.97:0/2999429384 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5040969d0 msgr2=0x7fd50413c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:37.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.982+0000 7fd50b554640 1 --2- 172.21.15.97:0/2999429384 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5040969d0 0x7fd50413c7c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd50002a610 tx=0x7fd500032000 comp rx=0 tx=0).stop 2024-09-13T18:40:37.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.982+0000 7fd50b554640 1 -- 172.21.15.97:0/2999429384 shutdown_connections 2024-09-13T18:40:37.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.982+0000 7fd50b554640 1 --2- 172.21.15.97:0/2999429384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd50412bf70 0x7fd504118280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.982+0000 7fd50b554640 1 --2- 172.21.15.97:0/2999429384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd50409dfb0 0x7fd50413cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.982+0000 7fd50b554640 1 --2- 172.21.15.97:0/2999429384 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd5040969d0 0x7fd50413c7c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:37.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.982+0000 7fd50b554640 1 -- 172.21.15.97:0/2999429384 >> 172.21.15.97:0/2999429384 conn(0x7fd50409b200 msgr2=0x7fd50409ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:37.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.982+0000 7fd50b554640 1 -- 172.21.15.97:0/2999429384 shutdown_connections 2024-09-13T18:40:37.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:37.982+0000 7fd50b554640 1 -- 172.21.15.97:0/2999429384 wait complete. 2024-09-13T18:40:37.995 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:39:01.375967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T18:39:05.732412+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:39:12.014248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:39:12.844264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:40:37.996 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:40:38.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f07860dd640 1 Processor -- start 2024-09-13T18:40:38.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f07860dd640 1 -- start start 2024-09-13T18:40:38.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f07860dd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f07800969d0 0x7f078012c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f07860dd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 0x7f0780098370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f07860dd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f078012cd60 0x7f07800988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f07860dd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0780096da0 con 0x7f07800969d0 2024-09-13T18:40:38.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f07860dd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078009ac80 con 0x7f078012c990 2024-09-13T18:40:38.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f07860dd640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0780097080 con 0x7f078012cd60 2024-09-13T18:40:38.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f077f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f07800969d0 0x7f078012c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f0776ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 0x7f0780098370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f077ffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f078012cd60 0x7f07800988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f077f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f07800969d0 0x7f078012c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44042/0 (socket says 172.21.15.97:44042) 2024-09-13T18:40:38.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f077f7fe640 1 -- 172.21.15.97:0/1296045057 learned_addr learned my addr 172.21.15.97:0/1296045057 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:38.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f0776ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 0x7f0780098370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37252/0 (socket says 172.21.15.97:37252) 2024-09-13T18:40:38.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f077f7fe640 1 -- 172.21.15.97:0/1296045057 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f078012cd60 msgr2=0x7f07800988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:38.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.090+0000 7f077f7fe640 1 --2- 172.21.15.97:0/1296045057 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f078012cd60 0x7f07800988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.091+0000 7f077f7fe640 1 -- 172.21.15.97:0/1296045057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 msgr2=0x7f0780098370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:38.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.091+0000 7f077f7fe640 1 --2- 172.21.15.97:0/1296045057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 0x7f0780098370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.091+0000 7f077f7fe640 1 -- 172.21.15.97:0/1296045057 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0780099590 con 0x7f07800969d0 2024-09-13T18:40:38.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.091+0000 7f0776ffd640 1 --2- 172.21.15.97:0/1296045057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 0x7f0780098370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:38.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.091+0000 7f077ffff640 1 --2- 172.21.15.97:0/1296045057 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f078012cd60 0x7f07800988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:38.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.091+0000 7f077f7fe640 1 --2- 172.21.15.97:0/1296045057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07800969d0 0x7f078012c450 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f077000b9d0 tx=0x7f07700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a0d56465b176e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:38.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.091+0000 7f077effd640 1 -- 172.21.15.97:0/1296045057 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770031400 con 0x7f07800969d0 2024-09-13T18:40:38.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.091+0000 7f077effd640 1 -- 172.21.15.97:0/1296045057 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077002d050 con 0x7f07800969d0 2024-09-13T18:40:38.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.091+0000 7f077effd640 1 -- 172.21.15.97:0/1296045057 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07700317d0 con 0x7f07800969d0 2024-09-13T18:40:38.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.092+0000 7f07860dd640 1 -- 172.21.15.97:0/1296045057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07800969d0 msgr2=0x7f078012c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.092+0000 7f07860dd640 1 --2- 172.21.15.97:0/1296045057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07800969d0 0x7f078012c450 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f077000b9d0 tx=0x7f07700090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.092+0000 7f07860dd640 1 -- 172.21.15.97:0/1296045057 shutdown_connections 2024-09-13T18:40:38.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.092+0000 7f07860dd640 1 --2- 172.21.15.97:0/1296045057 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f078012cd60 0x7f07800988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.092+0000 7f07860dd640 1 --2- 172.21.15.97:0/1296045057 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 0x7f0780098370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.092+0000 7f07860dd640 1 --2- 172.21.15.97:0/1296045057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07800969d0 0x7f078012c450 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.092+0000 7f07860dd640 1 -- 172.21.15.97:0/1296045057 >> 172.21.15.97:0/1296045057 conn(0x7f078009b170 msgr2=0x7f078009b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:38.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.092+0000 7f07860dd640 1 -- 172.21.15.97:0/1296045057 shutdown_connections 2024-09-13T18:40:38.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.092+0000 7f07860dd640 1 -- 172.21.15.97:0/1296045057 wait complete. 2024-09-13T18:40:38.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f07860dd640 1 Processor -- start 2024-09-13T18:40:38.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f07860dd640 1 -- start start 2024-09-13T18:40:38.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f07860dd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f07800969d0 0x7f07801196c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f07860dd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 0x7f0780119c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f07860dd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f078012cd60 0x7f078011a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f07860dd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078011bc70 con 0x7f078012cd60 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f07860dd640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0780099d50 con 0x7f078012c990 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f07860dd640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f078011cb40 con 0x7f07800969d0 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f0776ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 0x7f0780119c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f077ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f078012cd60 0x7f078011a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f077f7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f07800969d0 0x7f07801196c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f0776ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 0x7f0780119c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37266/0 (socket says 172.21.15.97:37266) 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f077ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f078012cd60 0x7f078011a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44044/0 (socket says 172.21.15.97:44044) 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.093+0000 7f0776ffd640 1 -- 172.21.15.97:0/205597073 learned_addr learned my addr 172.21.15.97:0/205597073 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.094+0000 7f0776ffd640 1 -- 172.21.15.97:0/205597073 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f07800969d0 msgr2=0x7f07801196c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.094+0000 7f0776ffd640 1 --2- 172.21.15.97:0/205597073 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f07800969d0 0x7f07801196c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.094+0000 7f0776ffd640 1 -- 172.21.15.97:0/205597073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f078012cd60 msgr2=0x7f078011a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.094+0000 7f0776ffd640 1 --2- 172.21.15.97:0/205597073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f078012cd60 0x7f078011a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.094+0000 7f0776ffd640 1 -- 172.21.15.97:0/205597073 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076800d830 con 0x7f078012c990 2024-09-13T18:40:38.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.094+0000 7f077f7fe640 1 --2- 172.21.15.97:0/205597073 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f07800969d0 0x7f07801196c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:38.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.094+0000 7f077ffff640 1 --2- 172.21.15.97:0/205597073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f078012cd60 0x7f078011a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:38.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.094+0000 7f0776ffd640 1 --2- 172.21.15.97:0/205597073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 0x7f0780119c00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f076800deb0 tx=0x7f076800f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:38.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.094+0000 7f0777fff640 1 -- 172.21.15.97:0/205597073 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800d2e0 con 0x7f078012c990 2024-09-13T18:40:38.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.094+0000 7f0777fff640 1 -- 172.21.15.97:0/205597073 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0768013040 con 0x7f078012c990 2024-09-13T18:40:38.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.094+0000 7f07860dd640 1 -- 172.21.15.97:0/205597073 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0778009a20 con 0x7f078012c990 2024-09-13T18:40:38.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.094+0000 7f0777fff640 1 -- 172.21.15.97:0/205597073 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768010d50 con 0x7f078012c990 2024-09-13T18:40:38.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.094+0000 7f07860dd640 1 -- 172.21.15.97:0/205597073 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077000b510 con 0x7f078012c990 2024-09-13T18:40:38.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.095+0000 7f0777fff640 1 -- 172.21.15.97:0/205597073 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f0768018690 con 0x7f078012c990 2024-09-13T18:40:38.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.095+0000 7f0777fff640 1 -- 172.21.15.97:0/205597073 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f0768046210 con 0x7f078012c990 2024-09-13T18:40:38.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.095+0000 7f07860dd640 1 -- 172.21.15.97:0/205597073 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078011cd60 con 0x7f078012c990 2024-09-13T18:40:38.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.099+0000 7f0777fff640 1 -- 172.21.15.97:0/205597073 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f076800b450 con 0x7f078012c990 2024-09-13T18:40:38.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.250+0000 7f07860dd640 1 -- 172.21.15.97:0/205597073 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07800714b0 con 0x7f078012c990 2024-09-13T18:40:38.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.251+0000 7f0777fff640 1 -- 172.21.15.97:0/205597073 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0768016e60 con 0x7f078012c990 2024-09-13T18:40:38.253 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2024-09-13T18:40:38.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.253+0000 7f07860dd640 1 -- 172.21.15.97:0/205597073 >> v1:172.21.15.97:6816/34603 conn(0x7f0760031190 legacy=0x7f0760033640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.253+0000 7f07860dd640 1 -- 172.21.15.97:0/205597073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 msgr2=0x7f0780119c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.253+0000 7f07860dd640 1 --2- 172.21.15.97:0/205597073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 0x7f0780119c00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f076800deb0 tx=0x7f076800f040 comp rx=0 tx=0).stop 2024-09-13T18:40:38.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.253+0000 7f07860dd640 1 -- 172.21.15.97:0/205597073 shutdown_connections 2024-09-13T18:40:38.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.253+0000 7f07860dd640 1 --2- 172.21.15.97:0/205597073 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f078012cd60 0x7f078011a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.253+0000 7f07860dd640 1 --2- 172.21.15.97:0/205597073 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f078012c990 0x7f0780119c00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.253+0000 7f07860dd640 1 --2- 172.21.15.97:0/205597073 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f07800969d0 0x7f07801196c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.253+0000 7f07860dd640 1 -- 172.21.15.97:0/205597073 >> 172.21.15.97:0/205597073 conn(0x7f078009b170 msgr2=0x7f078006da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:38.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.253+0000 7f07860dd640 1 -- 172.21.15.97:0/205597073 shutdown_connections 2024-09-13T18:40:38.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.253+0000 7f07860dd640 1 -- 172.21.15.97:0/205597073 wait complete. 2024-09-13T18:40:38.266 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-13T18:40:38.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.359+0000 7f7843d9d640 1 Processor -- start 2024-09-13T18:40:38.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.359+0000 7f7843d9d640 1 -- start start 2024-09-13T18:40:38.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.359+0000 7f7843d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f783c097d40 0x7f783c098140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.359+0000 7f7843d9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f783c130e80 0x7f783c133260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f7843d9d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783c06ead0 con 0x7f783c097260 2024-09-13T18:40:38.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f7843d9d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f783c099900 con 0x7f783c097d40 2024-09-13T18:40:38.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f7843d9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f783c09a820 con 0x7f783c130e80 2024-09-13T18:40:38.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f7841338640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f783c097d40 0x7f783c098140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f784233a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f783c130e80 0x7f783c133260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f7841338640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f783c097d40 0x7f783c098140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44048/0 (socket says 172.21.15.97:44048) 2024-09-13T18:40:38.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f7841338640 1 -- 172.21.15.97:0/3128843547 learned_addr learned my addr 172.21.15.97:0/3128843547 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:38.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f784233a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f783c130e80 0x7f783c133260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51554/0 (socket says 172.21.15.97:51554) 2024-09-13T18:40:38.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f7841b39640 1 --1- 172.21.15.97:0/3128843547 >> v1:172.21.15.97:6789/0 conn(0x7f783c097260 0x7f783c097630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58226/0 (socket says 172.21.15.97:58226) 2024-09-13T18:40:38.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f7841338640 1 -- 172.21.15.97:0/3128843547 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f783c130e80 msgr2=0x7f783c133260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:38.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f7841338640 1 --2- 172.21.15.97:0/3128843547 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f783c130e80 0x7f783c133260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f7841338640 1 -- 172.21.15.97:0/3128843547 >> v1:172.21.15.97:6789/0 conn(0x7f783c097260 legacy=0x7f783c097630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f7841338640 1 -- 172.21.15.97:0/3128843547 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c098dd0 con 0x7f783c097d40 2024-09-13T18:40:38.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f7840b37640 1 -- 172.21.15.97:0/3128843547 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966548424 0 0) 0x7f783c06ead0 con 0x7f783c097260 2024-09-13T18:40:38.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.360+0000 7f784233a640 1 --2- 172.21.15.97:0/3128843547 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f783c130e80 0x7f783c133260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:38.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.361+0000 7f7841338640 1 --2- 172.21.15.97:0/3128843547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f783c097d40 0x7f783c098140 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f782c009910 tx=0x7f782c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45afe87028cbce74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:38.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.361+0000 7f7840b37640 1 -- 172.21.15.97:0/3128843547 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c02ad20 con 0x7f783c097d40 2024-09-13T18:40:38.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.361+0000 7f7840b37640 1 -- 172.21.15.97:0/3128843547 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782c02ae80 con 0x7f783c097d40 2024-09-13T18:40:38.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.361+0000 7f7840b37640 1 -- 172.21.15.97:0/3128843547 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c032670 con 0x7f783c097d40 2024-09-13T18:40:38.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.361+0000 7f7843d9d640 1 -- 172.21.15.97:0/3128843547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f783c097d40 msgr2=0x7f783c098140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.361+0000 7f7843d9d640 1 --2- 172.21.15.97:0/3128843547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f783c097d40 0x7f783c098140 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f782c009910 tx=0x7f782c0091d0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.361+0000 7f7843d9d640 1 -- 172.21.15.97:0/3128843547 shutdown_connections 2024-09-13T18:40:38.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.361+0000 7f7843d9d640 1 --2- 172.21.15.97:0/3128843547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f783c097d40 0x7f783c098140 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.361+0000 7f7843d9d640 1 --2- 172.21.15.97:0/3128843547 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f783c130e80 0x7f783c133260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.361+0000 7f7843d9d640 1 -- 172.21.15.97:0/3128843547 >> 172.21.15.97:0/3128843547 conn(0x7f783c09b170 msgr2=0x7f783c09b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:38.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.361+0000 7f7843d9d640 1 -- 172.21.15.97:0/3128843547 shutdown_connections 2024-09-13T18:40:38.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.362+0000 7f7843d9d640 1 -- 172.21.15.97:0/3128843547 wait complete. 2024-09-13T18:40:38.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.362+0000 7f7843d9d640 1 Processor -- start 2024-09-13T18:40:38.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.362+0000 7f7843d9d640 1 -- start start 2024-09-13T18:40:38.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7843d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f783c097260 0x7f783c12d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7843d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f783c097d40 0x7f783c117890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7843d9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f783c130e80 0x7f783c117dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7843d9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c09df40 con 0x7f783c097d40 2024-09-13T18:40:38.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7843d9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783c12dd70 con 0x7f783c097260 2024-09-13T18:40:38.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7843d9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f783c1194b0 con 0x7f783c130e80 2024-09-13T18:40:38.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7841338640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f783c097d40 0x7f783c117890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7841b39640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f783c097260 0x7f783c12d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7841338640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f783c097d40 0x7f783c117890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44052/0 (socket says 172.21.15.97:44052) 2024-09-13T18:40:38.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7841338640 1 -- 172.21.15.97:0/1800824146 learned_addr learned my addr 172.21.15.97:0/1800824146 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:38.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f784233a640 1 --2- 172.21.15.97:0/1800824146 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f783c130e80 0x7f783c117dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7841338640 1 -- 172.21.15.97:0/1800824146 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f783c130e80 msgr2=0x7f783c117dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7841338640 1 --2- 172.21.15.97:0/1800824146 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f783c130e80 0x7f783c117dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7841338640 1 -- 172.21.15.97:0/1800824146 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f783c097260 msgr2=0x7f783c12d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7841338640 1 --2- 172.21.15.97:0/1800824146 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f783c097260 0x7f783c12d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7841338640 1 -- 172.21.15.97:0/1800824146 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7834009a20 con 0x7f783c097d40 2024-09-13T18:40:38.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.363+0000 7f7841338640 1 --2- 172.21.15.97:0/1800824146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f783c097d40 0x7f783c117890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f782c02a720 tx=0x7f782c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:38.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.364+0000 7f7831ffb640 1 -- 172.21.15.97:0/1800824146 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c031630 con 0x7f783c097d40 2024-09-13T18:40:38.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.364+0000 7f7831ffb640 1 -- 172.21.15.97:0/1800824146 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782c031790 con 0x7f783c097d40 2024-09-13T18:40:38.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.364+0000 7f7831ffb640 1 -- 172.21.15.97:0/1800824146 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c031b30 con 0x7f783c097d40 2024-09-13T18:40:38.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.364+0000 7f7843d9d640 1 -- 172.21.15.97:0/1800824146 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c009450 con 0x7f783c097d40 2024-09-13T18:40:38.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.364+0000 7f7843d9d640 1 -- 172.21.15.97:0/1800824146 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783c11aca0 con 0x7f783c097d40 2024-09-13T18:40:38.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.364+0000 7f7831ffb640 1 -- 172.21.15.97:0/1800824146 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f782c039070 con 0x7f783c097d40 2024-09-13T18:40:38.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.365+0000 7f7831ffb640 1 -- 172.21.15.97:0/1800824146 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f782c062400 con 0x7f783c097d40 2024-09-13T18:40:38.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.365+0000 7f7843d9d640 1 -- 172.21.15.97:0/1800824146 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783c0714b0 con 0x7f783c097d40 2024-09-13T18:40:38.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.369+0000 7f7831ffb640 1 -- 172.21.15.97:0/1800824146 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f782c037080 con 0x7f783c097d40 2024-09-13T18:40:38.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.520+0000 7f7843d9d640 1 -- 172.21.15.97:0/1800824146 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f783c09f4e0 con 0x7f783c097d40 2024-09-13T18:40:38.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.521+0000 7f7831ffb640 1 -- 172.21.15.97:0/1800824146 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f782c04a030 con 0x7f783c097d40 2024-09-13T18:40:38.524 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 8 2024-09-13T18:40:38.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.523+0000 7f7843d9d640 1 -- 172.21.15.97:0/1800824146 >> v1:172.21.15.97:6816/34603 conn(0x7f7820031160 legacy=0x7f7820033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.523+0000 7f7843d9d640 1 -- 172.21.15.97:0/1800824146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f783c097d40 msgr2=0x7f783c117890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.523+0000 7f7843d9d640 1 --2- 172.21.15.97:0/1800824146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f783c097d40 0x7f783c117890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f782c02a720 tx=0x7f782c032000 comp rx=0 tx=0).stop 2024-09-13T18:40:38.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.523+0000 7f7843d9d640 1 -- 172.21.15.97:0/1800824146 shutdown_connections 2024-09-13T18:40:38.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.523+0000 7f7843d9d640 1 --2- 172.21.15.97:0/1800824146 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f783c130e80 0x7f783c117dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.523+0000 7f7843d9d640 1 --2- 172.21.15.97:0/1800824146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f783c097d40 0x7f783c117890 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.523+0000 7f7843d9d640 1 --2- 172.21.15.97:0/1800824146 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f783c097260 0x7f783c12d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.523+0000 7f7843d9d640 1 -- 172.21.15.97:0/1800824146 >> 172.21.15.97:0/1800824146 conn(0x7f783c09b170 msgr2=0x7f783c12dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:38.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.523+0000 7f7843d9d640 1 -- 172.21.15.97:0/1800824146 shutdown_connections 2024-09-13T18:40:38.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.523+0000 7f7843d9d640 1 -- 172.21.15.97:0/1800824146 wait complete. 2024-09-13T18:40:38.535 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:40:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.629+0000 7f97a62c9640 1 Processor -- start 2024-09-13T18:40:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f97a62c9640 1 -- start start 2024-09-13T18:40:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f97a62c9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97a009f100 0x7f97a009f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f97a62c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012f3a0 0x7f97a012f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f97a62c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f97a012fd10 0x7f97a0136700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f97a62c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a0069fe0 con 0x7f97a012fd10 2024-09-13T18:40:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f97a62c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a009ecf0 con 0x7f97a012f3a0 2024-09-13T18:40:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f97a62c9640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0068dd0 con 0x7f97a009f100 2024-09-13T18:40:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f979ffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97a009f100 0x7f97a009f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f9797fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012f3a0 0x7f97a012f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f97a4866640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f97a012fd10 0x7f97a0136700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f9797fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012f3a0 0x7f97a012f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37294/0 (socket says 172.21.15.97:37294) 2024-09-13T18:40:38.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f97a4866640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f97a012fd10 0x7f97a0136700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44068/0 (socket says 172.21.15.97:44068) 2024-09-13T18:40:38.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f97a4866640 1 -- 172.21.15.97:0/3053969077 learned_addr learned my addr 172.21.15.97:0/3053969077 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:38.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f979ffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97a009f100 0x7f97a009f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51562/0 (socket says 172.21.15.97:51562) 2024-09-13T18:40:38.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f9797fff640 1 -- 172.21.15.97:0/3053969077 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97a009f100 msgr2=0x7f97a009f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:38.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f9797fff640 1 --2- 172.21.15.97:0/3053969077 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97a009f100 0x7f97a009f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f9797fff640 1 -- 172.21.15.97:0/3053969077 >> v2:172.21.15.97:3300/0 conn(0x7f97a012fd10 msgr2=0x7f97a0136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:38.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f9797fff640 1 --2- 172.21.15.97:0/3053969077 >> v2:172.21.15.97:3300/0 conn(0x7f97a012fd10 0x7f97a0136700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f9797fff640 1 -- 172.21.15.97:0/3053969077 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a0068b30 con 0x7f97a012f3a0 2024-09-13T18:40:38.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f97a4866640 1 --2- 172.21.15.97:0/3053969077 >> v2:172.21.15.97:3300/0 conn(0x7f97a012fd10 0x7f97a0136700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:38.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.630+0000 7f979ffff640 1 --2- 172.21.15.97:0/3053969077 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97a009f100 0x7f97a009f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:38.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.631+0000 7f9797fff640 1 --2- 172.21.15.97:0/3053969077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012f3a0 0x7f97a012f7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9788009850 tx=0x7f97880090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a45048f8948ef711 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:38.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.631+0000 7f979f7fe640 1 -- 172.21.15.97:0/3053969077 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978802abc0 con 0x7f97a012f3a0 2024-09-13T18:40:38.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.631+0000 7f979f7fe640 1 -- 172.21.15.97:0/3053969077 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978802ad20 con 0x7f97a012f3a0 2024-09-13T18:40:38.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.631+0000 7f979f7fe640 1 -- 172.21.15.97:0/3053969077 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788032670 con 0x7f97a012f3a0 2024-09-13T18:40:38.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.632+0000 7f97a62c9640 1 -- 172.21.15.97:0/3053969077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012f3a0 msgr2=0x7f97a012f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.632+0000 7f97a62c9640 1 --2- 172.21.15.97:0/3053969077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012f3a0 0x7f97a012f7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9788009850 tx=0x7f97880090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.632+0000 7f97a62c9640 1 -- 172.21.15.97:0/3053969077 shutdown_connections 2024-09-13T18:40:38.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.632+0000 7f97a62c9640 1 --2- 172.21.15.97:0/3053969077 >> v2:172.21.15.97:3300/0 conn(0x7f97a012fd10 0x7f97a0136700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.632+0000 7f97a62c9640 1 --2- 172.21.15.97:0/3053969077 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012f3a0 0x7f97a012f7d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.632+0000 7f97a62c9640 1 --2- 172.21.15.97:0/3053969077 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97a009f100 0x7f97a009f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.632+0000 7f97a62c9640 1 -- 172.21.15.97:0/3053969077 >> 172.21.15.97:0/3053969077 conn(0x7f97a0067b90 msgr2=0x7f97a00a0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:38.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.632+0000 7f97a62c9640 1 -- 172.21.15.97:0/3053969077 shutdown_connections 2024-09-13T18:40:38.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.632+0000 7f97a62c9640 1 -- 172.21.15.97:0/3053969077 wait complete. 2024-09-13T18:40:38.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f97a62c9640 1 Processor -- start 2024-09-13T18:40:38.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f97a62c9640 1 -- start start 2024-09-13T18:40:38.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f97a62c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97a009f100 0x7f97a011c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f97a62c9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97a012f3a0 0x7f97a0118d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f97a62c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012fd10 0x7f97a0119250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f97a62c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0068660 con 0x7f97a009f100 2024-09-13T18:40:38.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f97a62c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a011b990 con 0x7f97a012fd10 2024-09-13T18:40:38.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f97a62c9640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0118a00 con 0x7f97a012f3a0 2024-09-13T18:40:38.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f979ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97a009f100 0x7f97a011c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f9797fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97a012f3a0 0x7f97a0118d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f97a4866640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012fd10 0x7f97a0119250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f979ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97a009f100 0x7f97a011c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44080/0 (socket says 172.21.15.97:44080) 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f97a4866640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012fd10 0x7f97a0119250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37300/0 (socket says 172.21.15.97:37300) 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f979ffff640 1 -- 172.21.15.97:0/715089233 learned_addr learned my addr 172.21.15.97:0/715089233 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f979ffff640 1 -- 172.21.15.97:0/715089233 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97a012f3a0 msgr2=0x7f97a0118d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f979ffff640 1 --2- 172.21.15.97:0/715089233 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97a012f3a0 0x7f97a0118d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f979ffff640 1 -- 172.21.15.97:0/715089233 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012fd10 msgr2=0x7f97a0119250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f979ffff640 1 --2- 172.21.15.97:0/715089233 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012fd10 0x7f97a0119250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f979ffff640 1 -- 172.21.15.97:0/715089233 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790009390 con 0x7f97a009f100 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f97a4866640 1 --2- 172.21.15.97:0/715089233 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012fd10 0x7f97a0119250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.633+0000 7f9797fff640 1 --2- 172.21.15.97:0/715089233 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97a012f3a0 0x7f97a0118d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.634+0000 7f979ffff640 1 --2- 172.21.15.97:0/715089233 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97a009f100 0x7f97a011c430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f979000ec80 tx=0x7f97900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.634+0000 7f979cff9640 1 -- 172.21.15.97:0/715089233 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979000eec0 con 0x7f97a009f100 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.634+0000 7f979cff9640 1 -- 172.21.15.97:0/715089233 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979000cbc0 con 0x7f97a009f100 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.634+0000 7f979cff9640 1 -- 172.21.15.97:0/715089233 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790013470 con 0x7f97a009f100 2024-09-13T18:40:38.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.634+0000 7f97a62c9640 1 -- 172.21.15.97:0/715089233 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9798009ae0 con 0x7f97a009f100 2024-09-13T18:40:38.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.634+0000 7f97a62c9640 1 -- 172.21.15.97:0/715089233 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9788009390 con 0x7f97a009f100 2024-09-13T18:40:38.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.634+0000 7f979cff9640 1 -- 172.21.15.97:0/715089233 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f97900137e0 con 0x7f97a009f100 2024-09-13T18:40:38.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.635+0000 7f979cff9640 1 -- 172.21.15.97:0/715089233 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f9790042530 con 0x7f97a009f100 2024-09-13T18:40:38.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.635+0000 7f97a62c9640 1 -- 172.21.15.97:0/715089233 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a011bf80 con 0x7f97a009f100 2024-09-13T18:40:38.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.639+0000 7f979cff9640 1 -- 172.21.15.97:0/715089233 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f9790021070 con 0x7f97a009f100 2024-09-13T18:40:38.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.791+0000 7f97a62c9640 1 -- 172.21.15.97:0/715089233 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97a0064600 con 0x7f97a009f100 2024-09-13T18:40:38.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.791+0000 7f979cff9640 1 -- 172.21.15.97:0/715089233 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9790021020 con 0x7f97a009f100 2024-09-13T18:40:38.794 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2024-09-13T18:40:38.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.793+0000 7f97a62c9640 1 -- 172.21.15.97:0/715089233 >> v1:172.21.15.97:6816/34603 conn(0x7f9780031160 legacy=0x7f9780033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.793+0000 7f97a62c9640 1 -- 172.21.15.97:0/715089233 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97a009f100 msgr2=0x7f97a011c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.793+0000 7f97a62c9640 1 --2- 172.21.15.97:0/715089233 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97a009f100 0x7f97a011c430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f979000ec80 tx=0x7f97900090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.793+0000 7f97a62c9640 1 -- 172.21.15.97:0/715089233 shutdown_connections 2024-09-13T18:40:38.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.793+0000 7f97a62c9640 1 --2- 172.21.15.97:0/715089233 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f97a012fd10 0x7f97a0119250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.793+0000 7f97a62c9640 1 --2- 172.21.15.97:0/715089233 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f97a012f3a0 0x7f97a0118d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.793+0000 7f97a62c9640 1 --2- 172.21.15.97:0/715089233 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97a009f100 0x7f97a011c430 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.793+0000 7f97a62c9640 1 -- 172.21.15.97:0/715089233 >> 172.21.15.97:0/715089233 conn(0x7f97a0067b90 msgr2=0x7f97a012e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:38.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.793+0000 7f97a62c9640 1 -- 172.21.15.97:0/715089233 shutdown_connections 2024-09-13T18:40:38.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.793+0000 7f97a62c9640 1 -- 172.21.15.97:0/715089233 wait complete. 2024-09-13T18:40:38.807 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:40:38.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.901+0000 7f3a32434640 1 Processor -- start 2024-09-13T18:40:38.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.901+0000 7f3a32434640 1 -- start start 2024-09-13T18:40:38.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.901+0000 7f3a32434640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a2c09a580 0x7f3a2c096ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.901+0000 7f3a32434640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 0x7f3a2c097480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.901+0000 7f3a32434640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2c06a4a0 con 0x7f3a2c0979c0 2024-09-13T18:40:38.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.901+0000 7f3a32434640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c09a950 con 0x7f3a2c09a580 2024-09-13T18:40:38.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.901+0000 7f3a32434640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c06b330 con 0x7f3a2c0970b0 2024-09-13T18:40:38.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.901+0000 7f3a23fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 0x7f3a2c097480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.901+0000 7f3a2bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a2c09a580 0x7f3a2c096ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.901+0000 7f3a23fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 0x7f3a2c097480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51578/0 (socket says 172.21.15.97:51578) 2024-09-13T18:40:38.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.901+0000 7f3a309d1640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3a2c0979c0 0x7f3a2c12d150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58236/0 (socket says 172.21.15.97:58236) 2024-09-13T18:40:38.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.901+0000 7f3a2bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a2c09a580 0x7f3a2c096ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37314/0 (socket says 172.21.15.97:37314) 2024-09-13T18:40:38.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.901+0000 7f3a23fff640 1 -- 172.21.15.97:0/2203141807 learned_addr learned my addr 172.21.15.97:0/2203141807 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.902+0000 7f3a23fff640 1 -- 172.21.15.97:0/2203141807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a2c09a580 msgr2=0x7f3a2c096ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.902+0000 7f3a23fff640 1 --2- 172.21.15.97:0/2203141807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a2c09a580 0x7f3a2c096ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.902+0000 7f3a23fff640 1 -- 172.21.15.97:0/2203141807 >> v1:172.21.15.97:6789/0 conn(0x7f3a2c0979c0 legacy=0x7f3a2c12d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.902+0000 7f3a23fff640 1 -- 172.21.15.97:0/2203141807 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c06a6d0 con 0x7f3a2c0970b0 2024-09-13T18:40:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.902+0000 7f3a2b7fe640 1 -- 172.21.15.97:0/2203141807 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655150625 0 0) 0x7f3a2c06a4a0 con 0x7f3a2c0979c0 2024-09-13T18:40:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.902+0000 7f3a2bfff640 1 --2- 172.21.15.97:0/2203141807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a2c09a580 0x7f3a2c096ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.902+0000 7f3a23fff640 1 --2- 172.21.15.97:0/2203141807 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 0x7f3a2c097480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009940 tx=0x7f3a140091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eae4e42f0714644 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.903+0000 7f3a2b7fe640 1 -- 172.21.15.97:0/2203141807 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1402ad00 con 0x7f3a2c0970b0 2024-09-13T18:40:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.903+0000 7f3a2b7fe640 1 -- 172.21.15.97:0/2203141807 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1402ae60 con 0x7f3a2c0970b0 2024-09-13T18:40:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.903+0000 7f3a2b7fe640 1 -- 172.21.15.97:0/2203141807 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14032670 con 0x7f3a2c0970b0 2024-09-13T18:40:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.903+0000 7f3a32434640 1 -- 172.21.15.97:0/2203141807 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 msgr2=0x7f3a2c097480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.903+0000 7f3a32434640 1 --2- 172.21.15.97:0/2203141807 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 0x7f3a2c097480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009940 tx=0x7f3a140091d0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.903+0000 7f3a32434640 1 -- 172.21.15.97:0/2203141807 shutdown_connections 2024-09-13T18:40:38.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.903+0000 7f3a32434640 1 --2- 172.21.15.97:0/2203141807 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 0x7f3a2c097480 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.903+0000 7f3a32434640 1 --2- 172.21.15.97:0/2203141807 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a2c09a580 0x7f3a2c096ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.903+0000 7f3a32434640 1 -- 172.21.15.97:0/2203141807 >> 172.21.15.97:0/2203141807 conn(0x7f3a2c09b170 msgr2=0x7f3a2c09b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:38.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.903+0000 7f3a32434640 1 -- 172.21.15.97:0/2203141807 shutdown_connections 2024-09-13T18:40:38.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.903+0000 7f3a32434640 1 -- 172.21.15.97:0/2203141807 wait complete. 2024-09-13T18:40:38.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.904+0000 7f3a32434640 1 Processor -- start 2024-09-13T18:40:38.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.904+0000 7f3a32434640 1 -- start start 2024-09-13T18:40:38.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a32434640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 0x7f3a2c12d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a32434640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a2c0979c0 0x7f3a2c11c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a32434640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a2c09a580 0x7f3a2c11c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:38.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a32434640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c11e130 con 0x7f3a2c0979c0 2024-09-13T18:40:38.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a32434640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c11dd70 con 0x7f3a2c09a580 2024-09-13T18:40:38.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a32434640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c11eb00 con 0x7f3a2c0970b0 2024-09-13T18:40:38.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a2bfff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 0x7f3a2c12d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a23fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a2c0979c0 0x7f3a2c11c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a2bfff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 0x7f3a2c12d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51582/0 (socket says 172.21.15.97:51582) 2024-09-13T18:40:38.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a309d1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a2c09a580 0x7f3a2c11c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:38.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a2bfff640 1 -- 172.21.15.97:0/780673638 learned_addr learned my addr 172.21.15.97:0/780673638 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:38.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a2bfff640 1 -- 172.21.15.97:0/780673638 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a2c09a580 msgr2=0x7f3a2c11c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a2bfff640 1 --2- 172.21.15.97:0/780673638 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a2c09a580 0x7f3a2c11c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a2bfff640 1 -- 172.21.15.97:0/780673638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a2c0979c0 msgr2=0x7f3a2c11c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:38.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a2bfff640 1 --2- 172.21.15.97:0/780673638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a2c0979c0 0x7f3a2c11c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:38.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a2bfff640 1 -- 172.21.15.97:0/780673638 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c009390 con 0x7f3a2c0970b0 2024-09-13T18:40:38.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a309d1640 1 --2- 172.21.15.97:0/780673638 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a2c09a580 0x7f3a2c11c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:38.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a2bfff640 1 --2- 172.21.15.97:0/780673638 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 0x7f3a2c12d030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00ec80 tx=0x7f3a1c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:38.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a28ff9640 1 -- 172.21.15.97:0/780673638 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c00eec0 con 0x7f3a2c0970b0 2024-09-13T18:40:38.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a28ff9640 1 -- 172.21.15.97:0/780673638 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c00cbc0 con 0x7f3a2c0970b0 2024-09-13T18:40:38.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a32434640 1 -- 172.21.15.97:0/780673638 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a14009450 con 0x7f3a2c0970b0 2024-09-13T18:40:38.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a28ff9640 1 -- 172.21.15.97:0/780673638 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c013470 con 0x7f3a2c0970b0 2024-09-13T18:40:38.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.905+0000 7f3a32434640 1 -- 172.21.15.97:0/780673638 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c12d570 con 0x7f3a2c0970b0 2024-09-13T18:40:38.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.906+0000 7f3a28ff9640 1 -- 172.21.15.97:0/780673638 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f3a1c0137e0 con 0x7f3a2c0970b0 2024-09-13T18:40:38.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.906+0000 7f3a28ff9640 1 -- 172.21.15.97:0/780673638 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f3a1c042490 con 0x7f3a2c0970b0 2024-09-13T18:40:38.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.906+0000 7f3a32434640 1 -- 172.21.15.97:0/780673638 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c06ebc0 con 0x7f3a2c0970b0 2024-09-13T18:40:38.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:38.910+0000 7f3a28ff9640 1 -- 172.21.15.97:0/780673638 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f3a1c021080 con 0x7f3a2c0970b0 2024-09-13T18:40:39.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.061+0000 7f3a32434640 1 -- 172.21.15.97:0/780673638 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a2c11f930 con 0x7f3a2c0970b0 2024-09-13T18:40:39.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.061+0000 7f3a28ff9640 1 -- 172.21.15.97:0/780673638 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a1c023ad0 con 0x7f3a2c0970b0 2024-09-13T18:40:39.064 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2024-09-13T18:40:39.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.063+0000 7f3a32434640 1 -- 172.21.15.97:0/780673638 >> v1:172.21.15.97:6816/34603 conn(0x7f3a0c031160 legacy=0x7f3a0c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.063+0000 7f3a32434640 1 -- 172.21.15.97:0/780673638 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 msgr2=0x7f3a2c12d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.063+0000 7f3a32434640 1 --2- 172.21.15.97:0/780673638 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 0x7f3a2c12d030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00ec80 tx=0x7f3a1c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.063+0000 7f3a32434640 1 -- 172.21.15.97:0/780673638 shutdown_connections 2024-09-13T18:40:39.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.063+0000 7f3a32434640 1 --2- 172.21.15.97:0/780673638 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3a2c09a580 0x7f3a2c11c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.063+0000 7f3a32434640 1 --2- 172.21.15.97:0/780673638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3a2c0979c0 0x7f3a2c11c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.063+0000 7f3a32434640 1 --2- 172.21.15.97:0/780673638 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3a2c0970b0 0x7f3a2c12d030 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.063+0000 7f3a32434640 1 -- 172.21.15.97:0/780673638 >> 172.21.15.97:0/780673638 conn(0x7f3a2c09b170 msgr2=0x7f3a2c09d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:39.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.063+0000 7f3a32434640 1 -- 172.21.15.97:0/780673638 shutdown_connections 2024-09-13T18:40:39.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.063+0000 7f3a32434640 1 -- 172.21.15.97:0/780673638 wait complete. 2024-09-13T18:40:39.076 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:40:39.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.166+0000 7f4bb3ac0640 1 Processor -- start 2024-09-13T18:40:39.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.166+0000 7f4bb3ac0640 1 -- start start 2024-09-13T18:40:39.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.166+0000 7f4bb3ac0640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4bac09dfb0 0x7f4bac096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.166+0000 7f4bb3ac0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bac0969d0 0x7f4bac0974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.166+0000 7f4bb3ac0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac06a190 con 0x7f4bac12bf70 2024-09-13T18:40:39.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.166+0000 7f4bb3ac0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac09e380 con 0x7f4bac0969d0 2024-09-13T18:40:39.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.166+0000 7f4bb3ac0640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac098870 con 0x7f4bac09dfb0 2024-09-13T18:40:39.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.166+0000 7f4bb105b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bac0969d0 0x7f4bac0974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.166+0000 7f4bb185c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4bac09dfb0 0x7f4bac096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.166+0000 7f4bb205d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4bac12bf70 0x7f4bac12c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58246/0 (socket says 172.21.15.97:58246) 2024-09-13T18:40:39.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.166+0000 7f4bb205d640 1 -- 172.21.15.97:0/3101786391 learned_addr learned my addr 172.21.15.97:0/3101786391 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.167+0000 7f4bb185c640 1 -- 172.21.15.97:0/3101786391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bac0969d0 msgr2=0x7f4bac0974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.167+0000 7f4bb185c640 1 --2- 172.21.15.97:0/3101786391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bac0969d0 0x7f4bac0974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.167+0000 7f4bb085a640 1 -- 172.21.15.97:0/3101786391 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399131514 0 0) 0x7f4bac06a190 con 0x7f4bac12bf70 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.167+0000 7f4bb185c640 1 -- 172.21.15.97:0/3101786391 >> v1:172.21.15.97:6789/0 conn(0x7f4bac12bf70 legacy=0x7f4bac12c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.167+0000 7f4bb185c640 1 -- 172.21.15.97:0/3101786391 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac098e10 con 0x7f4bac09dfb0 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.167+0000 7f4bb105b640 1 --2- 172.21.15.97:0/3101786391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bac0969d0 0x7f4bac0974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.167+0000 7f4bb185c640 1 --2- 172.21.15.97:0/3101786391 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4bac09dfb0 0x7f4bac096f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40098b0 tx=0x7f4ba40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=688b41817ac7e76a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.167+0000 7f4bb085a640 1 -- 172.21.15.97:0/3101786391 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba402acc0 con 0x7f4bac09dfb0 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.167+0000 7f4bb085a640 1 -- 172.21.15.97:0/3101786391 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba402ae20 con 0x7f4bac09dfb0 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.167+0000 7f4bb085a640 1 -- 172.21.15.97:0/3101786391 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4032670 con 0x7f4bac09dfb0 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.168+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/3101786391 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4bac09dfb0 msgr2=0x7f4bac096f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.168+0000 7f4bb3ac0640 1 --2- 172.21.15.97:0/3101786391 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4bac09dfb0 0x7f4bac096f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40098b0 tx=0x7f4ba40090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.168+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/3101786391 shutdown_connections 2024-09-13T18:40:39.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.168+0000 7f4bb3ac0640 1 --2- 172.21.15.97:0/3101786391 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bac0969d0 0x7f4bac0974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.168+0000 7f4bb3ac0640 1 --2- 172.21.15.97:0/3101786391 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4bac09dfb0 0x7f4bac096f80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.168+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/3101786391 >> 172.21.15.97:0/3101786391 conn(0x7f4bac09b200 msgr2=0x7f4bac09b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:39.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.168+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/3101786391 shutdown_connections 2024-09-13T18:40:39.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.168+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/3101786391 wait complete. 2024-09-13T18:40:39.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.169+0000 7f4bb3ac0640 1 Processor -- start 2024-09-13T18:40:39.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.169+0000 7f4bb3ac0640 1 -- start start 2024-09-13T18:40:39.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.169+0000 7f4bb3ac0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bac0969d0 0x7f4bac119b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.169+0000 7f4bb3ac0640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bac09dfb0 0x7f4bac11a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.169+0000 7f4bb3ac0640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4bac12bf70 0x7f4bac13a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.169+0000 7f4bb3ac0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac099610 con 0x7f4bac0969d0 2024-09-13T18:40:39.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.169+0000 7f4bb3ac0640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac097e10 con 0x7f4bac09dfb0 2024-09-13T18:40:39.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.169+0000 7f4bb3ac0640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac119880 con 0x7f4bac12bf70 2024-09-13T18:40:39.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.169+0000 7f4bb185c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bac0969d0 0x7f4bac119b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.169+0000 7f4bb105b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bac09dfb0 0x7f4bac11a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.169+0000 7f4bb185c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bac0969d0 0x7f4bac119b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44094/0 (socket says 172.21.15.97:44094) 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.169+0000 7f4bb205d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4bac12bf70 0x7f4bac13a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.169+0000 7f4bb185c640 1 -- 172.21.15.97:0/659023507 learned_addr learned my addr 172.21.15.97:0/659023507 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.170+0000 7f4bb105b640 1 -- 172.21.15.97:0/659023507 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4bac12bf70 msgr2=0x7f4bac13a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.170+0000 7f4bb105b640 1 --2- 172.21.15.97:0/659023507 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4bac12bf70 0x7f4bac13a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.170+0000 7f4bb105b640 1 -- 172.21.15.97:0/659023507 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bac0969d0 msgr2=0x7f4bac119b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.170+0000 7f4bb105b640 1 --2- 172.21.15.97:0/659023507 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bac0969d0 0x7f4bac119b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.170+0000 7f4bb105b640 1 -- 172.21.15.97:0/659023507 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba0009390 con 0x7f4bac09dfb0 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.170+0000 7f4bb205d640 1 --2- 172.21.15.97:0/659023507 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4bac12bf70 0x7f4bac13a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.170+0000 7f4bb105b640 1 --2- 172.21.15.97:0/659023507 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bac09dfb0 0x7f4bac11a0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000ea20 tx=0x7f4ba00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.170+0000 7f4ba9ffb640 1 -- 172.21.15.97:0/659023507 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000ca10 con 0x7f4bac09dfb0 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.170+0000 7f4ba9ffb640 1 -- 172.21.15.97:0/659023507 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba000cb70 con 0x7f4bac09dfb0 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.170+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/659023507 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba4009390 con 0x7f4bac09dfb0 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.170+0000 7f4ba9ffb640 1 -- 172.21.15.97:0/659023507 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0013470 con 0x7f4bac09dfb0 2024-09-13T18:40:39.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.170+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/659023507 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac11d660 con 0x7f4bac09dfb0 2024-09-13T18:40:39.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.171+0000 7f4ba9ffb640 1 -- 172.21.15.97:0/659023507 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f4ba00137e0 con 0x7f4bac09dfb0 2024-09-13T18:40:39.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.171+0000 7f4ba9ffb640 1 -- 172.21.15.97:0/659023507 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f4ba00424e0 con 0x7f4bac09dfb0 2024-09-13T18:40:39.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.171+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/659023507 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac064000 con 0x7f4bac09dfb0 2024-09-13T18:40:39.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.176+0000 7f4ba9ffb640 1 -- 172.21.15.97:0/659023507 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f4ba0012730 con 0x7f4bac09dfb0 2024-09-13T18:40:39.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.359+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/659023507 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bac067670 con 0x7f4bac09dfb0 2024-09-13T18:40:39.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.359+0000 7f4ba9ffb640 1 -- 172.21.15.97:0/659023507 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2264 (secure 0 0 0) 0x7f4ba00232f0 con 0x7f4bac09dfb0 2024-09-13T18:40:39.362 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:40:39.362 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:13.885647+0000","modified":"2024-09-13T18:39:16.567097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6817/3890865357","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6817","nonce":3890865357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-09-13T18:40:39.362 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 5 2024-09-13T18:40:39.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.361+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/659023507 >> v1:172.21.15.97:6816/34603 conn(0x7f4b98031160 legacy=0x7f4b98033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.361+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/659023507 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bac09dfb0 msgr2=0x7f4bac11a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.361+0000 7f4bb3ac0640 1 --2- 172.21.15.97:0/659023507 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bac09dfb0 0x7f4bac11a0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000ea20 tx=0x7f4ba00090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.361+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/659023507 shutdown_connections 2024-09-13T18:40:39.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.361+0000 7f4bb3ac0640 1 --2- 172.21.15.97:0/659023507 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4bac12bf70 0x7f4bac13a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.361+0000 7f4bb3ac0640 1 --2- 172.21.15.97:0/659023507 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f4bac09dfb0 0x7f4bac11a0a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.361+0000 7f4bb3ac0640 1 --2- 172.21.15.97:0/659023507 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bac0969d0 0x7f4bac119b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.361+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/659023507 >> 172.21.15.97:0/659023507 conn(0x7f4bac09b200 msgr2=0x7f4bac09ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:39.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.361+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/659023507 shutdown_connections 2024-09-13T18:40:39.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.361+0000 7f4bb3ac0640 1 -- 172.21.15.97:0/659023507 wait complete. 2024-09-13T18:40:39.374 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:40:39.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.465+0000 7f7c08434640 1 Processor -- start 2024-09-13T18:40:39.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.465+0000 7f7c08434640 1 -- start start 2024-09-13T18:40:39.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c08434640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7c000a32b0 0x7f7c0012f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c08434640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 0x7f7c00137770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c08434640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c00096b70 con 0x7f7c0012fed0 2024-09-13T18:40:39.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c08434640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c001302f0 con 0x7f7c000a32b0 2024-09-13T18:40:39.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c08434640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000a3680 con 0x7f7c00069080 2024-09-13T18:40:39.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c061d0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7c000a32b0 0x7f7c0012f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c069d1640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 0x7f7c00137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c061d0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7c000a32b0 0x7f7c0012f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44100/0 (socket says 172.21.15.97:44100) 2024-09-13T18:40:39.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c069d1640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 0x7f7c00137770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51612/0 (socket says 172.21.15.97:51612) 2024-09-13T18:40:39.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c061d0640 1 -- 172.21.15.97:0/3065825409 learned_addr learned my addr 172.21.15.97:0/3065825409 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:39.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c059cf640 1 --1- 172.21.15.97:0/3065825409 >> v1:172.21.15.97:6789/0 conn(0x7f7c0012fed0 0x7f7c00068970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58248/0 (socket says 172.21.15.97:58248) 2024-09-13T18:40:39.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c069d1640 1 -- 172.21.15.97:0/3065825409 >> v2:172.21.15.97:3300/0 conn(0x7f7c000a32b0 msgr2=0x7f7c0012f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:39.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c069d1640 1 --2- 172.21.15.97:0/3065825409 >> v2:172.21.15.97:3300/0 conn(0x7f7c000a32b0 0x7f7c0012f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c069d1640 1 -- 172.21.15.97:0/3065825409 >> v1:172.21.15.97:6789/0 conn(0x7f7c0012fed0 legacy=0x7f7c00068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c069d1640 1 -- 172.21.15.97:0/3065825409 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c00097460 con 0x7f7c00069080 2024-09-13T18:40:39.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c051ce640 1 -- 172.21.15.97:0/3065825409 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619083418 0 0) 0x7f7c00096b70 con 0x7f7c0012fed0 2024-09-13T18:40:39.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.466+0000 7f7c061d0640 1 --2- 172.21.15.97:0/3065825409 >> v2:172.21.15.97:3300/0 conn(0x7f7c000a32b0 0x7f7c0012f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:39.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.467+0000 7f7c069d1640 1 --2- 172.21.15.97:0/3065825409 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 0x7f7c00137770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009e60 tx=0x7f7bf8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3146278b24ae536 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:39.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.467+0000 7f7c051ce640 1 -- 172.21.15.97:0/3065825409 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8007550 con 0x7f7c00069080 2024-09-13T18:40:39.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.467+0000 7f7c051ce640 1 -- 172.21.15.97:0/3065825409 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf802d050 con 0x7f7c00069080 2024-09-13T18:40:39.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.467+0000 7f7c051ce640 1 -- 172.21.15.97:0/3065825409 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf80078e0 con 0x7f7c00069080 2024-09-13T18:40:39.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.467+0000 7f7c08434640 1 -- 172.21.15.97:0/3065825409 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 msgr2=0x7f7c00137770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.468+0000 7f7c08434640 1 --2- 172.21.15.97:0/3065825409 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 0x7f7c00137770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009e60 tx=0x7f7bf8009780 comp rx=0 tx=0).stop 2024-09-13T18:40:39.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.468+0000 7f7c08434640 1 -- 172.21.15.97:0/3065825409 shutdown_connections 2024-09-13T18:40:39.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.468+0000 7f7c08434640 1 --2- 172.21.15.97:0/3065825409 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 0x7f7c00137770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.468+0000 7f7c08434640 1 --2- 172.21.15.97:0/3065825409 >> v2:172.21.15.97:3300/0 conn(0x7f7c000a32b0 0x7f7c0012f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.468+0000 7f7c08434640 1 -- 172.21.15.97:0/3065825409 >> 172.21.15.97:0/3065825409 conn(0x7f7c0006eef0 msgr2=0x7f7c000a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:39.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.468+0000 7f7c08434640 1 -- 172.21.15.97:0/3065825409 shutdown_connections 2024-09-13T18:40:39.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.468+0000 7f7c08434640 1 -- 172.21.15.97:0/3065825409 wait complete. 2024-09-13T18:40:39.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c08434640 1 Processor -- start 2024-09-13T18:40:39.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c08434640 1 -- start start 2024-09-13T18:40:39.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c08434640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 0x7f7c0013e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c08434640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c000a32b0 0x7f7c0013ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c08434640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c0012fed0 0x7f7c0013f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c08434640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0012dc10 con 0x7f7c0012fed0 2024-09-13T18:40:39.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c08434640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0009e710 con 0x7f7c000a32b0 2024-09-13T18:40:39.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c08434640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0011f090 con 0x7f7c00069080 2024-09-13T18:40:39.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c061d0640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 0x7f7c0013e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c069d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c0012fed0 0x7f7c0013f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c061d0640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 0x7f7c0013e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51618/0 (socket says 172.21.15.97:51618) 2024-09-13T18:40:39.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c061d0640 1 -- 172.21.15.97:0/4163419400 learned_addr learned my addr 172.21.15.97:0/4163419400 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:39.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c059cf640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c000a32b0 0x7f7c0013ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c061d0640 1 -- 172.21.15.97:0/4163419400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c000a32b0 msgr2=0x7f7c0013ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c061d0640 1 --2- 172.21.15.97:0/4163419400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c000a32b0 0x7f7c0013ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c061d0640 1 -- 172.21.15.97:0/4163419400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c0012fed0 msgr2=0x7f7c0013f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c061d0640 1 --2- 172.21.15.97:0/4163419400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c0012fed0 0x7f7c0013f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.469+0000 7f7c061d0640 1 -- 172.21.15.97:0/4163419400 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc009450 con 0x7f7c00069080 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.470+0000 7f7c061d0640 1 --2- 172.21.15.97:0/4163419400 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 0x7f7c0013e670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00ec80 tx=0x7f7bfc0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.470+0000 7f7bf67fc640 1 -- 172.21.15.97:0/4163419400 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00eec0 con 0x7f7c00069080 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.470+0000 7f7bf67fc640 1 -- 172.21.15.97:0/4163419400 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00cbc0 con 0x7f7c00069080 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.470+0000 7f7bf67fc640 1 -- 172.21.15.97:0/4163419400 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc013470 con 0x7f7c00069080 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.470+0000 7f7c08434640 1 -- 172.21.15.97:0/4163419400 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf8009a20 con 0x7f7c00069080 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.470+0000 7f7c08434640 1 -- 172.21.15.97:0/4163419400 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0011d1f0 con 0x7f7c00069080 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.470+0000 7f7bf67fc640 1 -- 172.21.15.97:0/4163419400 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f7bfc013820 con 0x7f7c00069080 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.471+0000 7f7bf67fc640 1 -- 172.21.15.97:0/4163419400 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f7bfc0425d0 con 0x7f7c00069080 2024-09-13T18:40:39.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.471+0000 7f7c08434640 1 -- 172.21.15.97:0/4163419400 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0011ea50 con 0x7f7c00069080 2024-09-13T18:40:39.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.475+0000 7f7bf67fc640 1 -- 172.21.15.97:0/4163419400 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f7bfc023ad0 con 0x7f7c00069080 2024-09-13T18:40:39.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.628+0000 7f7c08434640 1 -- 172.21.15.97:0/4163419400 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c00064000 con 0x7f7c00069080 2024-09-13T18:40:39.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.628+0000 7f7bf67fc640 1 -- 172.21.15.97:0/4163419400 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+11626 (secure 0 0 0) 0x7f7bfc0232f0 con 0x7f7c00069080 2024-09-13T18:40:39.631 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:40:39.631 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":23,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:54.652125+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.8","mappings":[{"from":1,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.630+0000 7f7c08434640 1 -- 172.21.15.97:0/4163419400 >> v1:172.21.15.97:6816/34603 conn(0x7f7be4031160 legacy=0x7f7be4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.630+0000 7f7c08434640 1 -- 172.21.15.97:0/4163419400 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 msgr2=0x7f7c0013e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.630+0000 7f7c08434640 1 --2- 172.21.15.97:0/4163419400 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 0x7f7c0013e670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00ec80 tx=0x7f7bfc0091d0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.630+0000 7f7c08434640 1 -- 172.21.15.97:0/4163419400 shutdown_connections 2024-09-13T18:40:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.630+0000 7f7c08434640 1 --2- 172.21.15.97:0/4163419400 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c0012fed0 0x7f7c0013f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.630+0000 7f7c08434640 1 --2- 172.21.15.97:0/4163419400 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c000a32b0 0x7f7c0013ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.630+0000 7f7c08434640 1 --2- 172.21.15.97:0/4163419400 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c00069080 0x7f7c0013e670 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.630+0000 7f7c08434640 1 -- 172.21.15.97:0/4163419400 >> 172.21.15.97:0/4163419400 conn(0x7f7c0006eef0 msgr2=0x7f7c000a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:39.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.630+0000 7f7c08434640 1 -- 172.21.15.97:0/4163419400 shutdown_connections 2024-09-13T18:40:39.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.630+0000 7f7c08434640 1 -- 172.21.15.97:0/4163419400 wait complete. 2024-09-13T18:40:39.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:39:01.375967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T18:39:05.732412+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:39:12.014248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:39:12.844264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:40:39.644 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:40:39.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.740+0000 7fec4a0af640 1 Processor -- start 2024-09-13T18:40:39.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.740+0000 7fec4a0af640 1 -- start start 2024-09-13T18:40:39.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.740+0000 7fec4a0af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4412f3f0 0x7fec441317d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.740+0000 7fec4a0af640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fec44131d10 0x7fec441340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.740+0000 7fec4a0af640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4406cce0 con 0x7fec4406e400 2024-09-13T18:40:39.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.740+0000 7fec4a0af640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4406e7d0 con 0x7fec44131d10 2024-09-13T18:40:39.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.740+0000 7fec4a0af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4406c610 con 0x7fec4412f3f0 2024-09-13T18:40:39.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.740+0000 7fec42ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4412f3f0 0x7fec441317d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.740+0000 7fec43fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fec44131d10 0x7fec441340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.740+0000 7fec43fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fec44131d10 0x7fec441340f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44112/0 (socket says 172.21.15.97:44112) 2024-09-13T18:40:39.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.740+0000 7fec43fff640 1 -- 172.21.15.97:0/678064198 learned_addr learned my addr 172.21.15.97:0/678064198 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:39.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.740+0000 7fec42ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4412f3f0 0x7fec441317d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37358/0 (socket says 172.21.15.97:37358) 2024-09-13T18:40:39.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.741+0000 7fec42ffd640 1 -- 172.21.15.97:0/678064198 >> v2:172.21.15.97:3300/0 conn(0x7fec44131d10 msgr2=0x7fec441340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:39.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.741+0000 7fec42ffd640 1 --2- 172.21.15.97:0/678064198 >> v2:172.21.15.97:3300/0 conn(0x7fec44131d10 0x7fec441340f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.741+0000 7fec42ffd640 1 -- 172.21.15.97:0/678064198 >> v1:172.21.15.97:6789/0 conn(0x7fec4406e400 legacy=0x7fec4406b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.741+0000 7fec42ffd640 1 -- 172.21.15.97:0/678064198 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4406eac0 con 0x7fec4412f3f0 2024-09-13T18:40:39.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.741+0000 7fec427fc640 1 -- 172.21.15.97:0/678064198 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156590640 0 0) 0x7fec4406cce0 con 0x7fec4406e400 2024-09-13T18:40:39.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.741+0000 7fec43fff640 1 --2- 172.21.15.97:0/678064198 >> v2:172.21.15.97:3300/0 conn(0x7fec44131d10 0x7fec441340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:39.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.741+0000 7fec42ffd640 1 --2- 172.21.15.97:0/678064198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4412f3f0 0x7fec441317d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec38009880 tx=0x7fec380090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c87b4f860d59ecde server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:39.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.742+0000 7fec427fc640 1 -- 172.21.15.97:0/678064198 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3802ace0 con 0x7fec4412f3f0 2024-09-13T18:40:39.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.742+0000 7fec427fc640 1 -- 172.21.15.97:0/678064198 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3802ae40 con 0x7fec4412f3f0 2024-09-13T18:40:39.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.742+0000 7fec427fc640 1 -- 172.21.15.97:0/678064198 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38032670 con 0x7fec4412f3f0 2024-09-13T18:40:39.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.742+0000 7fec4a0af640 1 -- 172.21.15.97:0/678064198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4412f3f0 msgr2=0x7fec441317d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.742+0000 7fec4a0af640 1 --2- 172.21.15.97:0/678064198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4412f3f0 0x7fec441317d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec38009880 tx=0x7fec380090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.742+0000 7fec4a0af640 1 -- 172.21.15.97:0/678064198 shutdown_connections 2024-09-13T18:40:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.742+0000 7fec4a0af640 1 --2- 172.21.15.97:0/678064198 >> v2:172.21.15.97:3300/0 conn(0x7fec44131d10 0x7fec441340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.742+0000 7fec4a0af640 1 --2- 172.21.15.97:0/678064198 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4412f3f0 0x7fec441317d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.742+0000 7fec4a0af640 1 -- 172.21.15.97:0/678064198 >> 172.21.15.97:0/678064198 conn(0x7fec4405e610 msgr2=0x7fec4409f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.742+0000 7fec4a0af640 1 -- 172.21.15.97:0/678064198 shutdown_connections 2024-09-13T18:40:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.742+0000 7fec4a0af640 1 -- 172.21.15.97:0/678064198 wait complete. 2024-09-13T18:40:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.743+0000 7fec4a0af640 1 Processor -- start 2024-09-13T18:40:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.743+0000 7fec4a0af640 1 -- start start 2024-09-13T18:40:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.743+0000 7fec4a0af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4406e400 0x7fec4412cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.743+0000 7fec4a0af640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fec4412f3f0 0x7fec44115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.743+0000 7fec4a0af640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec44131d10 0x7fec441161c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:39.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.743+0000 7fec4a0af640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec441180e0 con 0x7fec44131d10 2024-09-13T18:40:39.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.743+0000 7fec4a0af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec441317e0 con 0x7fec4406e400 2024-09-13T18:40:39.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.743+0000 7fec4a0af640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec4406d180 con 0x7fec4412f3f0 2024-09-13T18:40:39.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec437fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4406e400 0x7fec4412cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec43fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec44131d10 0x7fec441161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec42ffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fec4412f3f0 0x7fec44115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:39.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec437fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4406e400 0x7fec4412cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37370/0 (socket says 172.21.15.97:37370) 2024-09-13T18:40:39.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec43fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec44131d10 0x7fec441161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44128/0 (socket says 172.21.15.97:44128) 2024-09-13T18:40:39.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec437fe640 1 -- 172.21.15.97:0/2639012049 learned_addr learned my addr 172.21.15.97:0/2639012049 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec42ffd640 1 -- 172.21.15.97:0/2639012049 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4406e400 msgr2=0x7fec4412cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec42ffd640 1 --2- 172.21.15.97:0/2639012049 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4406e400 0x7fec4412cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec42ffd640 1 -- 172.21.15.97:0/2639012049 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec44131d10 msgr2=0x7fec441161c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec42ffd640 1 --2- 172.21.15.97:0/2639012049 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec44131d10 0x7fec441161c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec42ffd640 1 -- 172.21.15.97:0/2639012049 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c00bcf0 con 0x7fec4412f3f0 2024-09-13T18:40:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec43fff640 1 --2- 172.21.15.97:0/2639012049 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec44131d10 0x7fec441161c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec437fe640 1 --2- 172.21.15.97:0/2639012049 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4406e400 0x7fec4412cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec42ffd640 1 --2- 172.21.15.97:0/2639012049 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fec4412f3f0 0x7fec44115c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec4406c750 tx=0x7fec38032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec2b7fe640 1 -- 172.21.15.97:0/2639012049 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38031700 con 0x7fec4412f3f0 2024-09-13T18:40:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec2b7fe640 1 -- 172.21.15.97:0/2639012049 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec380318a0 con 0x7fec4412f3f0 2024-09-13T18:40:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec4a0af640 1 -- 172.21.15.97:0/2639012049 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec38009390 con 0x7fec4412f3f0 2024-09-13T18:40:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec2b7fe640 1 -- 172.21.15.97:0/2639012049 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38031c60 con 0x7fec4412f3f0 2024-09-13T18:40:39.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.744+0000 7fec4a0af640 1 -- 172.21.15.97:0/2639012049 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec44117690 con 0x7fec4412f3f0 2024-09-13T18:40:39.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.745+0000 7fec2b7fe640 1 -- 172.21.15.97:0/2639012049 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fec38039040 con 0x7fec4412f3f0 2024-09-13T18:40:39.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.745+0000 7fec2b7fe640 1 -- 172.21.15.97:0/2639012049 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fec38041030 con 0x7fec4412f3f0 2024-09-13T18:40:39.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.745+0000 7fec4a0af640 1 -- 172.21.15.97:0/2639012049 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4406db60 con 0x7fec4412f3f0 2024-09-13T18:40:39.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.749+0000 7fec2b7fe640 1 -- 172.21.15.97:0/2639012049 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fec3804b080 con 0x7fec4412f3f0 2024-09-13T18:40:39.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.899+0000 7fec4a0af640 1 -- 172.21.15.97:0/2639012049 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec44119240 con 0x7fec4412f3f0 2024-09-13T18:40:39.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.899+0000 7fec2b7fe640 1 -- 172.21.15.97:0/2639012049 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec38037020 con 0x7fec4412f3f0 2024-09-13T18:40:39.902 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2024-09-13T18:40:39.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.901+0000 7fec4a0af640 1 -- 172.21.15.97:0/2639012049 >> v1:172.21.15.97:6816/34603 conn(0x7fec30031160 legacy=0x7fec30033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.901+0000 7fec4a0af640 1 -- 172.21.15.97:0/2639012049 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fec4412f3f0 msgr2=0x7fec44115c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:39.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.901+0000 7fec4a0af640 1 --2- 172.21.15.97:0/2639012049 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fec4412f3f0 0x7fec44115c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec4406c750 tx=0x7fec38032000 comp rx=0 tx=0).stop 2024-09-13T18:40:39.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.901+0000 7fec4a0af640 1 -- 172.21.15.97:0/2639012049 shutdown_connections 2024-09-13T18:40:39.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.901+0000 7fec4a0af640 1 --2- 172.21.15.97:0/2639012049 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec44131d10 0x7fec441161c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.901+0000 7fec4a0af640 1 --2- 172.21.15.97:0/2639012049 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fec4412f3f0 0x7fec44115c80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.901+0000 7fec4a0af640 1 --2- 172.21.15.97:0/2639012049 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fec4406e400 0x7fec4412cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:39.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.901+0000 7fec4a0af640 1 -- 172.21.15.97:0/2639012049 >> 172.21.15.97:0/2639012049 conn(0x7fec4405e610 msgr2=0x7fec4412e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:39.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.901+0000 7fec4a0af640 1 -- 172.21.15.97:0/2639012049 shutdown_connections 2024-09-13T18:40:39.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:39.901+0000 7fec4a0af640 1 -- 172.21.15.97:0/2639012049 wait complete. 2024-09-13T18:40:39.915 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-13T18:40:40.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.009+0000 7fdc49b9d640 1 Processor -- start 2024-09-13T18:40:40.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.009+0000 7fdc49b9d640 1 -- start start 2024-09-13T18:40:40.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc49b9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc44097d40 0x7fdc44098140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc49b9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdc44130e80 0x7fdc44133260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc49b9d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4406ead0 con 0x7fdc44097260 2024-09-13T18:40:40.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc49b9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc44099900 con 0x7fdc44097d40 2024-09-13T18:40:40.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc49b9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4409a820 con 0x7fdc44130e80 2024-09-13T18:40:40.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc42ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc44097d40 0x7fdc44098140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc437fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdc44097260 0x7fdc44097630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58254/0 (socket says 172.21.15.97:58254) 2024-09-13T18:40:40.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc437fe640 1 -- 172.21.15.97:0/2676948986 learned_addr learned my addr 172.21.15.97:0/2676948986 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:40:40.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc43fff640 1 --2- 172.21.15.97:0/2676948986 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdc44130e80 0x7fdc44133260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc43fff640 1 -- 172.21.15.97:0/2676948986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc44097d40 msgr2=0x7fdc44098140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:40.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc43fff640 1 --2- 172.21.15.97:0/2676948986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc44097d40 0x7fdc44098140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc427fc640 1 -- 172.21.15.97:0/2676948986 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457832227 0 0) 0x7fdc4406ead0 con 0x7fdc44097260 2024-09-13T18:40:40.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc43fff640 1 -- 172.21.15.97:0/2676948986 >> v1:172.21.15.97:6789/0 conn(0x7fdc44097260 legacy=0x7fdc44097630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc43fff640 1 -- 172.21.15.97:0/2676948986 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc44098dd0 con 0x7fdc44130e80 2024-09-13T18:40:40.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.010+0000 7fdc42ffd640 1 --2- 172.21.15.97:0/2676948986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc44097d40 0x7fdc44098140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:40.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.011+0000 7fdc43fff640 1 --2- 172.21.15.97:0/2676948986 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdc44130e80 0x7fdc44133260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009e90 tx=0x7fdc3c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=365504a4b5f481ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.011+0000 7fdc427fc640 1 -- 172.21.15.97:0/2676948986 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c031400 con 0x7fdc44130e80 2024-09-13T18:40:40.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.011+0000 7fdc427fc640 1 -- 172.21.15.97:0/2676948986 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c02d050 con 0x7fdc44130e80 2024-09-13T18:40:40.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.011+0000 7fdc427fc640 1 -- 172.21.15.97:0/2676948986 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c031790 con 0x7fdc44130e80 2024-09-13T18:40:40.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.011+0000 7fdc49b9d640 1 -- 172.21.15.97:0/2676948986 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdc44130e80 msgr2=0x7fdc44133260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.011+0000 7fdc49b9d640 1 --2- 172.21.15.97:0/2676948986 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdc44130e80 0x7fdc44133260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009e90 tx=0x7fdc3c009780 comp rx=0 tx=0).stop 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.011+0000 7fdc49b9d640 1 -- 172.21.15.97:0/2676948986 shutdown_connections 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.011+0000 7fdc49b9d640 1 --2- 172.21.15.97:0/2676948986 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc44097d40 0x7fdc44098140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.011+0000 7fdc49b9d640 1 --2- 172.21.15.97:0/2676948986 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdc44130e80 0x7fdc44133260 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.011+0000 7fdc49b9d640 1 -- 172.21.15.97:0/2676948986 >> 172.21.15.97:0/2676948986 conn(0x7fdc4409b170 msgr2=0x7fdc4409b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.011+0000 7fdc49b9d640 1 -- 172.21.15.97:0/2676948986 shutdown_connections 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.011+0000 7fdc49b9d640 1 -- 172.21.15.97:0/2676948986 wait complete. 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.012+0000 7fdc49b9d640 1 Processor -- start 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.012+0000 7fdc49b9d640 1 -- start start 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc49b9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdc44097260 0x7fdc44115e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc49b9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc44097d40 0x7fdc44116370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc49b9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc44130e80 0x7fdc441168b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc49b9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc44118820 con 0x7fdc44097d40 2024-09-13T18:40:40.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc49b9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc44117e50 con 0x7fdc44130e80 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc49b9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc44118090 con 0x7fdc44097260 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc437fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdc44097260 0x7fdc44115e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc42ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc44097d40 0x7fdc44116370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc437fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdc44097260 0x7fdc44115e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51656/0 (socket says 172.21.15.97:51656) 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc437fe640 1 -- 172.21.15.97:0/1668509416 learned_addr learned my addr 172.21.15.97:0/1668509416 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc43fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc44130e80 0x7fdc441168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc437fe640 1 -- 172.21.15.97:0/1668509416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc44130e80 msgr2=0x7fdc441168b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc437fe640 1 --2- 172.21.15.97:0/1668509416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc44130e80 0x7fdc441168b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc437fe640 1 -- 172.21.15.97:0/1668509416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc44097d40 msgr2=0x7fdc44116370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc437fe640 1 --2- 172.21.15.97:0/1668509416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc44097d40 0x7fdc44116370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc437fe640 1 -- 172.21.15.97:0/1668509416 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc38009390 con 0x7fdc44097260 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc42ffd640 1 --2- 172.21.15.97:0/1668509416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc44097d40 0x7fdc44116370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc43fff640 1 --2- 172.21.15.97:0/1668509416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc44130e80 0x7fdc441168b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc437fe640 1 --2- 172.21.15.97:0/1668509416 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdc44097260 0x7fdc44115e30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400c540 tx=0x7fdc34007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.013+0000 7fdc2b7fe640 1 -- 172.21.15.97:0/1668509416 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc34005aa0 con 0x7fdc44097260 2024-09-13T18:40:40.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.014+0000 7fdc2b7fe640 1 -- 172.21.15.97:0/1668509416 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc34005c20 con 0x7fdc44097260 2024-09-13T18:40:40.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.014+0000 7fdc2b7fe640 1 -- 172.21.15.97:0/1668509416 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc340070d0 con 0x7fdc44097260 2024-09-13T18:40:40.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.014+0000 7fdc49b9d640 1 -- 172.21.15.97:0/1668509416 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3c009a20 con 0x7fdc44097260 2024-09-13T18:40:40.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.014+0000 7fdc49b9d640 1 -- 172.21.15.97:0/1668509416 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc44119540 con 0x7fdc44097260 2024-09-13T18:40:40.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.014+0000 7fdc2b7fe640 1 -- 172.21.15.97:0/1668509416 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fdc340074c0 con 0x7fdc44097260 2024-09-13T18:40:40.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.015+0000 7fdc2b7fe640 1 -- 172.21.15.97:0/1668509416 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fdc34041540 con 0x7fdc44097260 2024-09-13T18:40:40.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.015+0000 7fdc49b9d640 1 -- 172.21.15.97:0/1668509416 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc440714b0 con 0x7fdc44097260 2024-09-13T18:40:40.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.019+0000 7fdc2b7fe640 1 -- 172.21.15.97:0/1668509416 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fdc34017070 con 0x7fdc44097260 2024-09-13T18:40:40.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.170+0000 7fdc49b9d640 1 -- 172.21.15.97:0/1668509416 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdc4409f4e0 con 0x7fdc44097260 2024-09-13T18:40:40.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.171+0000 7fdc2b7fe640 1 -- 172.21.15.97:0/1668509416 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdc3401a360 con 0x7fdc44097260 2024-09-13T18:40:40.174 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 8 2024-09-13T18:40:40.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.173+0000 7fdc49b9d640 1 -- 172.21.15.97:0/1668509416 >> v1:172.21.15.97:6816/34603 conn(0x7fdc30031160 legacy=0x7fdc30033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.173+0000 7fdc49b9d640 1 -- 172.21.15.97:0/1668509416 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdc44097260 msgr2=0x7fdc44115e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.173+0000 7fdc49b9d640 1 --2- 172.21.15.97:0/1668509416 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdc44097260 0x7fdc44115e30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400c540 tx=0x7fdc34007f30 comp rx=0 tx=0).stop 2024-09-13T18:40:40.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.173+0000 7fdc49b9d640 1 -- 172.21.15.97:0/1668509416 shutdown_connections 2024-09-13T18:40:40.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.173+0000 7fdc49b9d640 1 --2- 172.21.15.97:0/1668509416 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdc44130e80 0x7fdc441168b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.173+0000 7fdc49b9d640 1 --2- 172.21.15.97:0/1668509416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc44097d40 0x7fdc44116370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.173+0000 7fdc49b9d640 1 --2- 172.21.15.97:0/1668509416 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdc44097260 0x7fdc44115e30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.173+0000 7fdc49b9d640 1 -- 172.21.15.97:0/1668509416 >> 172.21.15.97:0/1668509416 conn(0x7fdc4409b170 msgr2=0x7fdc4409c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:40.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.173+0000 7fdc49b9d640 1 -- 172.21.15.97:0/1668509416 shutdown_connections 2024-09-13T18:40:40.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.173+0000 7fdc49b9d640 1 -- 172.21.15.97:0/1668509416 wait complete. 2024-09-13T18:40:40.186 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:40:40.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.280+0000 7fd705f5d640 1 Processor -- start 2024-09-13T18:40:40.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.280+0000 7fd705f5d640 1 -- start start 2024-09-13T18:40:40.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd705f5d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd700130020 0x7fd700132400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd705f5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd700132940 0x7fd700134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd705f5d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70006bd30 con 0x7fd70006d700 2024-09-13T18:40:40.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd705f5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70006d1e0 con 0x7fd700132940 2024-09-13T18:40:40.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd705f5d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd70006dad0 con 0x7fd700130020 2024-09-13T18:40:40.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd6fffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd700132940 0x7fd700134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd6feffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd700130020 0x7fd700132400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd6ff7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd70006d700 0x7fd70006e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58256/0 (socket says 172.21.15.97:58256) 2024-09-13T18:40:40.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd6ff7fe640 1 -- 172.21.15.97:0/2828236961 learned_addr learned my addr 172.21.15.97:0/2828236961 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:40:40.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd6fffff640 1 -- 172.21.15.97:0/2828236961 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd700130020 msgr2=0x7fd700132400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:40.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd6fffff640 1 --2- 172.21.15.97:0/2828236961 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd700130020 0x7fd700132400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd6fffff640 1 -- 172.21.15.97:0/2828236961 >> v1:172.21.15.97:6789/0 conn(0x7fd70006d700 legacy=0x7fd70006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd6fffff640 1 -- 172.21.15.97:0/2828236961 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70009ae50 con 0x7fd700132940 2024-09-13T18:40:40.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd6fe7fc640 1 -- 172.21.15.97:0/2828236961 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277496917 0 0) 0x7fd70006bd30 con 0x7fd70006d700 2024-09-13T18:40:40.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.281+0000 7fd6feffd640 1 --2- 172.21.15.97:0/2828236961 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd700130020 0x7fd700132400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:40.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.282+0000 7fd6fffff640 1 --2- 172.21.15.97:0/2828236961 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd700132940 0x7fd700134d20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009880 tx=0x7fd6f80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ac709fd77a7f5ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.282+0000 7fd6fe7fc640 1 -- 172.21.15.97:0/2828236961 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f802acd0 con 0x7fd700132940 2024-09-13T18:40:40.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.282+0000 7fd6fe7fc640 1 -- 172.21.15.97:0/2828236961 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f802ae30 con 0x7fd700132940 2024-09-13T18:40:40.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.282+0000 7fd6fe7fc640 1 -- 172.21.15.97:0/2828236961 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8032670 con 0x7fd700132940 2024-09-13T18:40:40.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.282+0000 7fd705f5d640 1 -- 172.21.15.97:0/2828236961 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd700132940 msgr2=0x7fd700134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.282+0000 7fd705f5d640 1 --2- 172.21.15.97:0/2828236961 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd700132940 0x7fd700134d20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009880 tx=0x7fd6f80090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.283+0000 7fd705f5d640 1 -- 172.21.15.97:0/2828236961 shutdown_connections 2024-09-13T18:40:40.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.283+0000 7fd705f5d640 1 --2- 172.21.15.97:0/2828236961 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd700132940 0x7fd700134d20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.283+0000 7fd705f5d640 1 --2- 172.21.15.97:0/2828236961 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd700130020 0x7fd700132400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.283+0000 7fd705f5d640 1 -- 172.21.15.97:0/2828236961 >> 172.21.15.97:0/2828236961 conn(0x7fd700067b90 msgr2=0x7fd7000a0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:40.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.283+0000 7fd705f5d640 1 -- 172.21.15.97:0/2828236961 shutdown_connections 2024-09-13T18:40:40.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.283+0000 7fd705f5d640 1 -- 172.21.15.97:0/2828236961 wait complete. 2024-09-13T18:40:40.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.283+0000 7fd705f5d640 1 Processor -- start 2024-09-13T18:40:40.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd705f5d640 1 -- start start 2024-09-13T18:40:40.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd705f5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd70006d700 0x7fd700098e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd705f5d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd700130020 0x7fd700099500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd705f5d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd700132940 0x7fd700099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd705f5d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd700069ca0 con 0x7fd700130020 2024-09-13T18:40:40.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd705f5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70006c350 con 0x7fd70006d700 2024-09-13T18:40:40.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd705f5d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd700098130 con 0x7fd700132940 2024-09-13T18:40:40.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd6ff7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd70006d700 0x7fd700098e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd6feffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd700130020 0x7fd700099500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd6fffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd700132940 0x7fd700099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd6ff7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd70006d700 0x7fd700098e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37412/0 (socket says 172.21.15.97:37412) 2024-09-13T18:40:40.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd6ff7fe640 1 -- 172.21.15.97:0/2791257012 learned_addr learned my addr 172.21.15.97:0/2791257012 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:40.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd6ff7fe640 1 -- 172.21.15.97:0/2791257012 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd700132940 msgr2=0x7fd700099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd6ff7fe640 1 --2- 172.21.15.97:0/2791257012 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd700132940 0x7fd700099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd6ff7fe640 1 -- 172.21.15.97:0/2791257012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd700130020 msgr2=0x7fd700099500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd6ff7fe640 1 --2- 172.21.15.97:0/2791257012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd700130020 0x7fd700099500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd6ff7fe640 1 -- 172.21.15.97:0/2791257012 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f4009390 con 0x7fd70006d700 2024-09-13T18:40:40.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd6feffd640 1 --2- 172.21.15.97:0/2791257012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd700130020 0x7fd700099500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:40.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.284+0000 7fd6ff7fe640 1 --2- 172.21.15.97:0/2791257012 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd70006d700 0x7fd700098e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000ccc0 tx=0x7fd6f00019e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.285+0000 7fd6e77fe640 1 -- 172.21.15.97:0/2791257012 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000ce80 con 0x7fd70006d700 2024-09-13T18:40:40.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.285+0000 7fd6e77fe640 1 -- 172.21.15.97:0/2791257012 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f000a850 con 0x7fd70006d700 2024-09-13T18:40:40.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.285+0000 7fd705f5d640 1 -- 172.21.15.97:0/2791257012 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f8009390 con 0x7fd70006d700 2024-09-13T18:40:40.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.285+0000 7fd6e77fe640 1 -- 172.21.15.97:0/2791257012 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000ac70 con 0x7fd70006d700 2024-09-13T18:40:40.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.285+0000 7fd705f5d640 1 -- 172.21.15.97:0/2791257012 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7000986a0 con 0x7fd70006d700 2024-09-13T18:40:40.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.285+0000 7fd6e77fe640 1 -- 172.21.15.97:0/2791257012 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fd6f0007300 con 0x7fd70006d700 2024-09-13T18:40:40.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.286+0000 7fd6e77fe640 1 -- 172.21.15.97:0/2791257012 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fd6f0042180 con 0x7fd70006d700 2024-09-13T18:40:40.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.286+0000 7fd705f5d640 1 -- 172.21.15.97:0/2791257012 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd700098270 con 0x7fd70006d700 2024-09-13T18:40:40.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.290+0000 7fd6e77fe640 1 -- 172.21.15.97:0/2791257012 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fd6f00075b0 con 0x7fd70006d700 2024-09-13T18:40:40.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.441+0000 7fd705f5d640 1 -- 172.21.15.97:0/2791257012 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd700064600 con 0x7fd70006d700 2024-09-13T18:40:40.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.442+0000 7fd6e77fe640 1 -- 172.21.15.97:0/2791257012 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6f00290a0 con 0x7fd70006d700 2024-09-13T18:40:40.444 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2024-09-13T18:40:40.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.444+0000 7fd705f5d640 1 -- 172.21.15.97:0/2791257012 >> v1:172.21.15.97:6816/34603 conn(0x7fd6ec031160 legacy=0x7fd6ec033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.444+0000 7fd705f5d640 1 -- 172.21.15.97:0/2791257012 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd70006d700 msgr2=0x7fd700098e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.444+0000 7fd705f5d640 1 --2- 172.21.15.97:0/2791257012 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd70006d700 0x7fd700098e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000ccc0 tx=0x7fd6f00019e0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.444+0000 7fd705f5d640 1 -- 172.21.15.97:0/2791257012 shutdown_connections 2024-09-13T18:40:40.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.444+0000 7fd705f5d640 1 --2- 172.21.15.97:0/2791257012 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd700132940 0x7fd700099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.444+0000 7fd705f5d640 1 --2- 172.21.15.97:0/2791257012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd700130020 0x7fd700099500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.444+0000 7fd705f5d640 1 --2- 172.21.15.97:0/2791257012 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd70006d700 0x7fd700098e20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.444+0000 7fd705f5d640 1 -- 172.21.15.97:0/2791257012 >> 172.21.15.97:0/2791257012 conn(0x7fd700067b90 msgr2=0x7fd700131280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:40.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.444+0000 7fd705f5d640 1 -- 172.21.15.97:0/2791257012 shutdown_connections 2024-09-13T18:40:40.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.444+0000 7fd705f5d640 1 -- 172.21.15.97:0/2791257012 wait complete. 2024-09-13T18:40:40.457 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:40:40.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.550+0000 7f83ea99d640 1 Processor -- start 2024-09-13T18:40:40.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83ea99d640 1 -- start start 2024-09-13T18:40:40.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83ea99d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f83e409a700 0x7f83e4096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83ea99d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83e4096b60 0x7f83e41375e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83ea99d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e409c700 con 0x7f83e4096790 2024-09-13T18:40:40.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83ea99d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e409aad0 con 0x7f83e4096b60 2024-09-13T18:40:40.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83ea99d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83e409fbd0 con 0x7f83e409a700 2024-09-13T18:40:40.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83e8f3a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83e4096b60 0x7f83e41375e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83e37fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f83e4096790 0x7f83e4133eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58264/0 (socket says 172.21.15.97:58264) 2024-09-13T18:40:40.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83e37fe640 1 -- 172.21.15.97:0/2404926987 learned_addr learned my addr 172.21.15.97:0/2404926987 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:40:40.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83e3fff640 1 --2- 172.21.15.97:0/2404926987 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f83e409a700 0x7f83e4096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83e3fff640 1 -- 172.21.15.97:0/2404926987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83e4096b60 msgr2=0x7f83e41375e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:40.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83e3fff640 1 --2- 172.21.15.97:0/2404926987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83e4096b60 0x7f83e41375e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83e3fff640 1 -- 172.21.15.97:0/2404926987 >> v1:172.21.15.97:6789/0 conn(0x7f83e4096790 legacy=0x7f83e4133eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83e2ffd640 1 -- 172.21.15.97:0/2404926987 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828415030 0 0) 0x7f83e409c700 con 0x7f83e4096790 2024-09-13T18:40:40.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83e3fff640 1 -- 172.21.15.97:0/2404926987 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e4097370 con 0x7f83e409a700 2024-09-13T18:40:40.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.551+0000 7f83e8f3a640 1 --2- 172.21.15.97:0/2404926987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83e4096b60 0x7f83e41375e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:40.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.552+0000 7f83e3fff640 1 --2- 172.21.15.97:0/2404926987 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f83e409a700 0x7f83e4096250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009880 tx=0x7f83d40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab92b8c5acfc8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.552+0000 7f83e2ffd640 1 -- 172.21.15.97:0/2404926987 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d402acc0 con 0x7f83e409a700 2024-09-13T18:40:40.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.552+0000 7f83e2ffd640 1 -- 172.21.15.97:0/2404926987 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d402ae20 con 0x7f83e409a700 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.552+0000 7f83e2ffd640 1 -- 172.21.15.97:0/2404926987 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4032670 con 0x7f83e409a700 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.553+0000 7f83ea99d640 1 -- 172.21.15.97:0/2404926987 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f83e409a700 msgr2=0x7f83e4096250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.553+0000 7f83ea99d640 1 --2- 172.21.15.97:0/2404926987 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f83e409a700 0x7f83e4096250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009880 tx=0x7f83d40090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.553+0000 7f83ea99d640 1 -- 172.21.15.97:0/2404926987 shutdown_connections 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.553+0000 7f83ea99d640 1 --2- 172.21.15.97:0/2404926987 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83e4096b60 0x7f83e41375e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.553+0000 7f83ea99d640 1 --2- 172.21.15.97:0/2404926987 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f83e409a700 0x7f83e4096250 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.553+0000 7f83ea99d640 1 -- 172.21.15.97:0/2404926987 >> 172.21.15.97:0/2404926987 conn(0x7f83e409f7d0 msgr2=0x7f83e409b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.553+0000 7f83ea99d640 1 -- 172.21.15.97:0/2404926987 shutdown_connections 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.553+0000 7f83ea99d640 1 -- 172.21.15.97:0/2404926987 wait complete. 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.554+0000 7f83ea99d640 1 Processor -- start 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.554+0000 7f83ea99d640 1 -- start start 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.554+0000 7f83ea99d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f83e4096790 0x7f83e4094720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.554+0000 7f83ea99d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83e4096b60 0x7f83e40907e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.554+0000 7f83ea99d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83e409a700 0x7f83e4090d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.554+0000 7f83ea99d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e4094ea0 con 0x7f83e4096b60 2024-09-13T18:40:40.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.554+0000 7f83ea99d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e406f070 con 0x7f83e409a700 2024-09-13T18:40:40.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.554+0000 7f83ea99d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83e4092a90 con 0x7f83e4096790 2024-09-13T18:40:40.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.554+0000 7f83e3fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f83e4096790 0x7f83e4094720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.554+0000 7f83e37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83e4096b60 0x7f83e40907e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.554+0000 7f83e3fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f83e4096790 0x7f83e4094720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51688/0 (socket says 172.21.15.97:51688) 2024-09-13T18:40:40.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.554+0000 7f83e3fff640 1 -- 172.21.15.97:0/2864815249 learned_addr learned my addr 172.21.15.97:0/2864815249 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:40.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.554+0000 7f83e8f3a640 1 --2- 172.21.15.97:0/2864815249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83e409a700 0x7f83e4090d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.555+0000 7f83e3fff640 1 -- 172.21.15.97:0/2864815249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83e409a700 msgr2=0x7f83e4090d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.555+0000 7f83e3fff640 1 --2- 172.21.15.97:0/2864815249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83e409a700 0x7f83e4090d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.555+0000 7f83e3fff640 1 -- 172.21.15.97:0/2864815249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83e4096b60 msgr2=0x7f83e40907e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.555+0000 7f83e3fff640 1 --2- 172.21.15.97:0/2864815249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83e4096b60 0x7f83e40907e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.555+0000 7f83e3fff640 1 -- 172.21.15.97:0/2864815249 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc009a20 con 0x7f83e4096790 2024-09-13T18:40:40.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.555+0000 7f83e3fff640 1 --2- 172.21.15.97:0/2864815249 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f83e4096790 0x7f83e4094720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009850 tx=0x7f83d4032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.555+0000 7f83dbfff640 1 -- 172.21.15.97:0/2864815249 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4031700 con 0x7f83e4096790 2024-09-13T18:40:40.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.555+0000 7f83dbfff640 1 -- 172.21.15.97:0/2864815249 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d4031860 con 0x7f83e4096790 2024-09-13T18:40:40.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.555+0000 7f83dbfff640 1 -- 172.21.15.97:0/2864815249 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4031c20 con 0x7f83e4096790 2024-09-13T18:40:40.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.555+0000 7f83ea99d640 1 -- 172.21.15.97:0/2864815249 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d4009390 con 0x7f83e4096790 2024-09-13T18:40:40.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.555+0000 7f83ea99d640 1 -- 172.21.15.97:0/2864815249 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e4091260 con 0x7f83e4096790 2024-09-13T18:40:40.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.556+0000 7f83dbfff640 1 -- 172.21.15.97:0/2864815249 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f83d403c610 con 0x7f83e4096790 2024-09-13T18:40:40.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.556+0000 7f83dbfff640 1 -- 172.21.15.97:0/2864815249 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f83d40629e0 con 0x7f83e4096790 2024-09-13T18:40:40.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.556+0000 7f83ea99d640 1 -- 172.21.15.97:0/2864815249 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e40714b0 con 0x7f83e4096790 2024-09-13T18:40:40.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.560+0000 7f83dbfff640 1 -- 172.21.15.97:0/2864815249 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f83d4037020 con 0x7f83e4096790 2024-09-13T18:40:40.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.712+0000 7f83ea99d640 1 -- 172.21.15.97:0/2864815249 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83e4064a00 con 0x7f83e4096790 2024-09-13T18:40:40.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.713+0000 7f83dbfff640 1 -- 172.21.15.97:0/2864815249 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f83d4049070 con 0x7f83e4096790 2024-09-13T18:40:40.715 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2024-09-13T18:40:40.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.715+0000 7f83ea99d640 1 -- 172.21.15.97:0/2864815249 >> v1:172.21.15.97:6816/34603 conn(0x7f83c4031160 legacy=0x7f83c4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.715+0000 7f83ea99d640 1 -- 172.21.15.97:0/2864815249 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f83e4096790 msgr2=0x7f83e4094720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.715+0000 7f83ea99d640 1 --2- 172.21.15.97:0/2864815249 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f83e4096790 0x7f83e4094720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009850 tx=0x7f83d4032000 comp rx=0 tx=0).stop 2024-09-13T18:40:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.715+0000 7f83ea99d640 1 -- 172.21.15.97:0/2864815249 shutdown_connections 2024-09-13T18:40:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.715+0000 7f83ea99d640 1 --2- 172.21.15.97:0/2864815249 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f83e409a700 0x7f83e4090d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.715+0000 7f83ea99d640 1 --2- 172.21.15.97:0/2864815249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83e4096b60 0x7f83e40907e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.715+0000 7f83ea99d640 1 --2- 172.21.15.97:0/2864815249 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f83e4096790 0x7f83e4094720 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.715+0000 7f83ea99d640 1 -- 172.21.15.97:0/2864815249 >> 172.21.15.97:0/2864815249 conn(0x7f83e409f7d0 msgr2=0x7f83e4097fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.715+0000 7f83ea99d640 1 -- 172.21.15.97:0/2864815249 shutdown_connections 2024-09-13T18:40:40.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.715+0000 7f83ea99d640 1 -- 172.21.15.97:0/2864815249 wait complete. 2024-09-13T18:40:40.728 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:40:40.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.818+0000 7fa57b31d640 1 Processor -- start 2024-09-13T18:40:40.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.818+0000 7fa57b31d640 1 -- start start 2024-09-13T18:40:40.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa57b31d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57412f840 0x7fa57412fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa57b31d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa57409e840 0x7fa57409ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa57b31d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa57409f190 0x7fa5741366f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa57b31d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa574068220 con 0x7fa57409e840 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa57b31d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa574069f70 con 0x7fa57412f840 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa57b31d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa574069c80 con 0x7fa57409f190 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5798ba640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa57409f190 0x7fa5741366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5790b9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57412f840 0x7fa57412fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5788b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa57409e840 0x7fa57409ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5798ba640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa57409f190 0x7fa5741366f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51692/0 (socket says 172.21.15.97:51692) 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5788b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa57409e840 0x7fa57409ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44156/0 (socket says 172.21.15.97:44156) 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5798ba640 1 -- 172.21.15.97:0/2599470171 learned_addr learned my addr 172.21.15.97:0/2599470171 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5790b9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57412f840 0x7fa57412fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37456/0 (socket says 172.21.15.97:37456) 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5798ba640 1 -- 172.21.15.97:0/2599470171 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57412f840 msgr2=0x7fa57412fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5798ba640 1 --2- 172.21.15.97:0/2599470171 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57412f840 0x7fa57412fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5798ba640 1 -- 172.21.15.97:0/2599470171 >> v2:172.21.15.97:3300/0 conn(0x7fa57409e840 msgr2=0x7fa57409ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5798ba640 1 --2- 172.21.15.97:0/2599470171 >> v2:172.21.15.97:3300/0 conn(0x7fa57409e840 0x7fa57409ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5798ba640 1 -- 172.21.15.97:0/2599470171 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa574069020 con 0x7fa57409f190 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5788b8640 1 --2- 172.21.15.97:0/2599470171 >> v2:172.21.15.97:3300/0 conn(0x7fa57409e840 0x7fa57409ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.819+0000 7fa5790b9640 1 --2- 172.21.15.97:0/2599470171 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57412f840 0x7fa57412fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.820+0000 7fa5798ba640 1 --2- 172.21.15.97:0/2599470171 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa57409f190 0x7fa5741366f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009f50 tx=0x7fa56c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aef2b8bcc6ba829 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.820+0000 7fa56bfff640 1 -- 172.21.15.97:0/2599470171 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c031400 con 0x7fa57409f190 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.820+0000 7fa56bfff640 1 -- 172.21.15.97:0/2599470171 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c02d050 con 0x7fa57409f190 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.820+0000 7fa56bfff640 1 -- 172.21.15.97:0/2599470171 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0317d0 con 0x7fa57409f190 2024-09-13T18:40:40.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.821+0000 7fa57b31d640 1 -- 172.21.15.97:0/2599470171 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa57409f190 msgr2=0x7fa5741366f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.821+0000 7fa57b31d640 1 --2- 172.21.15.97:0/2599470171 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa57409f190 0x7fa5741366f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009f50 tx=0x7fa56c009840 comp rx=0 tx=0).stop 2024-09-13T18:40:40.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.821+0000 7fa57b31d640 1 -- 172.21.15.97:0/2599470171 shutdown_connections 2024-09-13T18:40:40.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.821+0000 7fa57b31d640 1 --2- 172.21.15.97:0/2599470171 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa57409f190 0x7fa5741366f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.821+0000 7fa57b31d640 1 --2- 172.21.15.97:0/2599470171 >> v2:172.21.15.97:3300/0 conn(0x7fa57409e840 0x7fa57409ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.821+0000 7fa57b31d640 1 --2- 172.21.15.97:0/2599470171 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57412f840 0x7fa57412fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.821+0000 7fa57b31d640 1 -- 172.21.15.97:0/2599470171 >> 172.21.15.97:0/2599470171 conn(0x7fa5740676f0 msgr2=0x7fa5740a0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.821+0000 7fa57b31d640 1 -- 172.21.15.97:0/2599470171 shutdown_connections 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.821+0000 7fa57b31d640 1 -- 172.21.15.97:0/2599470171 wait complete. 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.821+0000 7fa57b31d640 1 Processor -- start 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.821+0000 7fa57b31d640 1 -- start start 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa57b31d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57409e840 0x7fa57411ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa57b31d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa57409f190 0x7fa57411e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa57b31d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa57412f840 0x7fa57413e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa57b31d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa574120d80 con 0x7fa57412f840 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa57b31d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57411f1c0 con 0x7fa57409e840 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa57b31d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa57411db50 con 0x7fa57409f190 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa5790b9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57409e840 0x7fa57411ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa5788b8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa57409f190 0x7fa57411e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa5798ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa57412f840 0x7fa57413e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa5790b9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57409e840 0x7fa57411ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37460/0 (socket says 172.21.15.97:37460) 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa5790b9640 1 -- 172.21.15.97:0/3752728884 learned_addr learned my addr 172.21.15.97:0/3752728884 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa5788b8640 1 -- 172.21.15.97:0/3752728884 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57409e840 msgr2=0x7fa57411ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa5788b8640 1 --2- 172.21.15.97:0/3752728884 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57409e840 0x7fa57411ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa5788b8640 1 -- 172.21.15.97:0/3752728884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa57412f840 msgr2=0x7fa57413e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa5788b8640 1 --2- 172.21.15.97:0/3752728884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa57412f840 0x7fa57413e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa5788b8640 1 -- 172.21.15.97:0/3752728884 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa564009390 con 0x7fa57409f190 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa5790b9640 1 --2- 172.21.15.97:0/3752728884 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57409e840 0x7fa57411ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.822+0000 7fa5798ba640 1 --2- 172.21.15.97:0/3752728884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa57412f840 0x7fa57413e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.823+0000 7fa5788b8640 1 --2- 172.21.15.97:0/3752728884 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa57409f190 0x7fa57411e330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa56400ea50 tx=0x7fa5640090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.823+0000 7fa5697fa640 1 -- 172.21.15.97:0/3752728884 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56400ca10 con 0x7fa57409f190 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.823+0000 7fa5697fa640 1 -- 172.21.15.97:0/3752728884 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56400cb70 con 0x7fa57409f190 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.823+0000 7fa57b31d640 1 -- 172.21.15.97:0/3752728884 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa570009390 con 0x7fa57409f190 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.823+0000 7fa5697fa640 1 -- 172.21.15.97:0/3752728884 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564013470 con 0x7fa57409f190 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.823+0000 7fa57b31d640 1 -- 172.21.15.97:0/3752728884 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c009ae0 con 0x7fa57409f190 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.824+0000 7fa5697fa640 1 -- 172.21.15.97:0/3752728884 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fa5640137e0 con 0x7fa57409f190 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.824+0000 7fa5697fa640 1 -- 172.21.15.97:0/3752728884 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fa564042790 con 0x7fa57409f190 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.824+0000 7fa57b31d640 1 -- 172.21.15.97:0/3752728884 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa574064000 con 0x7fa57409f190 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:40.828+0000 7fa5697fa640 1 -- 172.21.15.97:0/3752728884 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fa564012730 con 0x7fa57409f190 2024-09-13T18:40:41.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.010+0000 7fa57b31d640 1 -- 172.21.15.97:0/3752728884 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa574120ec0 con 0x7fa57409f190 2024-09-13T18:40:41.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.010+0000 7fa5697fa640 1 -- 172.21.15.97:0/3752728884 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2264 (secure 0 0 0) 0x7fa56401b3b0 con 0x7fa57409f190 2024-09-13T18:40:41.013 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:40:41.013 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:13.885647+0000","modified":"2024-09-13T18:39:16.567097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6817/3890865357","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6817","nonce":3890865357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-09-13T18:40:41.014 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 5 2024-09-13T18:40:41.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.012+0000 7fa57b31d640 1 -- 172.21.15.97:0/3752728884 >> v1:172.21.15.97:6816/34603 conn(0x7fa558031160 legacy=0x7fa558033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.012+0000 7fa57b31d640 1 -- 172.21.15.97:0/3752728884 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa57409f190 msgr2=0x7fa57411e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.012+0000 7fa57b31d640 1 --2- 172.21.15.97:0/3752728884 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa57409f190 0x7fa57411e330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa56400ea50 tx=0x7fa5640090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.012+0000 7fa57b31d640 1 -- 172.21.15.97:0/3752728884 shutdown_connections 2024-09-13T18:40:41.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.012+0000 7fa57b31d640 1 --2- 172.21.15.97:0/3752728884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa57412f840 0x7fa57413e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.012+0000 7fa57b31d640 1 --2- 172.21.15.97:0/3752728884 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa57409f190 0x7fa57411e330 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.012+0000 7fa57b31d640 1 --2- 172.21.15.97:0/3752728884 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa57409e840 0x7fa57411ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.012+0000 7fa57b31d640 1 -- 172.21.15.97:0/3752728884 >> 172.21.15.97:0/3752728884 conn(0x7fa5740676f0 msgr2=0x7fa574116fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.012+0000 7fa57b31d640 1 -- 172.21.15.97:0/3752728884 shutdown_connections 2024-09-13T18:40:41.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.012+0000 7fa57b31d640 1 -- 172.21.15.97:0/3752728884 wait complete. 2024-09-13T18:40:41.025 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:40:41.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.116+0000 7f28bf4a8640 1 Processor -- start 2024-09-13T18:40:41.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.116+0000 7f28bf4a8640 1 -- start start 2024-09-13T18:40:41.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bf4a8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f28b809cea0 0x7f28b809d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bf4a8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f28b809d7b0 0x7f28b812d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bf4a8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28b812d6b0 0x7f28b812db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bf4a8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b809ca00 con 0x7f28b809d7b0 2024-09-13T18:40:41.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bf4a8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b809cca0 con 0x7f28b812d6b0 2024-09-13T18:40:41.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bf4a8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28b806a350 con 0x7f28b809cea0 2024-09-13T18:40:41.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bca43640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f28b809d7b0 0x7f28b812d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bd244640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f28b809cea0 0x7f28b809d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bda45640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28b812d6b0 0x7f28b812db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bca43640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f28b809d7b0 0x7f28b812d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44180/0 (socket says 172.21.15.97:44180) 2024-09-13T18:40:41.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bca43640 1 -- 172.21.15.97:0/1372867995 learned_addr learned my addr 172.21.15.97:0/1372867995 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:41.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bda45640 1 -- 172.21.15.97:0/1372867995 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f28b809cea0 msgr2=0x7f28b809d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:41.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bda45640 1 --2- 172.21.15.97:0/1372867995 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f28b809cea0 0x7f28b809d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bda45640 1 -- 172.21.15.97:0/1372867995 >> v2:172.21.15.97:3300/0 conn(0x7f28b809d7b0 msgr2=0x7f28b812d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:41.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bda45640 1 --2- 172.21.15.97:0/1372867995 >> v2:172.21.15.97:3300/0 conn(0x7f28b809d7b0 0x7f28b812d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bda45640 1 -- 172.21.15.97:0/1372867995 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b806e930 con 0x7f28b812d6b0 2024-09-13T18:40:41.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bd244640 1 --2- 172.21.15.97:0/1372867995 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f28b809cea0 0x7f28b809d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:41.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.117+0000 7f28bca43640 1 --2- 172.21.15.97:0/1372867995 >> v2:172.21.15.97:3300/0 conn(0x7f28b809d7b0 0x7f28b812d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.118+0000 7f28bda45640 1 --2- 172.21.15.97:0/1372867995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28b812d6b0 0x7f28b812db50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009e60 tx=0x7f28b0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=923644ea08f60b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.118+0000 7f28affff640 1 -- 172.21.15.97:0/1372867995 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0007550 con 0x7f28b812d6b0 2024-09-13T18:40:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.118+0000 7f28affff640 1 -- 172.21.15.97:0/1372867995 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b002d050 con 0x7f28b812d6b0 2024-09-13T18:40:41.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.118+0000 7f28affff640 1 -- 172.21.15.97:0/1372867995 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0007920 con 0x7f28b812d6b0 2024-09-13T18:40:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.119+0000 7f28bf4a8640 1 -- 172.21.15.97:0/1372867995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28b812d6b0 msgr2=0x7f28b812db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.119+0000 7f28bf4a8640 1 --2- 172.21.15.97:0/1372867995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28b812d6b0 0x7f28b812db50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009e60 tx=0x7f28b0009780 comp rx=0 tx=0).stop 2024-09-13T18:40:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.119+0000 7f28bf4a8640 1 -- 172.21.15.97:0/1372867995 shutdown_connections 2024-09-13T18:40:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.119+0000 7f28bf4a8640 1 --2- 172.21.15.97:0/1372867995 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28b812d6b0 0x7f28b812db50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.119+0000 7f28bf4a8640 1 --2- 172.21.15.97:0/1372867995 >> v2:172.21.15.97:3300/0 conn(0x7f28b809d7b0 0x7f28b812d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.119+0000 7f28bf4a8640 1 --2- 172.21.15.97:0/1372867995 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f28b809cea0 0x7f28b809d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.119+0000 7f28bf4a8640 1 -- 172.21.15.97:0/1372867995 >> 172.21.15.97:0/1372867995 conn(0x7f28b809b200 msgr2=0x7f28b809b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.119+0000 7f28bf4a8640 1 -- 172.21.15.97:0/1372867995 shutdown_connections 2024-09-13T18:40:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.119+0000 7f28bf4a8640 1 -- 172.21.15.97:0/1372867995 wait complete. 2024-09-13T18:40:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.119+0000 7f28bf4a8640 1 Processor -- start 2024-09-13T18:40:41.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.119+0000 7f28bf4a8640 1 -- start start 2024-09-13T18:40:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bf4a8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28b809cea0 0x7f28b812c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bf4a8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f28b809d7b0 0x7f28b8096a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bf4a8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28b812d6b0 0x7f28b8096f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bf4a8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b811fd50 con 0x7f28b809cea0 2024-09-13T18:40:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bf4a8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b805e2c0 con 0x7f28b812d6b0 2024-09-13T18:40:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bf4a8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8069a80 con 0x7f28b809d7b0 2024-09-13T18:40:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bd244640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28b809cea0 0x7f28b812c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bca43640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f28b809d7b0 0x7f28b8096a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bd244640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28b809cea0 0x7f28b812c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44188/0 (socket says 172.21.15.97:44188) 2024-09-13T18:40:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bd244640 1 -- 172.21.15.97:0/218527207 learned_addr learned my addr 172.21.15.97:0/218527207 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:41.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bda45640 1 --2- 172.21.15.97:0/218527207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28b812d6b0 0x7f28b8096f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bd244640 1 -- 172.21.15.97:0/218527207 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f28b809d7b0 msgr2=0x7f28b8096a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bd244640 1 --2- 172.21.15.97:0/218527207 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f28b809d7b0 0x7f28b8096a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bd244640 1 -- 172.21.15.97:0/218527207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28b812d6b0 msgr2=0x7f28b8096f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bd244640 1 --2- 172.21.15.97:0/218527207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28b812d6b0 0x7f28b8096f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.120+0000 7f28bd244640 1 -- 172.21.15.97:0/218527207 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4009390 con 0x7f28b809cea0 2024-09-13T18:40:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.121+0000 7f28bd244640 1 --2- 172.21.15.97:0/218527207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28b809cea0 0x7f28b812c6d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f28b400ec80 tx=0x7f28b40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.121+0000 7f28ad7fa640 1 -- 172.21.15.97:0/218527207 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b400eec0 con 0x7f28b809cea0 2024-09-13T18:40:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.121+0000 7f28ad7fa640 1 -- 172.21.15.97:0/218527207 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b400cbc0 con 0x7f28b809cea0 2024-09-13T18:40:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.121+0000 7f28bf4a8640 1 -- 172.21.15.97:0/218527207 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a8009450 con 0x7f28b809cea0 2024-09-13T18:40:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.121+0000 7f28ad7fa640 1 -- 172.21.15.97:0/218527207 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4013470 con 0x7f28b809cea0 2024-09-13T18:40:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.121+0000 7f28bf4a8640 1 -- 172.21.15.97:0/218527207 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b0009a20 con 0x7f28b809cea0 2024-09-13T18:40:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.121+0000 7f28ad7fa640 1 -- 172.21.15.97:0/218527207 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f28b40137e0 con 0x7f28b809cea0 2024-09-13T18:40:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.122+0000 7f28ad7fa640 1 -- 172.21.15.97:0/218527207 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f28b40424d0 con 0x7f28b809cea0 2024-09-13T18:40:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.122+0000 7f28bf4a8640 1 -- 172.21.15.97:0/218527207 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b8120eb0 con 0x7f28b809cea0 2024-09-13T18:40:41.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.126+0000 7f28ad7fa640 1 -- 172.21.15.97:0/218527207 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f28b4023aa0 con 0x7f28b809cea0 2024-09-13T18:40:41.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.279+0000 7f28bf4a8640 1 -- 172.21.15.97:0/218527207 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28b8064000 con 0x7f28b809cea0 2024-09-13T18:40:41.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.279+0000 7f28ad7fa640 1 -- 172.21.15.97:0/218527207 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+11626 (secure 0 0 0) 0x7f28b40232f0 con 0x7f28b809cea0 2024-09-13T18:40:41.282 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:40:41.282 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":23,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:54.652125+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.8","mappings":[{"from":1,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:41.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.281+0000 7f28bf4a8640 1 -- 172.21.15.97:0/218527207 >> v1:172.21.15.97:6816/34603 conn(0x7f289c031160 legacy=0x7f289c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.281+0000 7f28bf4a8640 1 -- 172.21.15.97:0/218527207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28b809cea0 msgr2=0x7f28b812c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.281+0000 7f28bf4a8640 1 --2- 172.21.15.97:0/218527207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28b809cea0 0x7f28b812c6d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f28b400ec80 tx=0x7f28b40090f0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.282+0000 7f28bf4a8640 1 -- 172.21.15.97:0/218527207 shutdown_connections 2024-09-13T18:40:41.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.282+0000 7f28bf4a8640 1 --2- 172.21.15.97:0/218527207 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f28b812d6b0 0x7f28b8096f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.282+0000 7f28bf4a8640 1 --2- 172.21.15.97:0/218527207 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f28b809d7b0 0x7f28b8096a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.282+0000 7f28bf4a8640 1 --2- 172.21.15.97:0/218527207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28b809cea0 0x7f28b812c6d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.282+0000 7f28bf4a8640 1 -- 172.21.15.97:0/218527207 >> 172.21.15.97:0/218527207 conn(0x7f28b809b200 msgr2=0x7f28b806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.282+0000 7f28bf4a8640 1 -- 172.21.15.97:0/218527207 shutdown_connections 2024-09-13T18:40:41.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.282+0000 7f28bf4a8640 1 -- 172.21.15.97:0/218527207 wait complete. 2024-09-13T18:40:41.295 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:40:41.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.387+0000 7f8fc86c9640 1 Processor -- start 2024-09-13T18:40:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.387+0000 7f8fc86c9640 1 -- start start 2024-09-13T18:40:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.387+0000 7f8fc86c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc00a1290 0x7f8fc012d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.387+0000 7f8fc86c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8fc012d7c0 0x7f8fc012db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.387+0000 7f8fc86c9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc006da40 con 0x7f8fc009b2a0 2024-09-13T18:40:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.387+0000 7f8fc86c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc006ee70 con 0x7f8fc012d7c0 2024-09-13T18:40:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.387+0000 7f8fc86c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc009cd30 con 0x7f8fc00a1290 2024-09-13T18:40:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.387+0000 7f8fc6465640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc00a1290 0x7f8fc012d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.387+0000 7f8fc5c64640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8fc012d7c0 0x7f8fc012db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.387+0000 7f8fc6c66640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f8fc009b2a0 0x7f8fc009b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58276/0 (socket says 172.21.15.97:58276) 2024-09-13T18:40:41.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.387+0000 7f8fc6465640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc00a1290 0x7f8fc012d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37492/0 (socket says 172.21.15.97:37492) 2024-09-13T18:40:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.387+0000 7f8fc5c64640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8fc012d7c0 0x7f8fc012db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44198/0 (socket says 172.21.15.97:44198) 2024-09-13T18:40:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.387+0000 7f8fc6465640 1 -- 172.21.15.97:0/1725651215 learned_addr learned my addr 172.21.15.97:0/1725651215 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.388+0000 7f8fc6465640 1 -- 172.21.15.97:0/1725651215 >> v2:172.21.15.97:3300/0 conn(0x7f8fc012d7c0 msgr2=0x7f8fc012db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.388+0000 7f8fc6465640 1 --2- 172.21.15.97:0/1725651215 >> v2:172.21.15.97:3300/0 conn(0x7f8fc012d7c0 0x7f8fc012db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.388+0000 7f8fc6465640 1 -- 172.21.15.97:0/1725651215 >> v1:172.21.15.97:6789/0 conn(0x7f8fc009b2a0 legacy=0x7f8fc009b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.388+0000 7f8fc6465640 1 -- 172.21.15.97:0/1725651215 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc012e0d0 con 0x7f8fc00a1290 2024-09-13T18:40:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.388+0000 7f8fc5463640 1 -- 172.21.15.97:0/1725651215 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412604590 0 0) 0x7f8fc006da40 con 0x7f8fc009b2a0 2024-09-13T18:40:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.388+0000 7f8fc5c64640 1 --2- 172.21.15.97:0/1725651215 >> v2:172.21.15.97:3300/0 conn(0x7f8fc012d7c0 0x7f8fc012db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.388+0000 7f8fc6465640 1 --2- 172.21.15.97:0/1725651215 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc00a1290 0x7f8fc012d1e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009940 tx=0x7f8fbc0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3391e543107e4690 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.389+0000 7f8fc5463640 1 -- 172.21.15.97:0/1725651215 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc02ad20 con 0x7f8fc00a1290 2024-09-13T18:40:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.389+0000 7f8fc5463640 1 -- 172.21.15.97:0/1725651215 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc02ae80 con 0x7f8fc00a1290 2024-09-13T18:40:41.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.389+0000 7f8fc5463640 1 -- 172.21.15.97:0/1725651215 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc032670 con 0x7f8fc00a1290 2024-09-13T18:40:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.389+0000 7f8fc86c9640 1 -- 172.21.15.97:0/1725651215 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc00a1290 msgr2=0x7f8fc012d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.389+0000 7f8fc86c9640 1 --2- 172.21.15.97:0/1725651215 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc00a1290 0x7f8fc012d1e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009940 tx=0x7f8fbc0091d0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.389+0000 7f8fc86c9640 1 -- 172.21.15.97:0/1725651215 shutdown_connections 2024-09-13T18:40:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.389+0000 7f8fc86c9640 1 --2- 172.21.15.97:0/1725651215 >> v2:172.21.15.97:3300/0 conn(0x7f8fc012d7c0 0x7f8fc012db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.389+0000 7f8fc86c9640 1 --2- 172.21.15.97:0/1725651215 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc00a1290 0x7f8fc012d1e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.389+0000 7f8fc86c9640 1 -- 172.21.15.97:0/1725651215 >> 172.21.15.97:0/1725651215 conn(0x7f8fc0067820 msgr2=0x7f8fc00a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.389+0000 7f8fc86c9640 1 -- 172.21.15.97:0/1725651215 shutdown_connections 2024-09-13T18:40:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.389+0000 7f8fc86c9640 1 -- 172.21.15.97:0/1725651215 wait complete. 2024-09-13T18:40:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.390+0000 7f8fc86c9640 1 Processor -- start 2024-09-13T18:40:41.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.390+0000 7f8fc86c9640 1 -- start start 2024-09-13T18:40:41.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.390+0000 7f8fc86c9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc009b2a0 0x7f8fc012a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.390+0000 7f8fc86c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fc00a1290 0x7f8fc0116f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.390+0000 7f8fc86c9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fc012d7c0 0x7f8fc0117450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.390+0000 7f8fc86c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc011ac00 con 0x7f8fc00a1290 2024-09-13T18:40:41.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.390+0000 7f8fc86c9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc006c150 con 0x7f8fc009b2a0 2024-09-13T18:40:41.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.390+0000 7f8fc86c9640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc011a210 con 0x7f8fc012d7c0 2024-09-13T18:40:41.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.390+0000 7f8fc6465640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc009b2a0 0x7f8fc012a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.390+0000 7f8fc5c64640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fc00a1290 0x7f8fc0116f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fc6465640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc009b2a0 0x7f8fc012a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37498/0 (socket says 172.21.15.97:37498) 2024-09-13T18:40:41.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fc6465640 1 -- 172.21.15.97:0/2087881793 learned_addr learned my addr 172.21.15.97:0/2087881793 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fc6c66640 1 --2- 172.21.15.97:0/2087881793 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fc012d7c0 0x7f8fc0117450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fc6465640 1 -- 172.21.15.97:0/2087881793 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fc012d7c0 msgr2=0x7f8fc0117450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fc6465640 1 --2- 172.21.15.97:0/2087881793 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fc012d7c0 0x7f8fc0117450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fc6465640 1 -- 172.21.15.97:0/2087881793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fc00a1290 msgr2=0x7f8fc0116f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fc6465640 1 --2- 172.21.15.97:0/2087881793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fc00a1290 0x7f8fc0116f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fc6465640 1 -- 172.21.15.97:0/2087881793 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb000d830 con 0x7f8fc009b2a0 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fc5c64640 1 --2- 172.21.15.97:0/2087881793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fc00a1290 0x7f8fc0116f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fc6465640 1 --2- 172.21.15.97:0/2087881793 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc009b2a0 0x7f8fc012a810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc02a690 tx=0x7f8fbc032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fb67fc640 1 -- 172.21.15.97:0/2087881793 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc03b610 con 0x7f8fc009b2a0 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fb67fc640 1 -- 172.21.15.97:0/2087881793 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc03b790 con 0x7f8fc009b2a0 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fc86c9640 1 -- 172.21.15.97:0/2087881793 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fbc009450 con 0x7f8fc009b2a0 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fb67fc640 1 -- 172.21.15.97:0/2087881793 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc03bb90 con 0x7f8fc009b2a0 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.391+0000 7f8fc86c9640 1 -- 172.21.15.97:0/2087881793 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc009a620 con 0x7f8fc009b2a0 2024-09-13T18:40:41.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.392+0000 7f8fb67fc640 1 -- 172.21.15.97:0/2087881793 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f8fbc039040 con 0x7f8fc009b2a0 2024-09-13T18:40:41.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.392+0000 7f8fb67fc640 1 -- 172.21.15.97:0/2087881793 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f8fbc041030 con 0x7f8fc009b2a0 2024-09-13T18:40:41.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.392+0000 7f8fc86c9640 1 -- 172.21.15.97:0/2087881793 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc0064600 con 0x7f8fc009b2a0 2024-09-13T18:40:41.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.396+0000 7f8fb67fc640 1 -- 172.21.15.97:0/2087881793 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f8fbc037080 con 0x7f8fc009b2a0 2024-09-13T18:40:41.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.582+0000 7f8fc86c9640 1 -- 172.21.15.97:0/2087881793 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fc012cfc0 con 0x7f8fc009b2a0 2024-09-13T18:40:41.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.582+0000 7f8fb67fc640 1 -- 172.21.15.97:0/2087881793 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2264 (secure 0 0 0) 0x7f8fbc04b070 con 0x7f8fc009b2a0 2024-09-13T18:40:41.585 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:40:41.585 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:13.885647+0000","modified":"2024-09-13T18:39:16.567097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6817/3890865357","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6817","nonce":3890865357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-09-13T18:40:41.586 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 5 2024-09-13T18:40:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.584+0000 7f8fc86c9640 1 -- 172.21.15.97:0/2087881793 >> v1:172.21.15.97:6816/34603 conn(0x7f8fa4031160 legacy=0x7f8fa4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.584+0000 7f8fc86c9640 1 -- 172.21.15.97:0/2087881793 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc009b2a0 msgr2=0x7f8fc012a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.584+0000 7f8fc86c9640 1 --2- 172.21.15.97:0/2087881793 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc009b2a0 0x7f8fc012a810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc02a690 tx=0x7f8fbc032000 comp rx=0 tx=0).stop 2024-09-13T18:40:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.585+0000 7f8fc86c9640 1 -- 172.21.15.97:0/2087881793 shutdown_connections 2024-09-13T18:40:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.585+0000 7f8fc86c9640 1 --2- 172.21.15.97:0/2087881793 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f8fc012d7c0 0x7f8fc0117450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.585+0000 7f8fc86c9640 1 --2- 172.21.15.97:0/2087881793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8fc00a1290 0x7f8fc0116f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.585+0000 7f8fc86c9640 1 --2- 172.21.15.97:0/2087881793 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f8fc009b2a0 0x7f8fc012a810 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.585+0000 7f8fc86c9640 1 -- 172.21.15.97:0/2087881793 >> 172.21.15.97:0/2087881793 conn(0x7f8fc0067820 msgr2=0x7f8fc009d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.585+0000 7f8fc86c9640 1 -- 172.21.15.97:0/2087881793 shutdown_connections 2024-09-13T18:40:41.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.585+0000 7f8fc86c9640 1 -- 172.21.15.97:0/2087881793 wait complete. 2024-09-13T18:40:41.698 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:39:13.885647+0000', 'modified': '2024-09-13T18:39:16.567097+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4204}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4204': {'gid': 4204, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.97:6817/3890865357', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.97:6817', 'nonce': 3890865357}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-09-13T18:40:41.698 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:40:41.699 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:40:41.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.791+0000 7f2caa39d640 1 Processor -- start 2024-09-13T18:40:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.791+0000 7f2caa39d640 1 -- start start 2024-09-13T18:40:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2caa39d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca409dfb0 0x7f2ca4096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2caa39d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2ca40974c0 0x7f2ca412c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2caa39d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca406a190 con 0x7f2ca40969d0 2024-09-13T18:40:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2caa39d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca409e380 con 0x7f2ca40974c0 2024-09-13T18:40:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2caa39d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca4098870 con 0x7f2ca409dfb0 2024-09-13T18:40:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca409dfb0 0x7f2ca4096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca409dfb0 0x7f2ca4096f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51734/0 (socket says 172.21.15.97:51734) 2024-09-13T18:40:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2ca893a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2ca40974c0 0x7f2ca412c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2ca3fff640 1 -- 172.21.15.97:0/1948001808 learned_addr learned my addr 172.21.15.97:0/1948001808 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2ca37fe640 1 --1- 172.21.15.97:0/1948001808 >> v1:172.21.15.97:6789/0 conn(0x7f2ca40969d0 0x7f2ca412bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58282/0 (socket says 172.21.15.97:58282) 2024-09-13T18:40:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2ca893a640 1 -- 172.21.15.97:0/1948001808 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca409dfb0 msgr2=0x7f2ca4096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2ca893a640 1 --2- 172.21.15.97:0/1948001808 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca409dfb0 0x7f2ca4096f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2ca893a640 1 -- 172.21.15.97:0/1948001808 >> v1:172.21.15.97:6789/0 conn(0x7f2ca40969d0 legacy=0x7f2ca412bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2ca2ffd640 1 -- 172.21.15.97:0/1948001808 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416191137 0 0) 0x7f2ca406a190 con 0x7f2ca40969d0 2024-09-13T18:40:41.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2ca893a640 1 -- 172.21.15.97:0/1948001808 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca4097960 con 0x7f2ca40974c0 2024-09-13T18:40:41.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.792+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/1948001808 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca409dfb0 0x7f2ca4096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:41.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.793+0000 7f2ca893a640 1 --2- 172.21.15.97:0/1948001808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ca40974c0 0x7f2ca412c680 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009e90 tx=0x7f2c9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec46c61e83ee222 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.793+0000 7f2ca2ffd640 1 -- 172.21.15.97:0/1948001808 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c02aea0 con 0x7f2ca40974c0 2024-09-13T18:40:41.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.793+0000 7f2ca2ffd640 1 -- 172.21.15.97:0/1948001808 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c02d050 con 0x7f2ca40974c0 2024-09-13T18:40:41.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.793+0000 7f2ca2ffd640 1 -- 172.21.15.97:0/1948001808 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c007780 con 0x7f2ca40974c0 2024-09-13T18:40:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.793+0000 7f2caa39d640 1 -- 172.21.15.97:0/1948001808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ca40974c0 msgr2=0x7f2ca412c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.793+0000 7f2caa39d640 1 --2- 172.21.15.97:0/1948001808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ca40974c0 0x7f2ca412c680 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009e90 tx=0x7f2c9c009780 comp rx=0 tx=0).stop 2024-09-13T18:40:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.793+0000 7f2caa39d640 1 -- 172.21.15.97:0/1948001808 shutdown_connections 2024-09-13T18:40:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.793+0000 7f2caa39d640 1 --2- 172.21.15.97:0/1948001808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ca40974c0 0x7f2ca412c680 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.793+0000 7f2caa39d640 1 --2- 172.21.15.97:0/1948001808 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca409dfb0 0x7f2ca4096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.793+0000 7f2caa39d640 1 -- 172.21.15.97:0/1948001808 >> 172.21.15.97:0/1948001808 conn(0x7f2ca409b200 msgr2=0x7f2ca409b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.794+0000 7f2caa39d640 1 -- 172.21.15.97:0/1948001808 shutdown_connections 2024-09-13T18:40:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.794+0000 7f2caa39d640 1 -- 172.21.15.97:0/1948001808 wait complete. 2024-09-13T18:40:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.794+0000 7f2caa39d640 1 Processor -- start 2024-09-13T18:40:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.794+0000 7f2caa39d640 1 -- start start 2024-09-13T18:40:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2caa39d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca40969d0 0x7f2ca413a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2caa39d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ca40974c0 0x7f2ca413aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2caa39d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ca409dfb0 0x7f2ca4119f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2caa39d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca411bfb0 con 0x7f2ca409dfb0 2024-09-13T18:40:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2caa39d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca412d2a0 con 0x7f2ca40974c0 2024-09-13T18:40:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2caa39d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca409a180 con 0x7f2ca40969d0 2024-09-13T18:40:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca893a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ca409dfb0 0x7f2ca4119f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca40969d0 0x7f2ca413a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca37fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ca40974c0 0x7f2ca413aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca40969d0 0x7f2ca413a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51738/0 (socket says 172.21.15.97:51738) 2024-09-13T18:40:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca893a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ca409dfb0 0x7f2ca4119f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44214/0 (socket says 172.21.15.97:44214) 2024-09-13T18:40:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca3fff640 1 -- 172.21.15.97:0/2655825945 learned_addr learned my addr 172.21.15.97:0/2655825945 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca3fff640 1 -- 172.21.15.97:0/2655825945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ca40974c0 msgr2=0x7f2ca413aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/2655825945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ca40974c0 0x7f2ca413aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca3fff640 1 -- 172.21.15.97:0/2655825945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ca409dfb0 msgr2=0x7f2ca4119f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/2655825945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ca409dfb0 0x7f2ca4119f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca3fff640 1 -- 172.21.15.97:0/2655825945 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9400b700 con 0x7f2ca40969d0 2024-09-13T18:40:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca37fe640 1 --2- 172.21.15.97:0/2655825945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ca40974c0 0x7f2ca413aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca893a640 1 --2- 172.21.15.97:0/2655825945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ca409dfb0 0x7f2ca4119f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.795+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/2655825945 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca40969d0 0x7f2ca413a570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400e3e0 tx=0x7f2c9400b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.796+0000 7f2c8bfff640 1 -- 172.21.15.97:0/2655825945 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9400ba70 con 0x7f2ca40969d0 2024-09-13T18:40:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.796+0000 7f2c8bfff640 1 -- 172.21.15.97:0/2655825945 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c94011660 con 0x7f2ca40969d0 2024-09-13T18:40:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.796+0000 7f2c8bfff640 1 -- 172.21.15.97:0/2655825945 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94011a00 con 0x7f2ca40969d0 2024-09-13T18:40:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.796+0000 7f2caa39d640 1 -- 172.21.15.97:0/2655825945 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9c009a20 con 0x7f2ca40969d0 2024-09-13T18:40:41.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.796+0000 7f2caa39d640 1 -- 172.21.15.97:0/2655825945 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca411e0d0 con 0x7f2ca40969d0 2024-09-13T18:40:41.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.797+0000 7f2c8bfff640 1 -- 172.21.15.97:0/2655825945 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f2c94019440 con 0x7f2ca40969d0 2024-09-13T18:40:41.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.797+0000 7f2c8bfff640 1 -- 172.21.15.97:0/2655825945 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f2c94044f30 con 0x7f2ca40969d0 2024-09-13T18:40:41.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.798+0000 7f2cac89f740 1 Processor -- start 2024-09-13T18:40:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.798+0000 7f2cac89f740 1 -- start start 2024-09-13T18:40:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2cac89f740 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff60a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2cac89f740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff60ecc0 0x563dff60ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2cac89f740 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff610960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2cac89f740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff55fe70 con 0x563dff60ecc0 2024-09-13T18:40:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2cac89f740 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dff55d600 con 0x563dff60a420 2024-09-13T18:40:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2cac89f740 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x563dff5592e0 con 0x563dff5f48f0 2024-09-13T18:40:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2ca37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff60ecc0 0x563dff60ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff60a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2ca893a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff610960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff60a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37512/0 (socket says 172.21.15.97:37512) 2024-09-13T18:40:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2ca37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff60ecc0 0x563dff60ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44220/0 (socket says 172.21.15.97:44220) 2024-09-13T18:40:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2ca3fff640 1 -- 172.21.15.97:0/3919121220 learned_addr learned my addr 172.21.15.97:0/3919121220 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2ca3fff640 1 -- 172.21.15.97:0/3919121220 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 msgr2=0x563dff610960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/3919121220 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff610960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2ca3fff640 1 -- 172.21.15.97:0/3919121220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff60ecc0 msgr2=0x563dff60ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/3919121220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff60ecc0 0x563dff60ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2ca3fff640 1 -- 172.21.15.97:0/3919121220 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dff2819e0 con 0x563dff60a420 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/3919121220 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff60a7f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400ef70 tx=0x7f2c94019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b02f766d3759622 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2c89ffb640 1 -- 172.21.15.97:0/3919121220 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c940176e0 con 0x563dff60a420 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2c89ffb640 1 -- 172.21.15.97:0/3919121220 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c94033110 con 0x563dff60a420 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.799+0000 7f2c89ffb640 1 -- 172.21.15.97:0/3919121220 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9400a2b0 con 0x563dff60a420 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.800+0000 7f2cac89f740 1 -- 172.21.15.97:0/3919121220 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 msgr2=0x563dff60a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.800+0000 7f2cac89f740 1 --2- 172.21.15.97:0/3919121220 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff60a7f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400ef70 tx=0x7f2c94019000 comp rx=0 tx=0).stop 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.800+0000 7f2cac89f740 1 -- 172.21.15.97:0/3919121220 shutdown_connections 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.800+0000 7f2cac89f740 1 --2- 172.21.15.97:0/3919121220 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff610960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.800+0000 7f2cac89f740 1 --2- 172.21.15.97:0/3919121220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff60ecc0 0x563dff60ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.800+0000 7f2cac89f740 1 --2- 172.21.15.97:0/3919121220 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff60a7f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.800+0000 7f2cac89f740 1 -- 172.21.15.97:0/3919121220 >> 172.21.15.97:0/3919121220 conn(0x563dff5c0fe0 msgr2=0x563dff5f6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.800+0000 7f2cac89f740 1 -- 172.21.15.97:0/3919121220 shutdown_connections 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.800+0000 7f2cac89f740 1 -- 172.21.15.97:0/3919121220 wait complete. 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.800+0000 7f2cac89f740 1 -- start start 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.800+0000 7f2cac89f740 1 Processor -- start 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2cac89f740 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff609260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2cac89f740 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff6097a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2cac89f740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5febe0 0x563dff5fc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2cac89f740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff4fb1b0 con 0x563dff5febe0 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2cac89f740 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dff4fae50 con 0x563dff60a420 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2cac89f740 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x563dff2a3590 con 0x563dff5f48f0 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2cac89f740 10 client.0 _ll_register_callbacks cb 0x563dff552b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:40:41.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2ca893a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5febe0 0x563dff5fc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2ca893a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5febe0 0x563dff5fc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44226/0 (socket says 172.21.15.97:44226) 2024-09-13T18:40:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2ca893a640 1 -- 172.21.15.97:0/1820707838 learned_addr learned my addr 172.21.15.97:0/1820707838 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2ca37fe640 1 --2- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff6097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff609260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2ca37fe640 1 -- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 msgr2=0x563dff609260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2ca37fe640 1 --2- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff609260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2ca37fe640 1 -- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5febe0 msgr2=0x563dff5fc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2ca37fe640 1 --2- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5febe0 0x563dff5fc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2ca37fe640 1 -- 172.21.15.97:0/1820707838 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca411e0d0 con 0x563dff60a420 2024-09-13T18:40:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff609260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.801+0000 7f2ca893a640 1 --2- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5febe0 0x563dff5fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2ca37fe640 1 --2- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff6097a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2c980011e0 tx=0x7f2c98007ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82c314bea003cc3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2c827fc640 10 client.0 ms_handle_connect on v2:172.21.15.97:3301/0 2024-09-13T18:40:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2c827fc640 1 -- 172.21.15.97:0/1820707838 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98014890 con 0x563dff60a420 2024-09-13T18:40:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2c827fc640 1 -- 172.21.15.97:0/1820707838 <== mon.1 v2:172.21.15.97:3301/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f2c980149f0 con 0x563dff60a420 2024-09-13T18:40:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2cac89f740 1 -- 172.21.15.97:0/1820707838 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563dff25f3c0 con 0x563dff60a420 2024-09-13T18:40:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2c827fc640 1 -- 172.21.15.97:0/1820707838 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c98014dc0 con 0x563dff60a420 2024-09-13T18:40:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2cac89f740 10 client.4765 fetch_fsmap learned FSMap version 5 2024-09-13T18:40:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2cac89f740 1 -- 172.21.15.97:0/1820707838 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x563dff50bab0 con 0x563dff60a420 2024-09-13T18:40:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2c827fc640 1 -- 172.21.15.97:0/1820707838 <== mon.1 v2:172.21.15.97:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563dff25f3c0 con 0x563dff60a420 2024-09-13T18:40:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2c827fc640 1 -- 172.21.15.97:0/1820707838 <== mon.1 v2:172.21.15.97:3301/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f2c98017a70 con 0x563dff60a420 2024-09-13T18:40:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2cac89f740 10 client.4765 fetch_fsmap finished waiting for FSMap version 5 2024-09-13T18:40:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2cac89f740 10 client.4765 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:40:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2cac89f740 20 client.4765 populate_metadata read hostname 'smithi097' 2024-09-13T18:40:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2cac89f740 4 client.4765 mds_command: new command op to 4204 tid=0[{"prefix": "get_command_descriptions"}] 2024-09-13T18:40:41.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2cac89f740 1 -- 172.21.15.97:0/1820707838 --> v1:172.21.15.97:6817/3890865357 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563dff2706c0 con 0x563dff6307c0 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.802+0000 7f2c827fc640 10 client.4765 ms_handle_connect on v1:172.21.15.97:6817/3890865357 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2c827fc640 1 -- 172.21.15.97:0/1820707838 <== mds.0 v1:172.21.15.97:6817/3890865357 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (unknown 0 0 610023333) 0x563dff2706c0 con 0x563dff6307c0 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2c827fc640 10 client.4765 handle_command_reply: tid=0 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2cac89f740 1 client.4765 shutdown 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2cac89f740 1 -- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 msgr2=0x563dff6097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2cac89f740 1 --2- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff6097a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2c980011e0 tx=0x7f2c98007ca0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2cac89f740 1 -- 172.21.15.97:0/1820707838 shutdown_connections 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2cac89f740 1 --2- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5febe0 0x563dff5fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2c827fc640 0 client.4765 ms_handle_reset on v1:172.21.15.97:6817/3890865357 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2cac89f740 1 --2- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff6097a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2cac89f740 1 --2- 172.21.15.97:0/1820707838 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff609260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2cac89f740 1 -- 172.21.15.97:0/1820707838 >> 172.21.15.97:0/1820707838 conn(0x563dff5c0fe0 msgr2=0x563dff610860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2cac89f740 1 -- 172.21.15.97:0/1820707838 shutdown_connections 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2cac89f740 1 -- 172.21.15.97:0/1820707838 wait complete. 2024-09-13T18:40:41.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.803+0000 7f2cac89f740 20 client.4765 trim_cache size 0 max 16384 2024-09-13T18:40:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.817+0000 7f2cac89f740 1 Processor -- start 2024-09-13T18:40:41.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.817+0000 7f2cac89f740 1 -- start start 2024-09-13T18:40:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.817+0000 7f2cac89f740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5f48f0 0x563dff5fefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.817+0000 7f2cac89f740 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff5febe0 0x563dff609220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.817+0000 7f2cac89f740 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff60a420 0x563dff609760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.817+0000 7f2cac89f740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff609ca0 con 0x563dff5f48f0 2024-09-13T18:40:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.817+0000 7f2cac89f740 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dff60a1e0 con 0x563dff5febe0 2024-09-13T18:40:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.817+0000 7f2cac89f740 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x563dff5f6740 con 0x563dff60a420 2024-09-13T18:40:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2ca37fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff5febe0 0x563dff609220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5f48f0 0x563dff5fefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5f48f0 0x563dff5fefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44230/0 (socket says 172.21.15.97:44230) 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2ca893a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff60a420 0x563dff609760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2ca37fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff5febe0 0x563dff609220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37532/0 (socket says 172.21.15.97:37532) 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2ca3fff640 1 -- 172.21.15.97:0/94063485 learned_addr learned my addr 172.21.15.97:0/94063485 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2ca3fff640 1 -- 172.21.15.97:0/94063485 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff60a420 msgr2=0x563dff609760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/94063485 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff60a420 0x563dff609760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2ca3fff640 1 -- 172.21.15.97:0/94063485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff5febe0 msgr2=0x563dff609220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/94063485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff5febe0 0x563dff609220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2ca3fff640 1 -- 172.21.15.97:0/94063485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dff4ffbc0 con 0x563dff5f48f0 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/94063485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5f48f0 0x563dff5fefb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c94000c00 tx=0x7f2c94008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96940dad49f499f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2c8a7fc640 1 -- 172.21.15.97:0/94063485 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9400a2b0 con 0x563dff5f48f0 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2c8a7fc640 1 -- 172.21.15.97:0/94063485 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c940176e0 con 0x563dff5f48f0 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.818+0000 7f2c8a7fc640 1 -- 172.21.15.97:0/94063485 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94011b60 con 0x563dff5f48f0 2024-09-13T18:40:41.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.819+0000 7f2cac89f740 1 -- 172.21.15.97:0/94063485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5f48f0 msgr2=0x563dff5fefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.819+0000 7f2cac89f740 1 --2- 172.21.15.97:0/94063485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5f48f0 0x563dff5fefb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c94000c00 tx=0x7f2c94008040 comp rx=0 tx=0).stop 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.819+0000 7f2cac89f740 1 -- 172.21.15.97:0/94063485 shutdown_connections 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.819+0000 7f2cac89f740 1 --2- 172.21.15.97:0/94063485 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff60a420 0x563dff609760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.819+0000 7f2cac89f740 1 --2- 172.21.15.97:0/94063485 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff5febe0 0x563dff609220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.819+0000 7f2cac89f740 1 --2- 172.21.15.97:0/94063485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5f48f0 0x563dff5fefb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.819+0000 7f2cac89f740 1 -- 172.21.15.97:0/94063485 >> 172.21.15.97:0/94063485 conn(0x563dff5c0fe0 msgr2=0x563dff60a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.819+0000 7f2cac89f740 1 -- 172.21.15.97:0/94063485 shutdown_connections 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.819+0000 7f2cac89f740 1 -- 172.21.15.97:0/94063485 wait complete. 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.819+0000 7f2cac89f740 1 -- start start 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.819+0000 7f2cac89f740 1 Processor -- start 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2cac89f740 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff62b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2cac89f740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5febe0 0x563dff62bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2cac89f740 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff67f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2cac89f740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dff60e3a0 con 0x563dff5febe0 2024-09-13T18:40:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2cac89f740 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dff663c90 con 0x563dff60a420 2024-09-13T18:40:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2cac89f740 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x563dff634280 con 0x563dff5f48f0 2024-09-13T18:40:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2cac89f740 10 client.0 _ll_register_callbacks cb 0x563dff60b1d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:40:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff62b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff62b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:51778/0 (socket says 172.21.15.97:51778) 2024-09-13T18:40:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2ca893a640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff67f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2ca3fff640 1 -- 172.21.15.97:0/669452619 learned_addr learned my addr 172.21.15.97:0/669452619 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2ca37fe640 1 --2- 172.21.15.97:0/669452619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5febe0 0x563dff62bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2ca3fff640 1 -- 172.21.15.97:0/669452619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 msgr2=0x563dff67f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/669452619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff67f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2ca3fff640 1 -- 172.21.15.97:0/669452619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5febe0 msgr2=0x563dff62bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:41.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/669452619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5febe0 0x563dff62bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2ca3fff640 1 -- 172.21.15.97:0/669452619 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563dff2819e0 con 0x563dff5f48f0 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2ca893a640 1 --2- 172.21.15.97:0/669452619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff67f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2ca3fff640 1 --2- 172.21.15.97:0/669452619 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff62b620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400ef70 tx=0x7f2c9402a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbc73f7e3d18e3df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2c827fc640 10 client.0 ms_handle_connect on v2:172.21.15.97:3302/0 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2c827fc640 1 -- 172.21.15.97:0/669452619 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9400a2b0 con 0x563dff5f48f0 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2c827fc640 1 -- 172.21.15.97:0/669452619 <== mon.2 v2:172.21.15.97:3302/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f2c9400daa0 con 0x563dff5f48f0 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2cac89f740 1 -- 172.21.15.97:0/669452619 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c94033110 con 0x563dff5f48f0 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2c827fc640 1 -- 172.21.15.97:0/669452619 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c94019e20 con 0x563dff5f48f0 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2cac89f740 10 client.4775 fetch_fsmap learned FSMap version 5 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2cac89f740 1 -- 172.21.15.97:0/669452619 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x563dff525780 con 0x563dff5f48f0 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.820+0000 7f2c827fc640 1 -- 172.21.15.97:0/669452619 <== mon.2 v2:172.21.15.97:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c94033110 con 0x563dff5f48f0 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2c827fc640 1 -- 172.21.15.97:0/669452619 <== mon.2 v2:172.21.15.97:3302/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f2c94011b60 con 0x563dff5f48f0 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 10 client.4775 fetch_fsmap finished waiting for FSMap version 5 2024-09-13T18:40:41.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 10 client.4775 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:40:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 20 client.4775 populate_metadata read hostname 'smithi097' 2024-09-13T18:40:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 4 client.4775 mds_command: new command op to 4204 tid=0[{"prefix": "status"}] 2024-09-13T18:40:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 1 -- 172.21.15.97:0/669452619 --> v1:172.21.15.97:6817/3890865357 -- command(tid 0: {"prefix": "status"}) v1 -- 0x563dff2c3d10 con 0x563dff67fae0 2024-09-13T18:40:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2c827fc640 10 client.4775 ms_handle_connect on v1:172.21.15.97:6817/3890865357 2024-09-13T18:40:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2c827fc640 1 -- 172.21.15.97:0/669452619 <== mds.0 v1:172.21.15.97:6817/3890865357 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 3341910985) 0x563dff2c3d10 con 0x563dff67fae0 2024-09-13T18:40:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2c827fc640 10 client.4775 handle_command_reply: tid=0 2024-09-13T18:40:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 1 client.4775 shutdown 2024-09-13T18:40:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 1 -- 172.21.15.97:0/669452619 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 msgr2=0x563dff62b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 1 --2- 172.21.15.97:0/669452619 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff62b620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400ef70 tx=0x7f2c9402a000 comp rx=0 tx=0).stop 2024-09-13T18:40:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 1 -- 172.21.15.97:0/669452619 shutdown_connections 2024-09-13T18:40:41.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 1 --2- 172.21.15.97:0/669452619 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x563dff60a420 0x563dff67f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 1 --2- 172.21.15.97:0/669452619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563dff5febe0 0x563dff62bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 1 --2- 172.21.15.97:0/669452619 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x563dff5f48f0 0x563dff62b620 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2c827fc640 0 client.4775 ms_handle_reset on v1:172.21.15.97:6817/3890865357 2024-09-13T18:40:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 1 -- 172.21.15.97:0/669452619 >> 172.21.15.97:0/669452619 conn(0x563dff5c0fe0 msgr2=0x563dff5fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 1 -- 172.21.15.97:0/669452619 shutdown_connections 2024-09-13T18:40:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.821+0000 7f2cac89f740 1 -- 172.21.15.97:0/669452619 wait complete. 2024-09-13T18:40:41.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.822+0000 7f2cac89f740 20 client.4775 trim_cache size 0 max 16384 2024-09-13T18:40:41.831 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-13T18:40:41.831 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_fsid": "26171290-0086-4a00-9403-ffac581535bf", 2024-09-13T18:40:41.831 INFO:teuthology.orchestra.run.smithi097.stdout: "whoami": 0, 2024-09-13T18:40:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 4204, 2024-09-13T18:40:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: "want_state": "up:active", 2024-09-13T18:40:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: "state": "up:active", 2024-09-13T18:40:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs", 2024-09-13T18:40:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: "rank_uptime": 87.271471429000002, 2024-09-13T18:40:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: "mdsmap_epoch": 5, 2024-09-13T18:40:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch": 23, 2024-09-13T18:40:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch_barrier": 20, 2024-09-13T18:40:41.832 INFO:teuthology.orchestra.run.smithi097.stdout: "uptime": 92.200472771999998 2024-09-13T18:40:41.832 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-13T18:40:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.822+0000 7f2caa39d640 1 -- 172.21.15.97:0/2655825945 >> v1:172.21.15.97:6816/34603 conn(0x7f2c90031160 legacy=0x7f2c90033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.822+0000 7f2caa39d640 1 -- 172.21.15.97:0/2655825945 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca40969d0 msgr2=0x7f2ca413a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.822+0000 7f2caa39d640 1 --2- 172.21.15.97:0/2655825945 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca40969d0 0x7f2ca413a570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400e3e0 tx=0x7f2c9400b460 comp rx=0 tx=0).stop 2024-09-13T18:40:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.822+0000 7f2caa39d640 1 -- 172.21.15.97:0/2655825945 shutdown_connections 2024-09-13T18:40:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.822+0000 7f2caa39d640 1 --2- 172.21.15.97:0/2655825945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ca409dfb0 0x7f2ca4119f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.822+0000 7f2caa39d640 1 --2- 172.21.15.97:0/2655825945 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2ca40974c0 0x7f2ca413aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.822+0000 7f2caa39d640 1 --2- 172.21.15.97:0/2655825945 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2ca40969d0 0x7f2ca413a570 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.822+0000 7f2caa39d640 1 -- 172.21.15.97:0/2655825945 >> 172.21.15.97:0/2655825945 conn(0x7f2ca409b200 msgr2=0x7f2ca406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.822+0000 7f2caa39d640 1 -- 172.21.15.97:0/2655825945 shutdown_connections 2024-09-13T18:40:41.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:41.822+0000 7f2caa39d640 1 -- 172.21.15.97:0/2655825945 wait complete. 2024-09-13T18:40:41.835 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T18:40:41.844 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T18:40:41.844 INFO:tasks.ceph_fuse:config is {'client.0': None} 2024-09-13T18:40:41.845 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-13T18:40:41.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:41.845 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-13T18:40:41.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:41.866 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-09-13T18:40:41.940 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-09-13T18:40:41.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:40:41.941 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T18:40:41.942 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:40:41.942 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:40:42.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.032+0000 7f3c21f5d640 1 Processor -- start 2024-09-13T18:40:42.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.032+0000 7f3c21f5d640 1 -- start start 2024-09-13T18:40:42.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c21f5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 0x7f3c1c09d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c21f5d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3c1c12d880 0x7f3c1c1354c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c21f5d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c1c09cca0 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c21f5d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c1c09cac0 con 0x7f3c1c12d880 2024-09-13T18:40:42.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c21f5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c06a350 con 0x7f3c1c09cea0 2024-09-13T18:40:42.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c1b7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 0x7f3c1c09d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c1bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3c1c12d880 0x7f3c1c1354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c1b7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 0x7f3c1c09d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37550/0 (socket says 172.21.15.97:37550) 2024-09-13T18:40:42.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c1b7fe640 1 -- 172.21.15.97:0/1471245848 learned_addr learned my addr 172.21.15.97:0/1471245848 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:42.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c1affd640 1 --1- 172.21.15.97:0/1471245848 >> v1:172.21.15.97:6789/0 conn(0x7f3c1c09d7b0 0x7f3c1c12d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:58290/0 (socket says 172.21.15.97:58290) 2024-09-13T18:40:42.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c1b7fe640 1 -- 172.21.15.97:0/1471245848 >> v2:172.21.15.97:3300/0 conn(0x7f3c1c12d880 msgr2=0x7f3c1c1354c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:42.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c1b7fe640 1 --2- 172.21.15.97:0/1471245848 >> v2:172.21.15.97:3300/0 conn(0x7f3c1c12d880 0x7f3c1c1354c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c1b7fe640 1 -- 172.21.15.97:0/1471245848 >> v1:172.21.15.97:6789/0 conn(0x7f3c1c09d7b0 legacy=0x7f3c1c12d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c1b7fe640 1 -- 172.21.15.97:0/1471245848 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c06e930 con 0x7f3c1c09cea0 2024-09-13T18:40:42.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.033+0000 7f3c1bfff640 1 --2- 172.21.15.97:0/1471245848 >> v2:172.21.15.97:3300/0 conn(0x7f3c1c12d880 0x7f3c1c1354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.034+0000 7f3c1b7fe640 1 --2- 172.21.15.97:0/1471245848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 0x7f3c1c09d270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c009f20 tx=0x7f3c0c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba8e1246a0a33db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.034+0000 7f3c1a7fc640 1 -- 172.21.15.97:0/1471245848 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c031400 con 0x7f3c1c09cea0 2024-09-13T18:40:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.034+0000 7f3c1a7fc640 1 -- 172.21.15.97:0/1471245848 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0c02d050 con 0x7f3c1c09cea0 2024-09-13T18:40:42.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.034+0000 7f3c1a7fc640 1 -- 172.21.15.97:0/1471245848 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c0317d0 con 0x7f3c1c09cea0 2024-09-13T18:40:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.034+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1471245848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 msgr2=0x7f3c1c09d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.034+0000 7f3c21f5d640 1 --2- 172.21.15.97:0/1471245848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 0x7f3c1c09d270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c009f20 tx=0x7f3c0c009840 comp rx=0 tx=0).stop 2024-09-13T18:40:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.034+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1471245848 shutdown_connections 2024-09-13T18:40:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.034+0000 7f3c21f5d640 1 --2- 172.21.15.97:0/1471245848 >> v2:172.21.15.97:3300/0 conn(0x7f3c1c12d880 0x7f3c1c1354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.034+0000 7f3c21f5d640 1 --2- 172.21.15.97:0/1471245848 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 0x7f3c1c09d270 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.034+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1471245848 >> 172.21.15.97:0/1471245848 conn(0x7f3c1c09b200 msgr2=0x7f3c1c09b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.035+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1471245848 shutdown_connections 2024-09-13T18:40:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.035+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1471245848 wait complete. 2024-09-13T18:40:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.035+0000 7f3c21f5d640 1 Processor -- start 2024-09-13T18:40:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.035+0000 7f3c21f5d640 1 -- start start 2024-09-13T18:40:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c21f5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 0x7f3c1c122470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c21f5d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c1c09d7b0 0x7f3c1c096a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c21f5d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3c1c12d880 0x7f3c1c096f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c21f5d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c1208a0 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c21f5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c06e190 con 0x7f3c1c09cea0 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c21f5d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c069a80 con 0x7f3c1c12d880 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c1affd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c1c09d7b0 0x7f3c1c096a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c1b7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 0x7f3c1c122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c1b7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 0x7f3c1c122470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:37558/0 (socket says 172.21.15.97:37558) 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c1b7fe640 1 -- 172.21.15.97:0/1837117658 learned_addr learned my addr 172.21.15.97:0/1837117658 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c1bfff640 1 --2- 172.21.15.97:0/1837117658 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3c1c12d880 0x7f3c1c096f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c1affd640 1 -- 172.21.15.97:0/1837117658 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3c1c12d880 msgr2=0x7f3c1c096f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c1affd640 1 --2- 172.21.15.97:0/1837117658 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3c1c12d880 0x7f3c1c096f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c1affd640 1 -- 172.21.15.97:0/1837117658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 msgr2=0x7f3c1c122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c1affd640 1 --2- 172.21.15.97:0/1837117658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 0x7f3c1c122470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c1affd640 1 -- 172.21.15.97:0/1837117658 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c14009390 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c1b7fe640 1 --2- 172.21.15.97:0/1837117658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 0x7f3c1c122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c1affd640 1 --2- 172.21.15.97:0/1837117658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c1c09d7b0 0x7f3c1c096a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000c4c0 tx=0x7f3c10007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.036+0000 7f3c037fe640 1 -- 172.21.15.97:0/1837117658 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c100072e0 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.037+0000 7f3c037fe640 1 -- 172.21.15.97:0/1837117658 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c10007440 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.037+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1837117658 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0c009ae0 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.037+0000 7f3c037fe640 1 -- 172.21.15.97:0/1837117658 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c100047a0 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.037+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1837117658 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1c097480 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.037+0000 7f3c037fe640 1 -- 172.21.15.97:0/1837117658 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f3c10004b90 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.037+0000 7f3c037fe640 1 -- 172.21.15.97:0/1837117658 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f3c10041530 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.037+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1837117658 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1c098770 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.042+0000 7f3c037fe640 1 -- 172.21.15.97:0/1837117658 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f3c10004e40 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.224+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1837117658 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3c1c121910 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.225+0000 7f3c037fe640 1 -- 172.21.15.97:0/1837117658 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v5) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3c1000f260 con 0x7f3c1c09d7b0 2024-09-13T18:40:42.228 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:40:42.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.226+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1837117658 >> v1:172.21.15.97:6816/34603 conn(0x7f3c08031160 legacy=0x7f3c08033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.226+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1837117658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c1c09d7b0 msgr2=0x7f3c1c096a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.226+0000 7f3c21f5d640 1 --2- 172.21.15.97:0/1837117658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c1c09d7b0 0x7f3c1c096a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000c4c0 tx=0x7f3c10007e20 comp rx=0 tx=0).stop 2024-09-13T18:40:42.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.226+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1837117658 shutdown_connections 2024-09-13T18:40:42.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.226+0000 7f3c21f5d640 1 --2- 172.21.15.97:0/1837117658 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f3c1c12d880 0x7f3c1c096f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.226+0000 7f3c21f5d640 1 --2- 172.21.15.97:0/1837117658 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c1c09d7b0 0x7f3c1c096a00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.226+0000 7f3c21f5d640 1 --2- 172.21.15.97:0/1837117658 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f3c1c09cea0 0x7f3c1c122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.226+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1837117658 >> 172.21.15.97:0/1837117658 conn(0x7f3c1c09b200 msgr2=0x7f3c1c09a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:42.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.226+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1837117658 shutdown_connections 2024-09-13T18:40:42.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:40:42.226+0000 7f3c21f5d640 1 -- 172.21.15.97:0/1837117658 wait complete. 2024-09-13T18:40:42.240 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:40:42.240 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:40:42.240 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-09-13T18:40:42.240 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:40:42.240 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:42.240 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:40:42.240 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:40:42.240 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:40:42.240 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:40:42.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:42.240 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-09-13T18:40:42.260 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:40:42.260 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:40:42.260 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:40:42.260 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:42.260 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-09-13T18:40:42.260 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:42.260 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:40:42.261 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:42.261 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-09-13T18:40:42.261 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:40:42.261 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:42.261 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-09-13T18:40:42.261 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:40:42.262 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:42.262 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:40:42.262 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:42.262 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:40:42.262 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42745sec preferred_lft 42745sec 2024-09-13T18:40:42.262 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2024-09-13T18:40:42.262 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:42.262 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:40:42.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:42.263 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-09-13T18:40:42.263 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T18:40:42.263 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:40:42.263 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2024-09-13T18:40:42.263 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2024-09-13T18:40:42.263 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:40:42.263 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T18:40:42.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:42.370 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:40:42.395 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-09-13T18:40:42.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:42.397 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-09-13T18:40:42.453 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-09-13T18:40:42.454 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:40:42.454 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:40:42.454 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:40:42.454 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:40:42.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:42.454 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-09-13T18:40:42.454 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T18:40:42.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:40:42.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:40:42.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:40:42.455 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T18:40:42.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:42.543 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-13T18:40:42.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:42.558 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-09-13T18:40:42.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:42.615 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-09-13T18:40:42.615 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T18:40:42.615 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:40:42.615 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:40:42.615 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T18:40:42.694 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:40:42.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:42.694 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-09-13T18:40:42.694 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T18:40:42.694 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:40:42.694 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:40:42.695 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:40:42.695 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:40:42.695 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:40:42.695 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T18:40:42.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:42.822 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-09-13T18:40:42.822 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T18:40:42.822 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2024-09-13T18:40:42.822 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:40:42.822 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T18:40:42.859 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:40:42.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:40:42.859 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:42.914 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:40:42.915 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:40:42.915 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:42.970 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-09-13T18:40:43.035 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:40:43.036 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:40:43.099 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:40:43.100 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:40:43.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:43.101 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-09-13T18:40:43.159 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:40:43.159 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:40:43.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-09-13T18:40:43.225 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:40:43.225 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:40:43.284 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi142.stderr:2024-09-13T18:40:43.282+0000 7fc05d354480 -1 init, newargv = 0x5618d006d590 newargc=15 2024-09-13T18:40:43.285 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi142.stderr:ceph-fuse[30428]: starting ceph client 2024-09-13T18:40:43.289 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi142.stderr:ceph-fuse[30428]: starting fuse 2024-09-13T18:40:43.294 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:40:43.295 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:40:43.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:43.295 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-09-13T18:40:43.351 INFO:teuthology.orchestra.run.smithi142.stdout:41 2024-09-13T18:40:43.351 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-13T18:40:43.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:40:43.352 DEBUG:teuthology.orchestra.run.smithi142:> import glob 2024-09-13T18:40:43.352 DEBUG:teuthology.orchestra.run.smithi142:> import re 2024-09-13T18:40:43.352 DEBUG:teuthology.orchestra.run.smithi142:> import os 2024-09-13T18:40:43.352 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2024-09-13T18:40:43.352 DEBUG:teuthology.orchestra.run.smithi142:> 2024-09-13T18:40:43.352 DEBUG:teuthology.orchestra.run.smithi142:> def _find_admin_socket(client_name): 2024-09-13T18:40:43.352 DEBUG:teuthology.orchestra.run.smithi142:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:40:43.352 DEBUG:teuthology.orchestra.run.smithi142:> files = glob.glob(asok_path) 2024-09-13T18:40:43.352 DEBUG:teuthology.orchestra.run.smithi142:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:40:43.352 DEBUG:teuthology.orchestra.run.smithi142:> 2024-09-13T18:40:43.352 DEBUG:teuthology.orchestra.run.smithi142:> # Given a non-glob path, it better be there 2024-09-13T18:40:43.352 DEBUG:teuthology.orchestra.run.smithi142:> if "*" not in asok_path: 2024-09-13T18:40:43.353 DEBUG:teuthology.orchestra.run.smithi142:> assert(len(files) == 1) 2024-09-13T18:40:43.353 DEBUG:teuthology.orchestra.run.smithi142:> return files[0] 2024-09-13T18:40:43.353 DEBUG:teuthology.orchestra.run.smithi142:> 2024-09-13T18:40:43.353 DEBUG:teuthology.orchestra.run.smithi142:> for f in files: 2024-09-13T18:40:43.353 DEBUG:teuthology.orchestra.run.smithi142:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:40:43.353 DEBUG:teuthology.orchestra.run.smithi142:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:40:43.353 DEBUG:teuthology.orchestra.run.smithi142:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:40:43.353 DEBUG:teuthology.orchestra.run.smithi142:> contents = proc_f.read() 2024-09-13T18:40:43.353 DEBUG:teuthology.orchestra.run.smithi142:> if mountpoint in contents: 2024-09-13T18:40:43.353 DEBUG:teuthology.orchestra.run.smithi142:> return f 2024-09-13T18:40:43.353 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:40:43.353 DEBUG:teuthology.orchestra.run.smithi142:> 2024-09-13T18:40:43.353 DEBUG:teuthology.orchestra.run.smithi142:> print(_find_admin_socket("client.0")) 2024-09-13T18:40:43.354 DEBUG:teuthology.orchestra.run.smithi142:> ' 2024-09-13T18:40:43.464 INFO:teuthology.orchestra.run.smithi142.stdout:/var/run/ceph/ceph-client.0.30428.asok 2024-09-13T18:40:43.650 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.30428.asok 2024-09-13T18:40:43.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:43.651 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.30428.asok status 2024-09-13T18:40:43.783 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-09-13T18:40:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": { 2024-09-13T18:40:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:40:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:40:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "entity_id": "0", 2024-09-13T18:40:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "hostname": "smithi142", 2024-09-13T18:40:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:40:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "pid": "30428", 2024-09-13T18:40:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "root": "/" 2024-09-13T18:40:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-13T18:40:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_count": 0, 2024-09-13T18:40:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_pinned_count": 0, 2024-09-13T18:40:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 5016, 2024-09-13T18:40:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "inst": { 2024-09-13T18:40:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "name": { 2024-09-13T18:40:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "client", 2024-09-13T18:40:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "num": 5016 2024-09-13T18:40:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-13T18:40:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2024-09-13T18:40:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2024-09-13T18:40:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:0", 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 2010887954 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:0", 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 2010887954 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "inst_str": "client.5016 172.21.15.142:0/2010887954", 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "addr_str": "172.21.15.142:0/2010887954", 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "inode_count": 1, 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_epoch": 5, 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch": 23, 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:40:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklisted": false, 2024-09-13T18:40:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs" 2024-09-13T18:40:43.786 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-09-13T18:40:43.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:43.792 DEBUG:teuthology.orchestra.run.smithi142:> stat --file-system '--printf=%T 2024-09-13T18:40:43.792 DEBUG:teuthology.orchestra.run.smithi142:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:43.808 INFO:teuthology.orchestra.run.smithi142.stdout:fuseblk 2024-09-13T18:40:43.808 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:43.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:43.808 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:43.872 INFO:teuthology.run_tasks:Running task print... 2024-09-13T18:40:43.881 INFO:teuthology.task.print:**** done remount client.0 2024-09-13T18:40:43.881 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T18:40:43.894 INFO:tasks.workunit:Pulling workunits from ref 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:40:43.895 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T18:40:43.895 INFO:tasks.workunit:timeout=3h 2024-09-13T18:40:43.895 INFO:tasks.workunit:cleanup=True 2024-09-13T18:40:43.895 DEBUG:teuthology.orchestra.run.smithi142:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:43.928 INFO:teuthology.orchestra.run.smithi142.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:43.928 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T18:40:43.928 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-09-13T18:40:43.928 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:40:43.929 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-13T18:40:43.929 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T18:40:43.929 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-13 18:39:14.551633847 +0000 2024-09-13T18:40:43.929 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-13 18:39:28.884678095 +0000 2024-09-13T18:40:43.929 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2024-09-13T18:40:43.929 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:43.929 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T18:40:44.001 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:40:44.060 INFO:tasks.workunit.client.0.smithi142.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T18:41:43.325 INFO:tasks.workunit.client.0.smithi142.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T18:41:43.325 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-09-13T18:41:43.325 INFO:tasks.workunit.client.0.smithi142.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T18:41:43.325 INFO:tasks.workunit.client.0.smithi142.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T18:41:43.325 INFO:tasks.workunit.client.0.smithi142.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T18:41:43.325 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-09-13T18:41:43.325 INFO:tasks.workunit.client.0.smithi142.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T18:41:43.326 INFO:tasks.workunit.client.0.smithi142.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T18:41:43.326 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-09-13T18:41:43.326 INFO:tasks.workunit.client.0.smithi142.stderr: git switch -c 2024-09-13T18:41:43.326 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-09-13T18:41:43.326 INFO:tasks.workunit.client.0.smithi142.stderr:Or undo this operation with: 2024-09-13T18:41:43.326 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-09-13T18:41:43.326 INFO:tasks.workunit.client.0.smithi142.stderr: git switch - 2024-09-13T18:41:43.326 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-09-13T18:41:43.326 INFO:tasks.workunit.client.0.smithi142.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T18:41:43.326 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-09-13T18:41:43.326 INFO:tasks.workunit.client.0.smithi142.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:41:43.330 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T18:41:43.425 INFO:tasks.workunit.client.0.smithi142.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T18:41:43.427 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:41:43.427 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T18:41:44.131 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T18:41:44.200 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T18:41:44.241 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:41:44.242 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:41:44.242 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T18:41:44.282 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:41:44.285 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:41:44.285 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T18:41:44.301 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-09-13T18:41:44.302 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-09-13T18:41:44.302 DEBUG:teuthology.orchestra.run.smithi142:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-09-13T18:41:44.368 INFO:tasks.workunit.client.0.smithi142.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-13T18:41:44.446 INFO:tasks.workunit.client.0.smithi142.stdout: Iozone: Performance Test of File I/O 2024-09-13T18:41:44.446 INFO:tasks.workunit.client.0.smithi142.stdout: Version $Revision: 3.494 $ 2024-09-13T18:41:44.446 INFO:tasks.workunit.client.0.smithi142.stdout: Compiled for 64 bit mode. 2024-09-13T18:41:44.446 INFO:tasks.workunit.client.0.smithi142.stdout: Build: linux-AMD64 2024-09-13T18:41:44.446 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:41:44.447 INFO:tasks.workunit.client.0.smithi142.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-13T18:41:44.447 INFO:tasks.workunit.client.0.smithi142.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-13T18:41:44.447 INFO:tasks.workunit.client.0.smithi142.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-13T18:41:44.447 INFO:tasks.workunit.client.0.smithi142.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-13T18:41:44.447 INFO:tasks.workunit.client.0.smithi142.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-13T18:41:44.447 INFO:tasks.workunit.client.0.smithi142.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-13T18:41:44.447 INFO:tasks.workunit.client.0.smithi142.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-13T18:41:44.447 INFO:tasks.workunit.client.0.smithi142.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-13T18:41:44.447 INFO:tasks.workunit.client.0.smithi142.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-13T18:41:44.447 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:41:44.447 INFO:tasks.workunit.client.0.smithi142.stdout: Run began: Fri Sep 13 18:41:44 2024 2024-09-13T18:41:44.447 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:41:44.447 INFO:tasks.workunit.client.0.smithi142.stdout: Include close in write timing 2024-09-13T18:41:44.448 INFO:tasks.workunit.client.0.smithi142.stdout: Include fsync in write timing 2024-09-13T18:41:44.448 INFO:tasks.workunit.client.0.smithi142.stdout: File size set to 1048576 kB 2024-09-13T18:41:44.448 INFO:tasks.workunit.client.0.smithi142.stdout: Record Size 16 kB 2024-09-13T18:41:44.448 INFO:tasks.workunit.client.0.smithi142.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-13T18:41:44.448 INFO:tasks.workunit.client.0.smithi142.stdout: Output is in kBytes/sec 2024-09-13T18:41:44.448 INFO:tasks.workunit.client.0.smithi142.stdout: Time Resolution = 0.000001 seconds. 2024-09-13T18:41:44.448 INFO:tasks.workunit.client.0.smithi142.stdout: Processor cache size set to 1024 kBytes. 2024-09-13T18:41:44.448 INFO:tasks.workunit.client.0.smithi142.stdout: Processor cache line size set to 32 bytes. 2024-09-13T18:41:44.448 INFO:tasks.workunit.client.0.smithi142.stdout: File stride size set to 17 * record size. 2024-09-13T18:41:44.448 INFO:tasks.workunit.client.0.smithi142.stdout: Throughput test with 1 process 2024-09-13T18:41:44.448 INFO:tasks.workunit.client.0.smithi142.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-09-13T18:41:52.912 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:41:52.913 INFO:tasks.workunit.client.0.smithi142.stdout: Children see throughput for 1 initial writers = 123888.10 kB/sec 2024-09-13T18:41:52.913 INFO:tasks.workunit.client.0.smithi142.stdout: Parent sees throughput for 1 initial writers = 123884.65 kB/sec 2024-09-13T18:41:52.913 INFO:tasks.workunit.client.0.smithi142.stdout: Min throughput per process = 123888.10 kB/sec 2024-09-13T18:41:52.913 INFO:tasks.workunit.client.0.smithi142.stdout: Max throughput per process = 123888.10 kB/sec 2024-09-13T18:41:52.913 INFO:tasks.workunit.client.0.smithi142.stdout: Avg throughput per process = 123888.10 kB/sec 2024-09-13T18:41:52.913 INFO:tasks.workunit.client.0.smithi142.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:42:05.744 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:05.745 INFO:tasks.workunit.client.0.smithi142.stdout: Children see throughput for 1 rewriters = 140047.66 kB/sec 2024-09-13T18:42:05.745 INFO:tasks.workunit.client.0.smithi142.stdout: Parent sees throughput for 1 rewriters = 140043.86 kB/sec 2024-09-13T18:42:05.745 INFO:tasks.workunit.client.0.smithi142.stdout: Min throughput per process = 140047.66 kB/sec 2024-09-13T18:42:05.745 INFO:tasks.workunit.client.0.smithi142.stdout: Max throughput per process = 140047.66 kB/sec 2024-09-13T18:42:05.745 INFO:tasks.workunit.client.0.smithi142.stdout: Avg throughput per process = 140047.66 kB/sec 2024-09-13T18:42:05.745 INFO:tasks.workunit.client.0.smithi142.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:42:09.111 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:09.111 INFO:tasks.workunit.client.0.smithi142.stdout: Children see throughput for 1 readers = 7496246.50 kB/sec 2024-09-13T18:42:09.112 INFO:tasks.workunit.client.0.smithi142.stdout: Parent sees throughput for 1 readers = 7485822.48 kB/sec 2024-09-13T18:42:09.112 INFO:tasks.workunit.client.0.smithi142.stdout: Min throughput per process = 7496246.50 kB/sec 2024-09-13T18:42:09.112 INFO:tasks.workunit.client.0.smithi142.stdout: Max throughput per process = 7496246.50 kB/sec 2024-09-13T18:42:09.112 INFO:tasks.workunit.client.0.smithi142.stdout: Avg throughput per process = 7496246.50 kB/sec 2024-09-13T18:42:09.112 INFO:tasks.workunit.client.0.smithi142.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:42:11.283 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:11.283 INFO:tasks.workunit.client.0.smithi142.stdout: Children see throughput for 1 re-readers = 7217724.00 kB/sec 2024-09-13T18:42:11.283 INFO:tasks.workunit.client.0.smithi142.stdout: Parent sees throughput for 1 re-readers = 7206665.70 kB/sec 2024-09-13T18:42:11.283 INFO:tasks.workunit.client.0.smithi142.stdout: Min throughput per process = 7217724.00 kB/sec 2024-09-13T18:42:11.283 INFO:tasks.workunit.client.0.smithi142.stdout: Max throughput per process = 7217724.00 kB/sec 2024-09-13T18:42:11.283 INFO:tasks.workunit.client.0.smithi142.stdout: Avg throughput per process = 7217724.00 kB/sec 2024-09-13T18:42:11.284 INFO:tasks.workunit.client.0.smithi142.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:42:17.626 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:17.626 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:17.626 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:17.626 INFO:tasks.workunit.client.0.smithi142.stdout:iozone test complete. 2024-09-13T18:42:17.626 INFO:tasks.workunit.client.0.smithi142.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-13T18:42:17.692 INFO:tasks.workunit.client.0.smithi142.stdout: Iozone: Performance Test of File I/O 2024-09-13T18:42:17.692 INFO:tasks.workunit.client.0.smithi142.stdout: Version $Revision: 3.494 $ 2024-09-13T18:42:17.692 INFO:tasks.workunit.client.0.smithi142.stdout: Compiled for 64 bit mode. 2024-09-13T18:42:17.692 INFO:tasks.workunit.client.0.smithi142.stdout: Build: linux-AMD64 2024-09-13T18:42:17.692 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: Run began: Fri Sep 13 18:42:17 2024 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: Include close in write timing 2024-09-13T18:42:17.693 INFO:tasks.workunit.client.0.smithi142.stdout: Include fsync in write timing 2024-09-13T18:42:17.694 INFO:tasks.workunit.client.0.smithi142.stdout: File size set to 1048576 kB 2024-09-13T18:42:17.694 INFO:tasks.workunit.client.0.smithi142.stdout: Record Size 1024 kB 2024-09-13T18:42:17.694 INFO:tasks.workunit.client.0.smithi142.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-13T18:42:17.694 INFO:tasks.workunit.client.0.smithi142.stdout: Output is in kBytes/sec 2024-09-13T18:42:17.694 INFO:tasks.workunit.client.0.smithi142.stdout: Time Resolution = 0.000001 seconds. 2024-09-13T18:42:17.694 INFO:tasks.workunit.client.0.smithi142.stdout: Processor cache size set to 1024 kBytes. 2024-09-13T18:42:17.694 INFO:tasks.workunit.client.0.smithi142.stdout: Processor cache line size set to 32 bytes. 2024-09-13T18:42:17.694 INFO:tasks.workunit.client.0.smithi142.stdout: File stride size set to 17 * record size. 2024-09-13T18:42:17.694 INFO:tasks.workunit.client.0.smithi142.stdout: Throughput test with 1 process 2024-09-13T18:42:17.694 INFO:tasks.workunit.client.0.smithi142.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-09-13T18:42:19.789 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:19.789 INFO:tasks.workunit.client.0.smithi142.stdout: Children see throughput for 1 initial writers = 507791.59 kB/sec 2024-09-13T18:42:19.789 INFO:tasks.workunit.client.0.smithi142.stdout: Parent sees throughput for 1 initial writers = 507738.50 kB/sec 2024-09-13T18:42:19.790 INFO:tasks.workunit.client.0.smithi142.stdout: Min throughput per process = 507791.59 kB/sec 2024-09-13T18:42:19.790 INFO:tasks.workunit.client.0.smithi142.stdout: Max throughput per process = 507791.59 kB/sec 2024-09-13T18:42:19.790 INFO:tasks.workunit.client.0.smithi142.stdout: Avg throughput per process = 507791.59 kB/sec 2024-09-13T18:42:19.790 INFO:tasks.workunit.client.0.smithi142.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:42:24.167 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:24.168 INFO:tasks.workunit.client.0.smithi142.stdout: Children see throughput for 1 rewriters = 514323.00 kB/sec 2024-09-13T18:42:24.168 INFO:tasks.workunit.client.0.smithi142.stdout: Parent sees throughput for 1 rewriters = 514263.66 kB/sec 2024-09-13T18:42:24.168 INFO:tasks.workunit.client.0.smithi142.stdout: Min throughput per process = 514323.00 kB/sec 2024-09-13T18:42:24.168 INFO:tasks.workunit.client.0.smithi142.stdout: Max throughput per process = 514323.00 kB/sec 2024-09-13T18:42:24.168 INFO:tasks.workunit.client.0.smithi142.stdout: Avg throughput per process = 514323.00 kB/sec 2024-09-13T18:42:24.168 INFO:tasks.workunit.client.0.smithi142.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:42:26.608 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:26.608 INFO:tasks.workunit.client.0.smithi142.stdout: Children see throughput for 1 readers = 7161871.50 kB/sec 2024-09-13T18:42:26.608 INFO:tasks.workunit.client.0.smithi142.stdout: Parent sees throughput for 1 readers = 7151506.71 kB/sec 2024-09-13T18:42:26.608 INFO:tasks.workunit.client.0.smithi142.stdout: Min throughput per process = 7161871.50 kB/sec 2024-09-13T18:42:26.608 INFO:tasks.workunit.client.0.smithi142.stdout: Max throughput per process = 7161871.50 kB/sec 2024-09-13T18:42:26.608 INFO:tasks.workunit.client.0.smithi142.stdout: Avg throughput per process = 7161871.50 kB/sec 2024-09-13T18:42:26.608 INFO:tasks.workunit.client.0.smithi142.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:42:28.781 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:28.781 INFO:tasks.workunit.client.0.smithi142.stdout: Children see throughput for 1 re-readers = 7252370.50 kB/sec 2024-09-13T18:42:28.781 INFO:tasks.workunit.client.0.smithi142.stdout: Parent sees throughput for 1 re-readers = 7240502.78 kB/sec 2024-09-13T18:42:28.781 INFO:tasks.workunit.client.0.smithi142.stdout: Min throughput per process = 7252370.50 kB/sec 2024-09-13T18:42:28.781 INFO:tasks.workunit.client.0.smithi142.stdout: Max throughput per process = 7252370.50 kB/sec 2024-09-13T18:42:28.781 INFO:tasks.workunit.client.0.smithi142.stdout: Avg throughput per process = 7252370.50 kB/sec 2024-09-13T18:42:28.781 INFO:tasks.workunit.client.0.smithi142.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:42:35.059 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:35.059 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:35.059 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:35.059 INFO:tasks.workunit.client.0.smithi142.stdout:iozone test complete. 2024-09-13T18:42:35.060 INFO:tasks.workunit.client.0.smithi142.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-13T18:42:35.125 INFO:tasks.workunit.client.0.smithi142.stdout: Iozone: Performance Test of File I/O 2024-09-13T18:42:35.125 INFO:tasks.workunit.client.0.smithi142.stdout: Version $Revision: 3.494 $ 2024-09-13T18:42:35.125 INFO:tasks.workunit.client.0.smithi142.stdout: Compiled for 64 bit mode. 2024-09-13T18:42:35.125 INFO:tasks.workunit.client.0.smithi142.stdout: Build: linux-AMD64 2024-09-13T18:42:35.125 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:35.125 INFO:tasks.workunit.client.0.smithi142.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-13T18:42:35.125 INFO:tasks.workunit.client.0.smithi142.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-13T18:42:35.125 INFO:tasks.workunit.client.0.smithi142.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-13T18:42:35.125 INFO:tasks.workunit.client.0.smithi142.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-13T18:42:35.125 INFO:tasks.workunit.client.0.smithi142.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-13T18:42:35.125 INFO:tasks.workunit.client.0.smithi142.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-13T18:42:35.125 INFO:tasks.workunit.client.0.smithi142.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: Run began: Fri Sep 13 18:42:35 2024 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: Include close in write timing 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: Include fsync in write timing 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: File size set to 10485760 kB 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: Record Size 1024 kB 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: Output is in kBytes/sec 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: Time Resolution = 0.000001 seconds. 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: Processor cache size set to 1024 kBytes. 2024-09-13T18:42:35.126 INFO:tasks.workunit.client.0.smithi142.stdout: Processor cache line size set to 32 bytes. 2024-09-13T18:42:35.127 INFO:tasks.workunit.client.0.smithi142.stdout: File stride size set to 17 * record size. 2024-09-13T18:42:35.127 INFO:tasks.workunit.client.0.smithi142.stdout: Throughput test with 1 process 2024-09-13T18:42:35.127 INFO:tasks.workunit.client.0.smithi142.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-09-13T18:42:55.529 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:42:55.529 INFO:tasks.workunit.client.0.smithi142.stdout: Children see throughput for 1 initial writers = 514690.38 kB/sec 2024-09-13T18:42:55.529 INFO:tasks.workunit.client.0.smithi142.stdout: Parent sees throughput for 1 initial writers = 514685.01 kB/sec 2024-09-13T18:42:55.529 INFO:tasks.workunit.client.0.smithi142.stdout: Min throughput per process = 514690.38 kB/sec 2024-09-13T18:42:55.529 INFO:tasks.workunit.client.0.smithi142.stdout: Max throughput per process = 514690.38 kB/sec 2024-09-13T18:42:55.529 INFO:tasks.workunit.client.0.smithi142.stdout: Avg throughput per process = 514690.38 kB/sec 2024-09-13T18:42:55.530 INFO:tasks.workunit.client.0.smithi142.stdout: Min xfer = 10485760.00 kB 2024-09-13T18:43:18.982 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:43:18.982 INFO:tasks.workunit.client.0.smithi142.stdout: Children see throughput for 1 rewriters = 528043.56 kB/sec 2024-09-13T18:43:18.982 INFO:tasks.workunit.client.0.smithi142.stdout: Parent sees throughput for 1 rewriters = 528037.15 kB/sec 2024-09-13T18:43:18.982 INFO:tasks.workunit.client.0.smithi142.stdout: Min throughput per process = 528043.56 kB/sec 2024-09-13T18:43:18.982 INFO:tasks.workunit.client.0.smithi142.stdout: Max throughput per process = 528043.56 kB/sec 2024-09-13T18:43:18.982 INFO:tasks.workunit.client.0.smithi142.stdout: Avg throughput per process = 528043.56 kB/sec 2024-09-13T18:43:18.982 INFO:tasks.workunit.client.0.smithi142.stdout: Min xfer = 10485760.00 kB 2024-09-13T18:43:23.674 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:43:23.674 INFO:tasks.workunit.client.0.smithi142.stdout: Children see throughput for 1 readers = 7885796.00 kB/sec 2024-09-13T18:43:23.674 INFO:tasks.workunit.client.0.smithi142.stdout: Parent sees throughput for 1 readers = 7884409.59 kB/sec 2024-09-13T18:43:23.674 INFO:tasks.workunit.client.0.smithi142.stdout: Min throughput per process = 7885796.00 kB/sec 2024-09-13T18:43:23.674 INFO:tasks.workunit.client.0.smithi142.stdout: Max throughput per process = 7885796.00 kB/sec 2024-09-13T18:43:23.674 INFO:tasks.workunit.client.0.smithi142.stdout: Avg throughput per process = 7885796.00 kB/sec 2024-09-13T18:43:23.675 INFO:tasks.workunit.client.0.smithi142.stdout: Min xfer = 10485760.00 kB 2024-09-13T18:43:27.113 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:43:27.113 INFO:tasks.workunit.client.0.smithi142.stdout: Children see throughput for 1 re-readers = 7888983.00 kB/sec 2024-09-13T18:43:27.113 INFO:tasks.workunit.client.0.smithi142.stdout: Parent sees throughput for 1 re-readers = 7887185.15 kB/sec 2024-09-13T18:43:27.113 INFO:tasks.workunit.client.0.smithi142.stdout: Min throughput per process = 7888983.00 kB/sec 2024-09-13T18:43:27.113 INFO:tasks.workunit.client.0.smithi142.stdout: Max throughput per process = 7888983.00 kB/sec 2024-09-13T18:43:27.113 INFO:tasks.workunit.client.0.smithi142.stdout: Avg throughput per process = 7888983.00 kB/sec 2024-09-13T18:43:27.113 INFO:tasks.workunit.client.0.smithi142.stdout: Min xfer = 10485760.00 kB 2024-09-13T18:43:33.951 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:43:33.951 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:43:33.951 INFO:tasks.workunit.client.0.smithi142.stdout: 2024-09-13T18:43:33.951 INFO:tasks.workunit.client.0.smithi142.stdout:iozone test complete. 2024-09-13T18:43:33.953 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T18:43:33.953 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T18:43:34.033 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-09-13T18:43:34.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T18:43:34.350 DEBUG:teuthology.parallel:result is None 2024-09-13T18:43:34.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:43:34.383 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:43:34.383 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T18:43:34.394 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T18:43:34.395 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:43:34.395 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:34.441 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:43:34.441 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:34.497 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:43:34.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.600+0000 7f48adb54640 1 Processor -- start 2024-09-13T18:43:34.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.600+0000 7f48adb54640 1 -- start start 2024-09-13T18:43:34.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48adb54640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a809dfb0 0x7f48a8096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:34.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48adb54640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f48a80969d0 0x7f48a80974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:34.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48adb54640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a806a190 con 0x7f48a812bf70 2024-09-13T18:43:34.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48adb54640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a809e380 con 0x7f48a80969d0 2024-09-13T18:43:34.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48adb54640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a8098870 con 0x7f48a809dfb0 2024-09-13T18:43:34.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48a77fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a809dfb0 0x7f48a8096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:34.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48a6ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f48a80969d0 0x7f48a80974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:34.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48a77fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a809dfb0 0x7f48a8096f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:40018/0 (socket says 172.21.15.97:40018) 2024-09-13T18:43:34.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48a77fe640 1 -- 172.21.15.97:0/1791100642 learned_addr learned my addr 172.21.15.97:0/1791100642 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:34.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48a6ffd640 1 --2- 172.21.15.97:0/1791100642 >> v2:172.21.15.97:3300/0 conn(0x7f48a80969d0 0x7f48a80974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58302/0 (socket says 172.21.15.97:58302) 2024-09-13T18:43:34.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48a7fff640 1 --1- 172.21.15.97:0/1791100642 >> v1:172.21.15.97:6789/0 conn(0x7f48a812bf70 0x7f48a812c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56434/0 (socket says 172.21.15.97:56434) 2024-09-13T18:43:34.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48a6ffd640 1 -- 172.21.15.97:0/1791100642 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a809dfb0 msgr2=0x7f48a8096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:34.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48a6ffd640 1 --2- 172.21.15.97:0/1791100642 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a809dfb0 0x7f48a8096f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48a6ffd640 1 -- 172.21.15.97:0/1791100642 >> v1:172.21.15.97:6789/0 conn(0x7f48a812bf70 legacy=0x7f48a812c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:34.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48a6ffd640 1 -- 172.21.15.97:0/1791100642 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a8098e10 con 0x7f48a80969d0 2024-09-13T18:43:34.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48a67fc640 1 -- 172.21.15.97:0/1791100642 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475376684 0 0) 0x7f48a806a190 con 0x7f48a812bf70 2024-09-13T18:43:34.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.601+0000 7f48a77fe640 1 --2- 172.21.15.97:0/1791100642 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a809dfb0 0x7f48a8096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:34.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.602+0000 7f48a6ffd640 1 --2- 172.21.15.97:0/1791100642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a80969d0 0x7f48a80974c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f489c009880 tx=0x7f489c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9890ba6ea93f1920 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.602+0000 7f48a67fc640 1 -- 172.21.15.97:0/1791100642 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c02ace0 con 0x7f48a80969d0 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.602+0000 7f48a67fc640 1 -- 172.21.15.97:0/1791100642 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c02ae40 con 0x7f48a80969d0 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.602+0000 7f48a67fc640 1 -- 172.21.15.97:0/1791100642 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c032670 con 0x7f48a80969d0 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.603+0000 7f48adb54640 1 -- 172.21.15.97:0/1791100642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a80969d0 msgr2=0x7f48a80974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.603+0000 7f48adb54640 1 --2- 172.21.15.97:0/1791100642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a80969d0 0x7f48a80974c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f489c009880 tx=0x7f489c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.603+0000 7f48adb54640 1 -- 172.21.15.97:0/1791100642 shutdown_connections 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.603+0000 7f48adb54640 1 --2- 172.21.15.97:0/1791100642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a80969d0 0x7f48a80974c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.603+0000 7f48adb54640 1 --2- 172.21.15.97:0/1791100642 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a809dfb0 0x7f48a8096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.603+0000 7f48adb54640 1 -- 172.21.15.97:0/1791100642 >> 172.21.15.97:0/1791100642 conn(0x7f48a809b200 msgr2=0x7f48a809b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.603+0000 7f48adb54640 1 -- 172.21.15.97:0/1791100642 shutdown_connections 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.603+0000 7f48adb54640 1 -- 172.21.15.97:0/1791100642 wait complete. 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48adb54640 1 Processor -- start 2024-09-13T18:43:34.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48adb54640 1 -- start start 2024-09-13T18:43:34.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48adb54640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a80969d0 0x7f48a813a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:34.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48adb54640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f48a809dfb0 0x7f48a813abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:34.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48adb54640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a812bf70 0x7f48a8117180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:34.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48adb54640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a8119730 con 0x7f48a80969d0 2024-09-13T18:43:34.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48adb54640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a8097e10 con 0x7f48a812bf70 2024-09-13T18:43:34.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48adb54640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48a811a600 con 0x7f48a809dfb0 2024-09-13T18:43:34.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48a77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a80969d0 0x7f48a813a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:34.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48a77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a80969d0 0x7f48a813a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58312/0 (socket says 172.21.15.97:58312) 2024-09-13T18:43:34.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48a7fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a812bf70 0x7f48a8117180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:34.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48a77fe640 1 -- 172.21.15.97:0/747455379 learned_addr learned my addr 172.21.15.97:0/747455379 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:34.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48a6ffd640 1 --2- 172.21.15.97:0/747455379 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f48a809dfb0 0x7f48a813abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:34.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48a77fe640 1 -- 172.21.15.97:0/747455379 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f48a809dfb0 msgr2=0x7f48a813abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:34.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48a77fe640 1 --2- 172.21.15.97:0/747455379 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f48a809dfb0 0x7f48a813abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48a77fe640 1 -- 172.21.15.97:0/747455379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a812bf70 msgr2=0x7f48a8117180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:34.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48a77fe640 1 --2- 172.21.15.97:0/747455379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a812bf70 0x7f48a8117180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48a77fe640 1 -- 172.21.15.97:0/747455379 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489800b700 con 0x7f48a80969d0 2024-09-13T18:43:34.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.604+0000 7f48a7fff640 1 --2- 172.21.15.97:0/747455379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a812bf70 0x7f48a8117180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:34.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.605+0000 7f48a77fe640 1 --2- 172.21.15.97:0/747455379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a80969d0 0x7f48a813a6a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f489800e3e0 tx=0x7f489800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:34.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.605+0000 7f488f7fe640 1 -- 172.21.15.97:0/747455379 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898011660 con 0x7f48a80969d0 2024-09-13T18:43:34.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.605+0000 7f488f7fe640 1 -- 172.21.15.97:0/747455379 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48980117c0 con 0x7f48a80969d0 2024-09-13T18:43:34.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.605+0000 7f48adb54640 1 -- 172.21.15.97:0/747455379 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c009390 con 0x7f48a80969d0 2024-09-13T18:43:34.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.605+0000 7f488f7fe640 1 -- 172.21.15.97:0/747455379 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898011b40 con 0x7f48a80969d0 2024-09-13T18:43:34.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.605+0000 7f48adb54640 1 -- 172.21.15.97:0/747455379 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a812f3f0 con 0x7f48a80969d0 2024-09-13T18:43:34.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.606+0000 7f488f7fe640 1 -- 172.21.15.97:0/747455379 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f4898019440 con 0x7f48a80969d0 2024-09-13T18:43:34.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.606+0000 7f488f7fe640 1 -- 172.21.15.97:0/747455379 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f4898044f60 con 0x7f48a80969d0 2024-09-13T18:43:34.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.606+0000 7f48adb54640 1 -- 172.21.15.97:0/747455379 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a811a820 con 0x7f48a80969d0 2024-09-13T18:43:34.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.610+0000 7f488f7fe640 1 -- 172.21.15.97:0/747455379 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f489801e070 con 0x7f48a80969d0 2024-09-13T18:43:34.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.765+0000 7f48adb54640 1 -- 172.21.15.97:0/747455379 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48a811aae0 con 0x7f48a80969d0 2024-09-13T18:43:34.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.765+0000 7f488f7fe640 1 -- 172.21.15.97:0/747455379 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+11626 (secure 0 0 0) 0x7f489801e020 con 0x7f48a80969d0 2024-09-13T18:43:34.779 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:43:34.779 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":23,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:54.652125+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.8","mappings":[{"from":1,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:43:34.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.767+0000 7f48adb54640 1 -- 172.21.15.97:0/747455379 >> v1:172.21.15.97:6816/34603 conn(0x7f4894031190 legacy=0x7f4894033640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:34.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.767+0000 7f48adb54640 1 -- 172.21.15.97:0/747455379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a80969d0 msgr2=0x7f48a813a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:34.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.767+0000 7f48adb54640 1 --2- 172.21.15.97:0/747455379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a80969d0 0x7f48a813a6a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f489800e3e0 tx=0x7f489800b460 comp rx=0 tx=0).stop 2024-09-13T18:43:34.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.767+0000 7f48adb54640 1 -- 172.21.15.97:0/747455379 shutdown_connections 2024-09-13T18:43:34.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.767+0000 7f48adb54640 1 --2- 172.21.15.97:0/747455379 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f48a812bf70 0x7f48a8117180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.767+0000 7f48adb54640 1 --2- 172.21.15.97:0/747455379 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f48a809dfb0 0x7f48a813abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.767+0000 7f48adb54640 1 --2- 172.21.15.97:0/747455379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48a80969d0 0x7f48a813a6a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.767+0000 7f48adb54640 1 -- 172.21.15.97:0/747455379 >> 172.21.15.97:0/747455379 conn(0x7f48a809b200 msgr2=0x7f48a809cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:34.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.768+0000 7f48adb54640 1 -- 172.21.15.97:0/747455379 shutdown_connections 2024-09-13T18:43:34.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.768+0000 7f48adb54640 1 -- 172.21.15.97:0/747455379 wait complete. 2024-09-13T18:43:34.785 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:39:01.375967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T18:39:05.732412+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:39:12.014248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:39:12.844264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:43:34.785 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:43:34.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.879+0000 7fe48ac6f640 1 Processor -- start 2024-09-13T18:43:34.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.879+0000 7fe48ac6f640 1 -- start start 2024-09-13T18:43:34.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe48ac6f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4840688c0 0x7fe48409d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:34.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe48ac6f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe484134740 0x7fe484136b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:34.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe48ac6f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4840975a0 con 0x7fe48409d2c0 2024-09-13T18:43:34.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe48ac6f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe484068c90 con 0x7fe4840688c0 2024-09-13T18:43:34.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe48ac6f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe48409e410 con 0x7fe484134740 2024-09-13T18:43:34.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe488a0b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4840688c0 0x7fe48409d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:34.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe47bfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe48409d2c0 0x7fe48409dd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56436/0 (socket says 172.21.15.97:56436) 2024-09-13T18:43:34.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe48920c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe484134740 0x7fe484136b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:34.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe47bfff640 1 -- 172.21.15.97:0/3861040384 learned_addr learned my addr 172.21.15.97:0/3861040384 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:43:34.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe488a0b640 1 -- 172.21.15.97:0/3861040384 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe484134740 msgr2=0x7fe484136b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:34.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe47b7fe640 1 -- 172.21.15.97:0/3861040384 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416626616 0 0) 0x7fe4840975a0 con 0x7fe48409d2c0 2024-09-13T18:43:34.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe488a0b640 1 --2- 172.21.15.97:0/3861040384 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe484134740 0x7fe484136b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe488a0b640 1 -- 172.21.15.97:0/3861040384 >> v1:172.21.15.97:6789/0 conn(0x7fe48409d2c0 legacy=0x7fe48409dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:34.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe488a0b640 1 -- 172.21.15.97:0/3861040384 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484069200 con 0x7fe4840688c0 2024-09-13T18:43:34.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.880+0000 7fe48920c640 1 --2- 172.21.15.97:0/3861040384 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe484134740 0x7fe484136b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:34.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.881+0000 7fe488a0b640 1 --2- 172.21.15.97:0/3861040384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4840688c0 0x7fe48409d7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4800098b0 tx=0x7fe4800090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40850c9b3bea3e95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:34.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.881+0000 7fe47b7fe640 1 -- 172.21.15.97:0/3861040384 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48002ac40 con 0x7fe4840688c0 2024-09-13T18:43:34.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.881+0000 7fe47b7fe640 1 -- 172.21.15.97:0/3861040384 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48002ada0 con 0x7fe4840688c0 2024-09-13T18:43:34.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.881+0000 7fe47b7fe640 1 -- 172.21.15.97:0/3861040384 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480032670 con 0x7fe4840688c0 2024-09-13T18:43:34.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.882+0000 7fe48ac6f640 1 -- 172.21.15.97:0/3861040384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4840688c0 msgr2=0x7fe48409d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:34.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.882+0000 7fe48ac6f640 1 --2- 172.21.15.97:0/3861040384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4840688c0 0x7fe48409d7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4800098b0 tx=0x7fe4800090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.882+0000 7fe48ac6f640 1 -- 172.21.15.97:0/3861040384 shutdown_connections 2024-09-13T18:43:34.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.882+0000 7fe48ac6f640 1 --2- 172.21.15.97:0/3861040384 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe484134740 0x7fe484136b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.882+0000 7fe48ac6f640 1 --2- 172.21.15.97:0/3861040384 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe4840688c0 0x7fe48409d7c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.882+0000 7fe48ac6f640 1 -- 172.21.15.97:0/3861040384 >> 172.21.15.97:0/3861040384 conn(0x7fe48406f310 msgr2=0x7fe4840a29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:34.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.882+0000 7fe48ac6f640 1 -- 172.21.15.97:0/3861040384 shutdown_connections 2024-09-13T18:43:34.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.882+0000 7fe48ac6f640 1 -- 172.21.15.97:0/3861040384 wait complete. 2024-09-13T18:43:34.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.883+0000 7fe48ac6f640 1 Processor -- start 2024-09-13T18:43:34.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.883+0000 7fe48ac6f640 1 -- start start 2024-09-13T18:43:34.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.883+0000 7fe48ac6f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe4840688c0 0x7fe48412fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:34.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.883+0000 7fe48ac6f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe48409d2c0 0x7fe484119030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:34.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.883+0000 7fe48ac6f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe484134740 0x7fe484119570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:34.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.883+0000 7fe48ac6f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48411b720 con 0x7fe484134740 2024-09-13T18:43:34.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.883+0000 7fe48ac6f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe484134b10 con 0x7fe48409d2c0 2024-09-13T18:43:34.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.883+0000 7fe48ac6f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe48411b3d0 con 0x7fe4840688c0 2024-09-13T18:43:34.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.883+0000 7fe488a0b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe4840688c0 0x7fe48412fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:34.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.883+0000 7fe488a0b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe4840688c0 0x7fe48412fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:38592/0 (socket says 172.21.15.97:38592) 2024-09-13T18:43:34.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.883+0000 7fe47bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe48409d2c0 0x7fe484119030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:34.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.883+0000 7fe488a0b640 1 -- 172.21.15.97:0/152723801 learned_addr learned my addr 172.21.15.97:0/152723801 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:34.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.883+0000 7fe48920c640 1 --2- 172.21.15.97:0/152723801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe484134740 0x7fe484119570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:34.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.884+0000 7fe488a0b640 1 -- 172.21.15.97:0/152723801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe48409d2c0 msgr2=0x7fe484119030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:34.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.884+0000 7fe488a0b640 1 --2- 172.21.15.97:0/152723801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe48409d2c0 0x7fe484119030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.884+0000 7fe488a0b640 1 -- 172.21.15.97:0/152723801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe484134740 msgr2=0x7fe484119570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:34.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.884+0000 7fe488a0b640 1 --2- 172.21.15.97:0/152723801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe484134740 0x7fe484119570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:34.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.884+0000 7fe488a0b640 1 -- 172.21.15.97:0/152723801 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c009a20 con 0x7fe4840688c0 2024-09-13T18:43:34.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.884+0000 7fe47bfff640 1 --2- 172.21.15.97:0/152723801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe48409d2c0 0x7fe484119030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:34.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.884+0000 7fe48920c640 1 --2- 172.21.15.97:0/152723801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe484134740 0x7fe484119570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:34.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.884+0000 7fe488a0b640 1 --2- 172.21.15.97:0/152723801 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe4840688c0 0x7fe48412fc60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe48002a5b0 tx=0x7fe480032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:34.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.884+0000 7fe478ff9640 1 -- 172.21.15.97:0/152723801 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48003d700 con 0x7fe4840688c0 2024-09-13T18:43:34.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.884+0000 7fe478ff9640 1 -- 172.21.15.97:0/152723801 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48003d860 con 0x7fe4840688c0 2024-09-13T18:43:34.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.884+0000 7fe478ff9640 1 -- 172.21.15.97:0/152723801 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48003dc00 con 0x7fe4840688c0 2024-09-13T18:43:34.893 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.884+0000 7fe48ac6f640 1 -- 172.21.15.97:0/152723801 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe480009390 con 0x7fe4840688c0 2024-09-13T18:43:34.893 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.884+0000 7fe48ac6f640 1 -- 172.21.15.97:0/152723801 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4841301a0 con 0x7fe4840688c0 2024-09-13T18:43:34.893 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.885+0000 7fe478ff9640 1 -- 172.21.15.97:0/152723801 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fe480039040 con 0x7fe4840688c0 2024-09-13T18:43:34.893 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.885+0000 7fe478ff9640 1 -- 172.21.15.97:0/152723801 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fe480061910 con 0x7fe4840688c0 2024-09-13T18:43:34.893 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.885+0000 7fe48ac6f640 1 -- 172.21.15.97:0/152723801 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4840714b0 con 0x7fe4840688c0 2024-09-13T18:43:34.893 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:34.889+0000 7fe478ff9640 1 -- 172.21.15.97:0/152723801 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fe480037070 con 0x7fe4840688c0 2024-09-13T18:43:35.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.040+0000 7fe48ac6f640 1 -- 172.21.15.97:0/152723801 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe48405e0d0 con 0x7fe4840688c0 2024-09-13T18:43:35.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.040+0000 7fe478ff9640 1 -- 172.21.15.97:0/152723801 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe480042030 con 0x7fe4840688c0 2024-09-13T18:43:35.044 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2024-09-13T18:43:35.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.042+0000 7fe48ac6f640 1 -- 172.21.15.97:0/152723801 >> v1:172.21.15.97:6816/34603 conn(0x7fe470031160 legacy=0x7fe470033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.042+0000 7fe48ac6f640 1 -- 172.21.15.97:0/152723801 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe4840688c0 msgr2=0x7fe48412fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.042+0000 7fe48ac6f640 1 --2- 172.21.15.97:0/152723801 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe4840688c0 0x7fe48412fc60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe48002a5b0 tx=0x7fe480032000 comp rx=0 tx=0).stop 2024-09-13T18:43:35.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.042+0000 7fe48ac6f640 1 -- 172.21.15.97:0/152723801 shutdown_connections 2024-09-13T18:43:35.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.042+0000 7fe48ac6f640 1 --2- 172.21.15.97:0/152723801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe484134740 0x7fe484119570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.042+0000 7fe48ac6f640 1 --2- 172.21.15.97:0/152723801 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe48409d2c0 0x7fe484119030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.042+0000 7fe48ac6f640 1 --2- 172.21.15.97:0/152723801 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe4840688c0 0x7fe48412fc60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.042+0000 7fe48ac6f640 1 -- 172.21.15.97:0/152723801 >> 172.21.15.97:0/152723801 conn(0x7fe48406f310 msgr2=0x7fe484133e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:35.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.042+0000 7fe48ac6f640 1 -- 172.21.15.97:0/152723801 shutdown_connections 2024-09-13T18:43:35.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.042+0000 7fe48ac6f640 1 -- 172.21.15.97:0/152723801 wait complete. 2024-09-13T18:43:35.055 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-13T18:43:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.148+0000 7fdacf06f640 1 Processor -- start 2024-09-13T18:43:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.148+0000 7fdacf06f640 1 -- start start 2024-09-13T18:43:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdacf06f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdac80688c0 0x7fdac809d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdacf06f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdac809d2c0 0x7fdac809dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdacf06f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac80975a0 con 0x7fdac812f410 2024-09-13T18:43:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdacf06f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac8068c90 con 0x7fdac80688c0 2024-09-13T18:43:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdacf06f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdac809ceb0 con 0x7fdac809d2c0 2024-09-13T18:43:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdacce0b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdac80688c0 0x7fdac809d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdac7fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdac809d2c0 0x7fdac809dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdacd60c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdac812f410 0x7fdac812f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56452/0 (socket says 172.21.15.97:56452) 2024-09-13T18:43:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdacd60c640 1 -- 172.21.15.97:0/1352183308 learned_addr learned my addr 172.21.15.97:0/1352183308 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:43:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdac77fe640 1 -- 172.21.15.97:0/1352183308 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154665540 0 0) 0x7fdac80975a0 con 0x7fdac812f410 2024-09-13T18:43:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdacce0b640 1 -- 172.21.15.97:0/1352183308 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdac809d2c0 msgr2=0x7fdac809dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdacce0b640 1 --2- 172.21.15.97:0/1352183308 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdac809d2c0 0x7fdac809dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdacce0b640 1 -- 172.21.15.97:0/1352183308 >> v1:172.21.15.97:6789/0 conn(0x7fdac812f410 legacy=0x7fdac812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdacce0b640 1 -- 172.21.15.97:0/1352183308 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac8069200 con 0x7fdac80688c0 2024-09-13T18:43:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.149+0000 7fdac7fff640 1 --2- 172.21.15.97:0/1352183308 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdac809d2c0 0x7fdac809dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.150+0000 7fdacce0b640 1 --2- 172.21.15.97:0/1352183308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdac80688c0 0x7fdac809d7c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009880 tx=0x7fdabc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac54a0fa9ed975de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.150+0000 7fdac77fe640 1 -- 172.21.15.97:0/1352183308 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc02ac60 con 0x7fdac80688c0 2024-09-13T18:43:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.150+0000 7fdac77fe640 1 -- 172.21.15.97:0/1352183308 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc02adc0 con 0x7fdac80688c0 2024-09-13T18:43:35.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.150+0000 7fdac77fe640 1 -- 172.21.15.97:0/1352183308 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc032670 con 0x7fdac80688c0 2024-09-13T18:43:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.151+0000 7fdacf06f640 1 -- 172.21.15.97:0/1352183308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdac80688c0 msgr2=0x7fdac809d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.151+0000 7fdacf06f640 1 --2- 172.21.15.97:0/1352183308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdac80688c0 0x7fdac809d7c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009880 tx=0x7fdabc0090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.151+0000 7fdacf06f640 1 -- 172.21.15.97:0/1352183308 shutdown_connections 2024-09-13T18:43:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.151+0000 7fdacf06f640 1 --2- 172.21.15.97:0/1352183308 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdac809d2c0 0x7fdac809dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.151+0000 7fdacf06f640 1 --2- 172.21.15.97:0/1352183308 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdac80688c0 0x7fdac809d7c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.151+0000 7fdacf06f640 1 -- 172.21.15.97:0/1352183308 >> 172.21.15.97:0/1352183308 conn(0x7fdac806f310 msgr2=0x7fdac80a29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.151+0000 7fdacf06f640 1 -- 172.21.15.97:0/1352183308 shutdown_connections 2024-09-13T18:43:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.151+0000 7fdacf06f640 1 -- 172.21.15.97:0/1352183308 wait complete. 2024-09-13T18:43:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.151+0000 7fdacf06f640 1 Processor -- start 2024-09-13T18:43:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacf06f640 1 -- start start 2024-09-13T18:43:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacf06f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdac80688c0 0x7fdac811e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacf06f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdac809d2c0 0x7fdac811ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacf06f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdac812f410 0x7fdac811b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacf06f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80a2160 con 0x7fdac80688c0 2024-09-13T18:43:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacf06f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac811da80 con 0x7fdac809d2c0 2024-09-13T18:43:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacf06f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdac811c110 con 0x7fdac812f410 2024-09-13T18:43:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdac7fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdac809d2c0 0x7fdac811ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacd60c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdac812f410 0x7fdac811b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacce0b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdac80688c0 0x7fdac811e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdac7fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdac809d2c0 0x7fdac811ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:40066/0 (socket says 172.21.15.97:40066) 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdac7fff640 1 -- 172.21.15.97:0/3954096976 learned_addr learned my addr 172.21.15.97:0/3954096976 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacd60c640 1 -- 172.21.15.97:0/3954096976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdac809d2c0 msgr2=0x7fdac811ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacd60c640 1 --2- 172.21.15.97:0/3954096976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdac809d2c0 0x7fdac811ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacd60c640 1 -- 172.21.15.97:0/3954096976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdac80688c0 msgr2=0x7fdac811e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacd60c640 1 --2- 172.21.15.97:0/3954096976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdac80688c0 0x7fdac811e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacd60c640 1 -- 172.21.15.97:0/3954096976 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab4009390 con 0x7fdac812f410 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.152+0000 7fdacce0b640 1 --2- 172.21.15.97:0/3954096976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdac80688c0 0x7fdac811e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.153+0000 7fdacd60c640 1 --2- 172.21.15.97:0/3954096976 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdac812f410 0x7fdac811b3a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdac000cbe0 tx=0x7fdac00019a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.153+0000 7fdac4ff9640 1 -- 172.21.15.97:0/3954096976 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac000ce00 con 0x7fdac812f410 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.153+0000 7fdac4ff9640 1 -- 172.21.15.97:0/3954096976 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac000a850 con 0x7fdac812f410 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.153+0000 7fdacf06f640 1 -- 172.21.15.97:0/3954096976 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc009390 con 0x7fdac812f410 2024-09-13T18:43:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.153+0000 7fdac4ff9640 1 -- 172.21.15.97:0/3954096976 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac000ac90 con 0x7fdac812f410 2024-09-13T18:43:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.153+0000 7fdacf06f640 1 -- 172.21.15.97:0/3954096976 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac811b8e0 con 0x7fdac812f410 2024-09-13T18:43:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.153+0000 7fdac4ff9640 1 -- 172.21.15.97:0/3954096976 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fdac0007300 con 0x7fdac812f410 2024-09-13T18:43:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.154+0000 7fdac4ff9640 1 -- 172.21.15.97:0/3954096976 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fdac0042150 con 0x7fdac812f410 2024-09-13T18:43:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.154+0000 7fdacf06f640 1 -- 172.21.15.97:0/3954096976 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac80714b0 con 0x7fdac812f410 2024-09-13T18:43:35.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.158+0000 7fdac4ff9640 1 -- 172.21.15.97:0/3954096976 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fdac00075b0 con 0x7fdac812f410 2024-09-13T18:43:35.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.309+0000 7fdacf06f640 1 -- 172.21.15.97:0/3954096976 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdac805e0d0 con 0x7fdac812f410 2024-09-13T18:43:35.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.309+0000 7fdac4ff9640 1 -- 172.21.15.97:0/3954096976 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdac0010770 con 0x7fdac812f410 2024-09-13T18:43:35.312 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 8 2024-09-13T18:43:35.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.311+0000 7fdacf06f640 1 -- 172.21.15.97:0/3954096976 >> v1:172.21.15.97:6816/34603 conn(0x7fdaac031160 legacy=0x7fdaac033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.311+0000 7fdacf06f640 1 -- 172.21.15.97:0/3954096976 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdac812f410 msgr2=0x7fdac811b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.311+0000 7fdacf06f640 1 --2- 172.21.15.97:0/3954096976 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdac812f410 0x7fdac811b3a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdac000cbe0 tx=0x7fdac00019a0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.311+0000 7fdacf06f640 1 -- 172.21.15.97:0/3954096976 shutdown_connections 2024-09-13T18:43:35.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.311+0000 7fdacf06f640 1 --2- 172.21.15.97:0/3954096976 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdac812f410 0x7fdac811b3a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.311+0000 7fdacf06f640 1 --2- 172.21.15.97:0/3954096976 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdac809d2c0 0x7fdac811ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.311+0000 7fdacf06f640 1 --2- 172.21.15.97:0/3954096976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdac80688c0 0x7fdac811e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.311+0000 7fdacf06f640 1 -- 172.21.15.97:0/3954096976 >> 172.21.15.97:0/3954096976 conn(0x7fdac806f310 msgr2=0x7fdac8132520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:35.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.311+0000 7fdacf06f640 1 -- 172.21.15.97:0/3954096976 shutdown_connections 2024-09-13T18:43:35.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.311+0000 7fdacf06f640 1 -- 172.21.15.97:0/3954096976 wait complete. 2024-09-13T18:43:35.324 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:43:35.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.417+0000 7f0f2b31d640 1 Processor -- start 2024-09-13T18:43:35.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.417+0000 7f0f2b31d640 1 -- start start 2024-09-13T18:43:35.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f2b31d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f2409bd80 0x7f0f24134950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f2b31d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0f24134e90 0x7f0f24137270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f2b31d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f24068d90 con 0x7f0f2409b2a0 2024-09-13T18:43:35.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f2b31d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f2409d250 con 0x7f0f24134e90 2024-09-13T18:43:35.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f2b31d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2409c150 con 0x7f0f2409bd80 2024-09-13T18:43:35.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f288b8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f2409bd80 0x7f0f24134950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f290b9640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f0f2409b2a0 0x7f0f2409b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56464/0 (socket says 172.21.15.97:56464) 2024-09-13T18:43:35.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f298ba640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0f24134e90 0x7f0f24137270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f290b9640 1 -- 172.21.15.97:0/2662527936 learned_addr learned my addr 172.21.15.97:0/2662527936 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:43:35.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f298ba640 1 -- 172.21.15.97:0/2662527936 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f2409bd80 msgr2=0x7f0f24134950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:35.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f298ba640 1 --2- 172.21.15.97:0/2662527936 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f2409bd80 0x7f0f24134950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f298ba640 1 -- 172.21.15.97:0/2662527936 >> v1:172.21.15.97:6789/0 conn(0x7f0f2409b2a0 legacy=0x7f0f2409b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f1bfff640 1 -- 172.21.15.97:0/2662527936 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887661012 0 0) 0x7f0f24068d90 con 0x7f0f2409b2a0 2024-09-13T18:43:35.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f298ba640 1 -- 172.21.15.97:0/2662527936 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f240681b0 con 0x7f0f24134e90 2024-09-13T18:43:35.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.418+0000 7f0f288b8640 1 --2- 172.21.15.97:0/2662527936 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f2409bd80 0x7f0f24134950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:35.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.419+0000 7f0f298ba640 1 --2- 172.21.15.97:0/2662527936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f24134e90 0x7f0f24137270 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009e90 tx=0x7f0f1c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878ca87fa8e449f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:35.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.419+0000 7f0f1bfff640 1 -- 172.21.15.97:0/2662527936 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c02aea0 con 0x7f0f24134e90 2024-09-13T18:43:35.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.419+0000 7f0f1bfff640 1 -- 172.21.15.97:0/2662527936 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c02d050 con 0x7f0f24134e90 2024-09-13T18:43:35.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.419+0000 7f0f1bfff640 1 -- 172.21.15.97:0/2662527936 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c007780 con 0x7f0f24134e90 2024-09-13T18:43:35.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.420+0000 7f0f2b31d640 1 -- 172.21.15.97:0/2662527936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f24134e90 msgr2=0x7f0f24137270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.420+0000 7f0f2b31d640 1 --2- 172.21.15.97:0/2662527936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f24134e90 0x7f0f24137270 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009e90 tx=0x7f0f1c009780 comp rx=0 tx=0).stop 2024-09-13T18:43:35.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.420+0000 7f0f2b31d640 1 -- 172.21.15.97:0/2662527936 shutdown_connections 2024-09-13T18:43:35.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.420+0000 7f0f2b31d640 1 --2- 172.21.15.97:0/2662527936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f24134e90 0x7f0f24137270 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.420+0000 7f0f2b31d640 1 --2- 172.21.15.97:0/2662527936 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f2409bd80 0x7f0f24134950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.420+0000 7f0f2b31d640 1 -- 172.21.15.97:0/2662527936 >> 172.21.15.97:0/2662527936 conn(0x7f0f24067b90 msgr2=0x7f0f240a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:35.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.420+0000 7f0f2b31d640 1 -- 172.21.15.97:0/2662527936 shutdown_connections 2024-09-13T18:43:35.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.420+0000 7f0f2b31d640 1 -- 172.21.15.97:0/2662527936 wait complete. 2024-09-13T18:43:35.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.420+0000 7f0f2b31d640 1 Processor -- start 2024-09-13T18:43:35.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.420+0000 7f0f2b31d640 1 -- start start 2024-09-13T18:43:35.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f2b31d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f2409b2a0 0x7f0f24098f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f2b31d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f2409bd80 0x7f0f240969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f2b31d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f24134e90 0x7f0f24096f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f2b31d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f24099aa0 con 0x7f0f24134e90 2024-09-13T18:43:35.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f2b31d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2406eec0 con 0x7f0f2409b2a0 2024-09-13T18:43:35.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f2b31d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f24068660 con 0x7f0f2409bd80 2024-09-13T18:43:35.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f290b9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f2409b2a0 0x7f0f24098f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f298ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f24134e90 0x7f0f24096f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f288b8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f2409bd80 0x7f0f240969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f298ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f24134e90 0x7f0f24096f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58334/0 (socket says 172.21.15.97:58334) 2024-09-13T18:43:35.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f290b9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f2409b2a0 0x7f0f24098f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:40070/0 (socket says 172.21.15.97:40070) 2024-09-13T18:43:35.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f288b8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f2409bd80 0x7f0f240969d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:38630/0 (socket says 172.21.15.97:38630) 2024-09-13T18:43:35.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f298ba640 1 -- 172.21.15.97:0/1337663846 learned_addr learned my addr 172.21.15.97:0/1337663846 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:35.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f288b8640 1 -- 172.21.15.97:0/1337663846 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f2409b2a0 msgr2=0x7f0f24098f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f288b8640 1 --2- 172.21.15.97:0/1337663846 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f2409b2a0 0x7f0f24098f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f288b8640 1 -- 172.21.15.97:0/1337663846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f24134e90 msgr2=0x7f0f24096f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f288b8640 1 --2- 172.21.15.97:0/1337663846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f24134e90 0x7f0f24096f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.421+0000 7f0f288b8640 1 -- 172.21.15.97:0/1337663846 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f14009390 con 0x7f0f2409bd80 2024-09-13T18:43:35.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.422+0000 7f0f290b9640 1 --2- 172.21.15.97:0/1337663846 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f2409b2a0 0x7f0f24098f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:35.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.422+0000 7f0f298ba640 1 --2- 172.21.15.97:0/1337663846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f24134e90 0x7f0f24096f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:35.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.422+0000 7f0f288b8640 1 --2- 172.21.15.97:0/1337663846 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f2409bd80 0x7f0f240969d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400ea50 tx=0x7f0f140090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:35.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.422+0000 7f0f197fa640 1 -- 172.21.15.97:0/1337663846 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1400ca10 con 0x7f0f2409bd80 2024-09-13T18:43:35.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.422+0000 7f0f197fa640 1 -- 172.21.15.97:0/1337663846 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1400cb70 con 0x7f0f2409bd80 2024-09-13T18:43:35.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.422+0000 7f0f2b31d640 1 -- 172.21.15.97:0/1337663846 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1c009a20 con 0x7f0f2409bd80 2024-09-13T18:43:35.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.422+0000 7f0f197fa640 1 -- 172.21.15.97:0/1337663846 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14013470 con 0x7f0f2409bd80 2024-09-13T18:43:35.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.422+0000 7f0f2b31d640 1 -- 172.21.15.97:0/1337663846 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f24099460 con 0x7f0f2409bd80 2024-09-13T18:43:35.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.423+0000 7f0f197fa640 1 -- 172.21.15.97:0/1337663846 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f0f14013860 con 0x7f0f2409bd80 2024-09-13T18:43:35.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.423+0000 7f0f197fa640 1 -- 172.21.15.97:0/1337663846 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f0f14042490 con 0x7f0f2409bd80 2024-09-13T18:43:35.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.423+0000 7f0f2b31d640 1 -- 172.21.15.97:0/1337663846 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f24099be0 con 0x7f0f2409bd80 2024-09-13T18:43:35.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.427+0000 7f0f197fa640 1 -- 172.21.15.97:0/1337663846 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f0f24099be0 con 0x7f0f2409bd80 2024-09-13T18:43:35.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.580+0000 7f0f2b31d640 1 -- 172.21.15.97:0/1337663846 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f24099be0 con 0x7f0f2409bd80 2024-09-13T18:43:35.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.581+0000 7f0f197fa640 1 -- 172.21.15.97:0/1337663846 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f24099be0 con 0x7f0f2409bd80 2024-09-13T18:43:35.584 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2024-09-13T18:43:35.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.583+0000 7f0f2b31d640 1 -- 172.21.15.97:0/1337663846 >> v1:172.21.15.97:6816/34603 conn(0x7f0f08031160 legacy=0x7f0f08033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.583+0000 7f0f2b31d640 1 -- 172.21.15.97:0/1337663846 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f2409bd80 msgr2=0x7f0f240969d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.583+0000 7f0f2b31d640 1 --2- 172.21.15.97:0/1337663846 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f2409bd80 0x7f0f240969d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400ea50 tx=0x7f0f140090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.583+0000 7f0f2b31d640 1 -- 172.21.15.97:0/1337663846 shutdown_connections 2024-09-13T18:43:35.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.583+0000 7f0f2b31d640 1 --2- 172.21.15.97:0/1337663846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f24134e90 0x7f0f24096f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.583+0000 7f0f2b31d640 1 --2- 172.21.15.97:0/1337663846 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f0f2409bd80 0x7f0f240969d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.583+0000 7f0f2b31d640 1 --2- 172.21.15.97:0/1337663846 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f0f2409b2a0 0x7f0f24098f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.583+0000 7f0f2b31d640 1 -- 172.21.15.97:0/1337663846 >> 172.21.15.97:0/1337663846 conn(0x7f0f24067b90 msgr2=0x7f0f2409fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:35.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.583+0000 7f0f2b31d640 1 -- 172.21.15.97:0/1337663846 shutdown_connections 2024-09-13T18:43:35.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.583+0000 7f0f2b31d640 1 -- 172.21.15.97:0/1337663846 wait complete. 2024-09-13T18:43:35.596 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:43:35.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.718+0000 7f7c4099d640 1 Processor -- start 2024-09-13T18:43:35.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.718+0000 7f7c4099d640 1 -- start start 2024-09-13T18:43:35.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.719+0000 7f7c4099d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c3c096e50 0x7f7c3c097220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.719+0000 7f7c4099d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7c3c097760 0x7f7c3c12d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.719+0000 7f7c4099d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c3c12d720 0x7f7c3c12dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.719+0000 7f7c4099d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c0969d0 con 0x7f7c3c097760 2024-09-13T18:43:35.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.719+0000 7f7c4099d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c06a430 con 0x7f7c3c12d720 2024-09-13T18:43:35.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.719+0000 7f7c4099d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c06a6f0 con 0x7f7c3c096e50 2024-09-13T18:43:35.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.719+0000 7f7c3a59c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c3c096e50 0x7f7c3c097220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.719+0000 7f7c3a59c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c3c096e50 0x7f7c3c097220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:38636/0 (socket says 172.21.15.97:38636) 2024-09-13T18:43:35.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.719+0000 7f7c3a59c640 1 -- 172.21.15.97:0/1716558553 learned_addr learned my addr 172.21.15.97:0/1716558553 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:35.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.720+0000 7f7c39d9b640 1 --2- 172.21.15.97:0/1716558553 >> v2:172.21.15.97:3300/0 conn(0x7f7c3c097760 0x7f7c3c12d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.720+0000 7f7c3a59c640 1 -- 172.21.15.97:0/1716558553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c3c12d720 msgr2=0x7f7c3c12dba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:43:35.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.720+0000 7f7c3a59c640 1 --2- 172.21.15.97:0/1716558553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c3c12d720 0x7f7c3c12dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.720+0000 7f7c3a59c640 1 -- 172.21.15.97:0/1716558553 >> v2:172.21.15.97:3300/0 conn(0x7f7c3c097760 msgr2=0x7f7c3c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:35.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.720+0000 7f7c3a59c640 1 --2- 172.21.15.97:0/1716558553 >> v2:172.21.15.97:3300/0 conn(0x7f7c3c097760 0x7f7c3c12d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.720+0000 7f7c3a59c640 1 -- 172.21.15.97:0/1716558553 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c09a380 con 0x7f7c3c096e50 2024-09-13T18:43:35.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.721+0000 7f7c3a59c640 1 --2- 172.21.15.97:0/1716558553 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c3c096e50 0x7f7c3c097220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009910 tx=0x7f7c2c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0dd37cb3381b3e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:35.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.721+0000 7f7c3959a640 1 -- 172.21.15.97:0/1716558553 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c02add0 con 0x7f7c3c096e50 2024-09-13T18:43:35.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.721+0000 7f7c3959a640 1 -- 172.21.15.97:0/1716558553 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c032440 con 0x7f7c3c096e50 2024-09-13T18:43:35.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.721+0000 7f7c3959a640 1 -- 172.21.15.97:0/1716558553 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c0327e0 con 0x7f7c3c096e50 2024-09-13T18:43:35.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.723+0000 7f7c4099d640 1 -- 172.21.15.97:0/1716558553 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c3c096e50 msgr2=0x7f7c3c097220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.723+0000 7f7c4099d640 1 --2- 172.21.15.97:0/1716558553 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c3c096e50 0x7f7c3c097220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009910 tx=0x7f7c2c0091d0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.724+0000 7f7c4099d640 1 -- 172.21.15.97:0/1716558553 shutdown_connections 2024-09-13T18:43:35.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.724+0000 7f7c4099d640 1 --2- 172.21.15.97:0/1716558553 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c3c12d720 0x7f7c3c12dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.724+0000 7f7c4099d640 1 --2- 172.21.15.97:0/1716558553 >> v2:172.21.15.97:3300/0 conn(0x7f7c3c097760 0x7f7c3c12d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.724+0000 7f7c4099d640 1 --2- 172.21.15.97:0/1716558553 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c3c096e50 0x7f7c3c097220 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.724+0000 7f7c4099d640 1 -- 172.21.15.97:0/1716558553 >> 172.21.15.97:0/1716558553 conn(0x7f7c3c09f100 msgr2=0x7f7c3c09b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:35.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.724+0000 7f7c4099d640 1 -- 172.21.15.97:0/1716558553 shutdown_connections 2024-09-13T18:43:35.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.724+0000 7f7c4099d640 1 -- 172.21.15.97:0/1716558553 wait complete. 2024-09-13T18:43:35.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.725+0000 7f7c4099d640 1 Processor -- start 2024-09-13T18:43:35.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.726+0000 7f7c4099d640 1 -- start start 2024-09-13T18:43:35.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c4099d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c3c096e50 0x7f7c3c116bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c4099d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c3c097760 0x7f7c3c1170f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c4099d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c3c12d720 0x7f7c3c13a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:35.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c4099d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c1189f0 con 0x7f7c3c12d720 2024-09-13T18:43:35.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c4099d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c069cb0 con 0x7f7c3c096e50 2024-09-13T18:43:35.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c4099d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c1198c0 con 0x7f7c3c097760 2024-09-13T18:43:35.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c39d9b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c3c097760 0x7f7c3c1170f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c39d9b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c3c097760 0x7f7c3c1170f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:38646/0 (socket says 172.21.15.97:38646) 2024-09-13T18:43:35.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c3ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c3c12d720 0x7f7c3c13a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:35.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c39d9b640 1 -- 172.21.15.97:0/1515601877 learned_addr learned my addr 172.21.15.97:0/1515601877 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:35.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c3ad9d640 1 -- 172.21.15.97:0/1515601877 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c3c097760 msgr2=0x7f7c3c1170f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c3ad9d640 1 --2- 172.21.15.97:0/1515601877 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c3c097760 0x7f7c3c1170f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c3ad9d640 1 -- 172.21.15.97:0/1515601877 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c3c096e50 msgr2=0x7f7c3c116bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:35.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c3ad9d640 1 --2- 172.21.15.97:0/1515601877 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c3c096e50 0x7f7c3c116bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:35.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.727+0000 7f7c3ad9d640 1 -- 172.21.15.97:0/1515601877 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c009450 con 0x7f7c3c12d720 2024-09-13T18:43:35.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.728+0000 7f7c3ad9d640 1 --2- 172.21.15.97:0/1515601877 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c3c12d720 0x7f7c3c13a810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000b4c0 tx=0x7f7c30006f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:35.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.728+0000 7f7c2a7fc640 1 -- 172.21.15.97:0/1515601877 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3000f510 con 0x7f7c3c12d720 2024-09-13T18:43:35.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.729+0000 7f7c4099d640 1 -- 172.21.15.97:0/1515601877 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c11a5b0 con 0x7f7c3c12d720 2024-09-13T18:43:35.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.729+0000 7f7c2a7fc640 1 -- 172.21.15.97:0/1515601877 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3000f690 con 0x7f7c3c12d720 2024-09-13T18:43:35.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.729+0000 7f7c2a7fc640 1 -- 172.21.15.97:0/1515601877 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3000fa50 con 0x7f7c3c12d720 2024-09-13T18:43:35.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.729+0000 7f7c4099d640 1 -- 172.21.15.97:0/1515601877 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c1167f0 con 0x7f7c3c12d720 2024-09-13T18:43:35.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.730+0000 7f7c2a7fc640 1 -- 172.21.15.97:0/1515601877 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f7c3001a400 con 0x7f7c3c12d720 2024-09-13T18:43:35.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.730+0000 7f7c2a7fc640 1 -- 172.21.15.97:0/1515601877 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f7c30042550 con 0x7f7c3c12d720 2024-09-13T18:43:35.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.731+0000 7f7c4099d640 1 -- 172.21.15.97:0/1515601877 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c12d210 con 0x7f7c3c12d720 2024-09-13T18:43:35.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:35.739+0000 7f7c2a7fc640 1 -- 172.21.15.97:0/1515601877 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f7c3000fe00 con 0x7f7c3c12d720 2024-09-13T18:43:36.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.038+0000 7f7c4099d640 1 -- 172.21.15.97:0/1515601877 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7c3c0714b0 con 0x7f7c3c12d720 2024-09-13T18:43:36.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.038+0000 7f7c2a7fc640 1 -- 172.21.15.97:0/1515601877 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7c300172b0 con 0x7f7c3c12d720 2024-09-13T18:43:36.041 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2024-09-13T18:43:36.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.041+0000 7f7c4099d640 1 -- 172.21.15.97:0/1515601877 >> v1:172.21.15.97:6816/34603 conn(0x7f7c1c031160 legacy=0x7f7c1c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:36.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.041+0000 7f7c4099d640 1 -- 172.21.15.97:0/1515601877 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c3c12d720 msgr2=0x7f7c3c13a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:36.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.041+0000 7f7c4099d640 1 --2- 172.21.15.97:0/1515601877 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c3c12d720 0x7f7c3c13a810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000b4c0 tx=0x7f7c30006f50 comp rx=0 tx=0).stop 2024-09-13T18:43:36.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.041+0000 7f7c4099d640 1 -- 172.21.15.97:0/1515601877 shutdown_connections 2024-09-13T18:43:36.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.041+0000 7f7c4099d640 1 --2- 172.21.15.97:0/1515601877 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c3c12d720 0x7f7c3c13a810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.041+0000 7f7c4099d640 1 --2- 172.21.15.97:0/1515601877 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7c3c097760 0x7f7c3c1170f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.041+0000 7f7c4099d640 1 --2- 172.21.15.97:0/1515601877 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7c3c096e50 0x7f7c3c116bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.041+0000 7f7c4099d640 1 -- 172.21.15.97:0/1515601877 >> 172.21.15.97:0/1515601877 conn(0x7f7c3c09f100 msgr2=0x7f7c3c12e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:36.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.043+0000 7f7c4099d640 1 -- 172.21.15.97:0/1515601877 shutdown_connections 2024-09-13T18:43:36.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.043+0000 7f7c4099d640 1 -- 172.21.15.97:0/1515601877 wait complete. 2024-09-13T18:43:36.060 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:43:36.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.209+0000 7fb89fd09640 1 Processor -- start 2024-09-13T18:43:36.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.210+0000 7fb89fd09640 1 -- start start 2024-09-13T18:43:36.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.210+0000 7fb89fd09640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb89809cea0 0x7fb89809d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:36.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89fd09640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb89812d880 0x7fb8981354c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:36.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89fd09640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89809cca0 con 0x7fb89809d7b0 2024-09-13T18:43:36.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89fd09640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89809cac0 con 0x7fb89812d880 2024-09-13T18:43:36.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89fd09640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb89806a350 con 0x7fb89809cea0 2024-09-13T18:43:36.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89d2a4640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb89809d7b0 0x7fb89812d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56480/0 (socket says 172.21.15.97:56480) 2024-09-13T18:43:36.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89d2a4640 1 -- 172.21.15.97:0/1310782152 learned_addr learned my addr 172.21.15.97:0/1310782152 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:43:36.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89e2a6640 1 --2- 172.21.15.97:0/1310782152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb89812d880 0x7fb8981354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:36.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89daa5640 1 --2- 172.21.15.97:0/1310782152 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb89809cea0 0x7fb89809d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:36.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89caa3640 1 -- 172.21.15.97:0/1310782152 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235830691 0 0) 0x7fb89809cca0 con 0x7fb89809d7b0 2024-09-13T18:43:36.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89caa3640 1 -- 172.21.15.97:0/1310782152 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8840034e0 con 0x7fb89809d7b0 2024-09-13T18:43:36.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89e2a6640 1 -- 172.21.15.97:0/1310782152 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb89809cea0 msgr2=0x7fb89809d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:36.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89e2a6640 1 --2- 172.21.15.97:0/1310782152 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb89809cea0 0x7fb89809d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89e2a6640 1 -- 172.21.15.97:0/1310782152 >> v1:172.21.15.97:6789/0 conn(0x7fb89809d7b0 legacy=0x7fb89812d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:36.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.211+0000 7fb89e2a6640 1 -- 172.21.15.97:0/1310782152 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89806e930 con 0x7fb89812d880 2024-09-13T18:43:36.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.212+0000 7fb89e2a6640 1 --2- 172.21.15.97:0/1310782152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb89812d880 0x7fb8981354c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb89400fb00 tx=0x7fb8940090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2a75afdc7f41276 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:36.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.213+0000 7fb89caa3640 1 -- 172.21.15.97:0/1310782152 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89402ab30 con 0x7fb89812d880 2024-09-13T18:43:36.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.213+0000 7fb89caa3640 1 -- 172.21.15.97:0/1310782152 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89402ac90 con 0x7fb89812d880 2024-09-13T18:43:36.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.213+0000 7fb89caa3640 1 -- 172.21.15.97:0/1310782152 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894032650 con 0x7fb89812d880 2024-09-13T18:43:36.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.214+0000 7fb89fd09640 1 -- 172.21.15.97:0/1310782152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb89812d880 msgr2=0x7fb8981354c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:36.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.214+0000 7fb89fd09640 1 --2- 172.21.15.97:0/1310782152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb89812d880 0x7fb8981354c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb89400fb00 tx=0x7fb8940090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.214+0000 7fb89fd09640 1 -- 172.21.15.97:0/1310782152 shutdown_connections 2024-09-13T18:43:36.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.214+0000 7fb89fd09640 1 --2- 172.21.15.97:0/1310782152 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb89812d880 0x7fb8981354c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.214+0000 7fb89fd09640 1 --2- 172.21.15.97:0/1310782152 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb89809cea0 0x7fb89809d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.214+0000 7fb89fd09640 1 -- 172.21.15.97:0/1310782152 >> 172.21.15.97:0/1310782152 conn(0x7fb89809b200 msgr2=0x7fb89809b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:36.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.215+0000 7fb89fd09640 1 -- 172.21.15.97:0/1310782152 shutdown_connections 2024-09-13T18:43:36.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.216+0000 7fb89fd09640 1 -- 172.21.15.97:0/1310782152 wait complete. 2024-09-13T18:43:36.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.217+0000 7fb89fd09640 1 Processor -- start 2024-09-13T18:43:36.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.217+0000 7fb89fd09640 1 -- start start 2024-09-13T18:43:36.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.218+0000 7fb89fd09640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb89809cea0 0x7fb89813a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:36.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.218+0000 7fb89fd09640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89809d7b0 0x7fb89813ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:36.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.218+0000 7fb89fd09640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb89812d880 0x7fb898118360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:36.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.218+0000 7fb89fd09640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89811a2f0 con 0x7fb89809d7b0 2024-09-13T18:43:36.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.218+0000 7fb89fd09640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89811b9e0 con 0x7fb89809cea0 2024-09-13T18:43:36.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.218+0000 7fb89fd09640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb898096a60 con 0x7fb89812d880 2024-09-13T18:43:36.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.218+0000 7fb89daa5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb89809cea0 0x7fb89813a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:36.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.218+0000 7fb89e2a6640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb89812d880 0x7fb898118360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:36.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.218+0000 7fb89d2a4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89809d7b0 0x7fb89813ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:36.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.218+0000 7fb89daa5640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb89809cea0 0x7fb89813a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:40090/0 (socket says 172.21.15.97:40090) 2024-09-13T18:43:36.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.218+0000 7fb89daa5640 1 -- 172.21.15.97:0/1671275669 learned_addr learned my addr 172.21.15.97:0/1671275669 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:36.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.219+0000 7fb89d2a4640 1 -- 172.21.15.97:0/1671275669 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb89812d880 msgr2=0x7fb898118360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:36.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.219+0000 7fb89d2a4640 1 --2- 172.21.15.97:0/1671275669 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb89812d880 0x7fb898118360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.219+0000 7fb89d2a4640 1 -- 172.21.15.97:0/1671275669 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb89809cea0 msgr2=0x7fb89813a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:36.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.219+0000 7fb89d2a4640 1 --2- 172.21.15.97:0/1671275669 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb89809cea0 0x7fb89813a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.219+0000 7fb89d2a4640 1 -- 172.21.15.97:0/1671275669 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89400f610 con 0x7fb89809d7b0 2024-09-13T18:43:36.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.219+0000 7fb89daa5640 1 --2- 172.21.15.97:0/1671275669 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb89809cea0 0x7fb89813a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:36.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.220+0000 7fb89d2a4640 1 --2- 172.21.15.97:0/1671275669 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89809d7b0 0x7fb89813ac60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb898068830 tx=0x7fb88c001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:36.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.221+0000 7fb889ffb640 1 -- 172.21.15.97:0/1671275669 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00ce10 con 0x7fb89809d7b0 2024-09-13T18:43:36.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.221+0000 7fb889ffb640 1 -- 172.21.15.97:0/1671275669 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c00a850 con 0x7fb89809d7b0 2024-09-13T18:43:36.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.221+0000 7fb889ffb640 1 -- 172.21.15.97:0/1671275669 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00ac90 con 0x7fb89809d7b0 2024-09-13T18:43:36.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.221+0000 7fb89fd09640 1 -- 172.21.15.97:0/1671275669 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89812f4b0 con 0x7fb89809d7b0 2024-09-13T18:43:36.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.221+0000 7fb89fd09640 1 -- 172.21.15.97:0/1671275669 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89813b1a0 con 0x7fb89809d7b0 2024-09-13T18:43:36.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.223+0000 7fb89fd09640 1 -- 172.21.15.97:0/1671275669 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb898064000 con 0x7fb89809d7b0 2024-09-13T18:43:36.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.224+0000 7fb889ffb640 1 -- 172.21.15.97:0/1671275669 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fb88c007300 con 0x7fb89809d7b0 2024-09-13T18:43:36.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.225+0000 7fb889ffb640 1 -- 172.21.15.97:0/1671275669 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fb88c042280 con 0x7fb89809d7b0 2024-09-13T18:43:36.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.231+0000 7fb889ffb640 1 -- 172.21.15.97:0/1671275669 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fb88c00adf0 con 0x7fb89809d7b0 2024-09-13T18:43:36.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.556+0000 7fb89fd09640 1 -- 172.21.15.97:0/1671275669 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb89806e500 con 0x7fb89809d7b0 2024-09-13T18:43:36.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.557+0000 7fb889ffb640 1 -- 172.21.15.97:0/1671275669 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb88c010770 con 0x7fb89809d7b0 2024-09-13T18:43:36.561 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2024-09-13T18:43:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.560+0000 7fb89fd09640 1 -- 172.21.15.97:0/1671275669 >> v1:172.21.15.97:6816/34603 conn(0x7fb87c0311b0 legacy=0x7fb87c033660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.560+0000 7fb89fd09640 1 -- 172.21.15.97:0/1671275669 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89809d7b0 msgr2=0x7fb89813ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:36.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.560+0000 7fb89fd09640 1 --2- 172.21.15.97:0/1671275669 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89809d7b0 0x7fb89813ac60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb898068830 tx=0x7fb88c001a60 comp rx=0 tx=0).stop 2024-09-13T18:43:36.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.562+0000 7fb89fd09640 1 -- 172.21.15.97:0/1671275669 shutdown_connections 2024-09-13T18:43:36.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.562+0000 7fb89fd09640 1 --2- 172.21.15.97:0/1671275669 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb89812d880 0x7fb898118360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.562+0000 7fb89fd09640 1 --2- 172.21.15.97:0/1671275669 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb89809d7b0 0x7fb89813ac60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.562+0000 7fb89fd09640 1 --2- 172.21.15.97:0/1671275669 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb89809cea0 0x7fb89813a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.562+0000 7fb89fd09640 1 -- 172.21.15.97:0/1671275669 >> 172.21.15.97:0/1671275669 conn(0x7fb89809b200 msgr2=0x7fb898099ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:36.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.562+0000 7fb89fd09640 1 -- 172.21.15.97:0/1671275669 shutdown_connections 2024-09-13T18:43:36.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.563+0000 7fb89fd09640 1 -- 172.21.15.97:0/1671275669 wait complete. 2024-09-13T18:43:36.582 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:43:36.582 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:36.603 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:43:36.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.759+0000 7fedbcd9d640 1 Processor -- start 2024-09-13T18:43:36.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.760+0000 7fedbcd9d640 1 -- start start 2024-09-13T18:43:36.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.760+0000 7fedbcd9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fedb80a3420 0x7fedb806d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:36.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.760+0000 7fedbcd9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb8138c20 0x7fedb813b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:36.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.760+0000 7fedbcd9d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb809dc90 con 0x7fedb809ded0 2024-09-13T18:43:36.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.761+0000 7fedbcd9d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb806a5d0 con 0x7fedb80a3420 2024-09-13T18:43:36.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.761+0000 7fedbcd9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb806e3d0 con 0x7fedb8138c20 2024-09-13T18:43:36.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.761+0000 7fedb659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fedb80a3420 0x7fedb806d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:36.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.761+0000 7fedb659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fedb80a3420 0x7fedb806d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58358/0 (socket says 172.21.15.97:58358) 2024-09-13T18:43:36.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.761+0000 7fedb659c640 1 -- 172.21.15.97:0/1619834834 learned_addr learned my addr 172.21.15.97:0/1619834834 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:36.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.761+0000 7fedb6d9d640 1 --2- 172.21.15.97:0/1619834834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb8138c20 0x7fedb813b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:36.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.762+0000 7fedb659c640 1 -- 172.21.15.97:0/1619834834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb8138c20 msgr2=0x7fedb813b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:36.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.762+0000 7fedb659c640 1 --2- 172.21.15.97:0/1619834834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb8138c20 0x7fedb813b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.762+0000 7fedb659c640 1 -- 172.21.15.97:0/1619834834 >> v1:172.21.15.97:6789/0 conn(0x7fedb809ded0 legacy=0x7fedb806dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:36.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.762+0000 7fedb559a640 1 -- 172.21.15.97:0/1619834834 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220580819 0 0) 0x7fedb809dc90 con 0x7fedb809ded0 2024-09-13T18:43:36.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.762+0000 7fedb659c640 1 -- 172.21.15.97:0/1619834834 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb809ce50 con 0x7fedb80a3420 2024-09-13T18:43:36.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.763+0000 7fedb659c640 1 --2- 172.21.15.97:0/1619834834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb80a3420 0x7fedb806d780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fedac009910 tx=0x7fedac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c905cf2214d61bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:36.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.765+0000 7fedb559a640 1 -- 172.21.15.97:0/1619834834 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac02adb0 con 0x7fedb80a3420 2024-09-13T18:43:36.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.765+0000 7fedb559a640 1 -- 172.21.15.97:0/1619834834 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac032440 con 0x7fedb80a3420 2024-09-13T18:43:36.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.766+0000 7fedb559a640 1 -- 172.21.15.97:0/1619834834 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac032820 con 0x7fedb80a3420 2024-09-13T18:43:36.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.766+0000 7fedbcd9d640 1 -- 172.21.15.97:0/1619834834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb80a3420 msgr2=0x7fedb806d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:36.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.766+0000 7fedbcd9d640 1 --2- 172.21.15.97:0/1619834834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb80a3420 0x7fedb806d780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fedac009910 tx=0x7fedac0091d0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.768+0000 7fedbcd9d640 1 -- 172.21.15.97:0/1619834834 shutdown_connections 2024-09-13T18:43:36.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.768+0000 7fedbcd9d640 1 --2- 172.21.15.97:0/1619834834 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb8138c20 0x7fedb813b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.768+0000 7fedbcd9d640 1 --2- 172.21.15.97:0/1619834834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb80a3420 0x7fedb806d780 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.768+0000 7fedbcd9d640 1 -- 172.21.15.97:0/1619834834 >> 172.21.15.97:0/1619834834 conn(0x7fedb806efb0 msgr2=0x7fedb80a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:36.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.769+0000 7fedbcd9d640 1 -- 172.21.15.97:0/1619834834 shutdown_connections 2024-09-13T18:43:36.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.769+0000 7fedbcd9d640 1 -- 172.21.15.97:0/1619834834 wait complete. 2024-09-13T18:43:36.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.771+0000 7fedbcd9d640 1 Processor -- start 2024-09-13T18:43:36.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.772+0000 7fedbcd9d640 1 -- start start 2024-09-13T18:43:36.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.772+0000 7fedbcd9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fedb809ded0 0x7fedb81243b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:36.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.772+0000 7fedbcd9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb80a3420 0x7fedb81218c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:36.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.772+0000 7fedbcd9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb8138c20 0x7fedb8121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:36.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.772+0000 7fedbcd9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80a20c0 con 0x7fedb80a3420 2024-09-13T18:43:36.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.772+0000 7fedbcd9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb809e3c0 con 0x7fedb8138c20 2024-09-13T18:43:36.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.772+0000 7fedbcd9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8123eb0 con 0x7fedb809ded0 2024-09-13T18:43:36.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.772+0000 7fedb6d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb8138c20 0x7fedb8121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:36.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.772+0000 7fedb6d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb8138c20 0x7fedb8121e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:40112/0 (socket says 172.21.15.97:40112) 2024-09-13T18:43:36.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.772+0000 7fedb6d9d640 1 -- 172.21.15.97:0/244117847 learned_addr learned my addr 172.21.15.97:0/244117847 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:36.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.773+0000 7fedb5d9b640 1 --2- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb80a3420 0x7fedb81218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:36.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.773+0000 7fedb6d9d640 1 -- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fedb809ded0 msgr2=0x7fedb81243b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:36.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.773+0000 7fedb659c640 1 --2- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fedb809ded0 0x7fedb81243b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:36.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.773+0000 7fedb6d9d640 1 --2- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fedb809ded0 0x7fedb81243b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.773+0000 7fedb6d9d640 1 -- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb80a3420 msgr2=0x7fedb81218c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:36.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.773+0000 7fedb6d9d640 1 --2- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb80a3420 0x7fedb81218c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:36.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.773+0000 7fedb6d9d640 1 -- 172.21.15.97:0/244117847 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac009450 con 0x7fedb8138c20 2024-09-13T18:43:36.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.773+0000 7fedb5d9b640 1 --2- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb80a3420 0x7fedb81218c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:36.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.774+0000 7fedb6d9d640 1 --2- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb8138c20 0x7fedb8121e00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009f20 tx=0x7fedb000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:36.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.774+0000 7fedb659c640 1 --2- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fedb809ded0 0x7fedb81243b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:43:36.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.774+0000 7feda67fc640 1 -- 172.21.15.97:0/244117847 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb000ce10 con 0x7fedb8138c20 2024-09-13T18:43:36.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.774+0000 7fedbcd9d640 1 -- 172.21.15.97:0/244117847 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb8138450 con 0x7fedb8138c20 2024-09-13T18:43:36.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.775+0000 7fedbcd9d640 1 -- 172.21.15.97:0/244117847 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb809c300 con 0x7fedb8138c20 2024-09-13T18:43:36.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.776+0000 7feda67fc640 1 -- 172.21.15.97:0/244117847 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb000f040 con 0x7fedb8138c20 2024-09-13T18:43:36.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.776+0000 7feda67fc640 1 -- 172.21.15.97:0/244117847 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb00146d0 con 0x7fedb8138c20 2024-09-13T18:43:36.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.776+0000 7feda67fc640 1 -- 172.21.15.97:0/244117847 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fedb0014a40 con 0x7fedb8138c20 2024-09-13T18:43:36.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.777+0000 7feda67fc640 1 -- 172.21.15.97:0/244117847 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fedb0043110 con 0x7fedb8138c20 2024-09-13T18:43:36.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.777+0000 7fedbcd9d640 1 -- 172.21.15.97:0/244117847 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c005210 con 0x7fedb8138c20 2024-09-13T18:43:36.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:36.786+0000 7feda67fc640 1 -- 172.21.15.97:0/244117847 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fedb0024300 con 0x7fedb8138c20 2024-09-13T18:43:37.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.101+0000 7fedbcd9d640 1 -- 172.21.15.97:0/244117847 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed9c0054c0 con 0x7fedb8138c20 2024-09-13T18:43:37.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.102+0000 7feda67fc640 1 -- 172.21.15.97:0/244117847 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+11626 (secure 0 0 0) 0x7fedb002b090 con 0x7fedb8138c20 2024-09-13T18:43:37.105 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:43:37.105 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":23,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:54.652125+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.8","mappings":[{"from":1,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:43:37.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.105+0000 7fedbcd9d640 1 -- 172.21.15.97:0/244117847 >> v1:172.21.15.97:6816/34603 conn(0x7fed98031230 legacy=0x7fed980336e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.106+0000 7fedbcd9d640 1 -- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb8138c20 msgr2=0x7fedb8121e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.106+0000 7fedbcd9d640 1 --2- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb8138c20 0x7fedb8121e00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009f20 tx=0x7fedb000b040 comp rx=0 tx=0).stop 2024-09-13T18:43:37.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.106+0000 7fedbcd9d640 1 -- 172.21.15.97:0/244117847 shutdown_connections 2024-09-13T18:43:37.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.106+0000 7fedbcd9d640 1 --2- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fedb8138c20 0x7fedb8121e00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.106+0000 7fedbcd9d640 1 --2- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fedb80a3420 0x7fedb81218c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.106+0000 7fedbcd9d640 1 --2- 172.21.15.97:0/244117847 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fedb809ded0 0x7fedb81243b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.106+0000 7fedbcd9d640 1 -- 172.21.15.97:0/244117847 >> 172.21.15.97:0/244117847 conn(0x7fedb806efb0 msgr2=0x7fedb806c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:37.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.106+0000 7fedbcd9d640 1 -- 172.21.15.97:0/244117847 shutdown_connections 2024-09-13T18:43:37.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.106+0000 7fedbcd9d640 1 -- 172.21.15.97:0/244117847 wait complete. 2024-09-13T18:43:37.126 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:39:01.375967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T18:39:05.732412+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:39:12.014248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:39:12.844264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:43:37.126 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:43:37.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.285+0000 7f273275d640 1 Processor -- start 2024-09-13T18:43:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.285+0000 7f273275d640 1 -- start start 2024-09-13T18:43:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.286+0000 7f273275d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272c098390 0x7f272c099310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.286+0000 7f273275d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f272c09e630 0x7f272c12c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.286+0000 7f273275d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c098760 con 0x7f272c099850 2024-09-13T18:43:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.286+0000 7f273275d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c09f130 con 0x7f272c09e630 2024-09-13T18:43:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.286+0000 7f273275d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0978d0 con 0x7f272c098390 2024-09-13T18:43:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.286+0000 7f272b7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f272c099850 0x7f272c12c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56494/0 (socket says 172.21.15.97:56494) 2024-09-13T18:43:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.286+0000 7f272b7fe640 1 -- 172.21.15.97:0/368670486 learned_addr learned my addr 172.21.15.97:0/368670486 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:43:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.286+0000 7f2730cfa640 1 --2- 172.21.15.97:0/368670486 >> v2:172.21.15.97:3300/0 conn(0x7f272c09e630 0x7f272c12c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.286+0000 7f272bfff640 1 --2- 172.21.15.97:0/368670486 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272c098390 0x7f272c099310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.287+0000 7f2730cfa640 1 -- 172.21.15.97:0/368670486 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272c098390 msgr2=0x7f272c099310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:37.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.287+0000 7f2730cfa640 1 --2- 172.21.15.97:0/368670486 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272c098390 0x7f272c099310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.287+0000 7f2730cfa640 1 -- 172.21.15.97:0/368670486 >> v1:172.21.15.97:6789/0 conn(0x7f272c099850 legacy=0x7f272c12c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.287+0000 7f2730cfa640 1 -- 172.21.15.97:0/368670486 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c097b90 con 0x7f272c09e630 2024-09-13T18:43:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.289+0000 7f2730cfa640 1 --2- 172.21.15.97:0/368670486 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272c09e630 0x7f272c12c760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2724009e60 tx=0x7f2724009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6920d833b2228d77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:37.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.289+0000 7f272affd640 1 -- 172.21.15.97:0/368670486 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724007550 con 0x7f272c09e630 2024-09-13T18:43:37.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.289+0000 7f272affd640 1 -- 172.21.15.97:0/368670486 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272402d050 con 0x7f272c09e630 2024-09-13T18:43:37.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.289+0000 7f272affd640 1 -- 172.21.15.97:0/368670486 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27240078e0 con 0x7f272c09e630 2024-09-13T18:43:37.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.290+0000 7f273275d640 1 -- 172.21.15.97:0/368670486 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272c09e630 msgr2=0x7f272c12c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.290+0000 7f273275d640 1 --2- 172.21.15.97:0/368670486 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272c09e630 0x7f272c12c760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2724009e60 tx=0x7f2724009780 comp rx=0 tx=0).stop 2024-09-13T18:43:37.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.291+0000 7f273275d640 1 -- 172.21.15.97:0/368670486 shutdown_connections 2024-09-13T18:43:37.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.291+0000 7f273275d640 1 --2- 172.21.15.97:0/368670486 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272c09e630 0x7f272c12c760 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.291+0000 7f273275d640 1 --2- 172.21.15.97:0/368670486 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272c098390 0x7f272c099310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.291+0000 7f273275d640 1 -- 172.21.15.97:0/368670486 >> 172.21.15.97:0/368670486 conn(0x7f272c05e620 msgr2=0x7f272c09f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:37.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.291+0000 7f273275d640 1 -- 172.21.15.97:0/368670486 shutdown_connections 2024-09-13T18:43:37.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.291+0000 7f273275d640 1 -- 172.21.15.97:0/368670486 wait complete. 2024-09-13T18:43:37.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.293+0000 7f273275d640 1 Processor -- start 2024-09-13T18:43:37.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.293+0000 7f273275d640 1 -- start start 2024-09-13T18:43:37.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.294+0000 7f273275d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272c098390 0x7f272c119720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.294+0000 7f273275d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272c099850 0x7f272c115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.294+0000 7f273275d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f272c09e630 0x7f272c1162c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.294+0000 7f273275d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c118cf0 con 0x7f272c099850 2024-09-13T18:43:37.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.294+0000 7f273275d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c118f40 con 0x7f272c098390 2024-09-13T18:43:37.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.294+0000 7f273275d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f272c1297b0 con 0x7f272c09e630 2024-09-13T18:43:37.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.294+0000 7f272bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272c098390 0x7f272c119720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.294+0000 7f272bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272c098390 0x7f272c119720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:49218/0 (socket says 172.21.15.97:49218) 2024-09-13T18:43:37.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.294+0000 7f272bfff640 1 -- 172.21.15.97:0/3392600855 learned_addr learned my addr 172.21.15.97:0/3392600855 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:37.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.294+0000 7f2730cfa640 1 --2- 172.21.15.97:0/3392600855 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f272c09e630 0x7f272c1162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.295+0000 7f272bfff640 1 -- 172.21.15.97:0/3392600855 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f272c09e630 msgr2=0x7f272c1162c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.295+0000 7f272bfff640 1 --2- 172.21.15.97:0/3392600855 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f272c09e630 0x7f272c1162c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.295+0000 7f272bfff640 1 -- 172.21.15.97:0/3392600855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272c099850 msgr2=0x7f272c115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.295+0000 7f272bfff640 1 --2- 172.21.15.97:0/3392600855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272c099850 0x7f272c115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.295+0000 7f272bfff640 1 -- 172.21.15.97:0/3392600855 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2724009a20 con 0x7f272c098390 2024-09-13T18:43:37.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.295+0000 7f272bfff640 1 --2- 172.21.15.97:0/3392600855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272c098390 0x7f272c119720 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f271c00ec80 tx=0x7f271c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:37.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.296+0000 7f2723fff640 1 -- 172.21.15.97:0/3392600855 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c00ecb0 con 0x7f272c098390 2024-09-13T18:43:37.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.296+0000 7f273275d640 1 -- 172.21.15.97:0/3392600855 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c117340 con 0x7f272c098390 2024-09-13T18:43:37.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.296+0000 7f273275d640 1 -- 172.21.15.97:0/3392600855 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c117db0 con 0x7f272c098390 2024-09-13T18:43:37.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.296+0000 7f2723fff640 1 -- 172.21.15.97:0/3392600855 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c00ee10 con 0x7f272c098390 2024-09-13T18:43:37.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.296+0000 7f2723fff640 1 -- 172.21.15.97:0/3392600855 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c00cdf0 con 0x7f272c098390 2024-09-13T18:43:37.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.297+0000 7f273275d640 1 -- 172.21.15.97:0/3392600855 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2710005210 con 0x7f272c098390 2024-09-13T18:43:37.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.298+0000 7f2723fff640 1 -- 172.21.15.97:0/3392600855 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f271c013680 con 0x7f272c098390 2024-09-13T18:43:37.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.298+0000 7f2723fff640 1 -- 172.21.15.97:0/3392600855 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f271c0424c0 con 0x7f272c098390 2024-09-13T18:43:37.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.306+0000 7f2723fff640 1 -- 172.21.15.97:0/3392600855 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f271c023ad0 con 0x7f272c098390 2024-09-13T18:43:37.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.525+0000 7f273275d640 1 -- 172.21.15.97:0/3392600855 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2710005a40 con 0x7f272c098390 2024-09-13T18:43:37.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.526+0000 7f2723fff640 1 -- 172.21.15.97:0/3392600855 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f271c0232f0 con 0x7f272c098390 2024-09-13T18:43:37.529 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2024-09-13T18:43:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.528+0000 7f273275d640 1 -- 172.21.15.97:0/3392600855 >> v1:172.21.15.97:6816/34603 conn(0x7f270c0311b0 legacy=0x7f270c033660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.528+0000 7f273275d640 1 -- 172.21.15.97:0/3392600855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272c098390 msgr2=0x7f272c119720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.528+0000 7f273275d640 1 --2- 172.21.15.97:0/3392600855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272c098390 0x7f272c119720 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f271c00ec80 tx=0x7f271c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.528+0000 7f273275d640 1 -- 172.21.15.97:0/3392600855 shutdown_connections 2024-09-13T18:43:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.528+0000 7f273275d640 1 --2- 172.21.15.97:0/3392600855 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f272c09e630 0x7f272c1162c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.528+0000 7f273275d640 1 --2- 172.21.15.97:0/3392600855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f272c099850 0x7f272c115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.528+0000 7f273275d640 1 --2- 172.21.15.97:0/3392600855 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f272c098390 0x7f272c119720 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.528+0000 7f273275d640 1 -- 172.21.15.97:0/3392600855 >> 172.21.15.97:0/3392600855 conn(0x7f272c05e620 msgr2=0x7f272c129fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:37.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.528+0000 7f273275d640 1 -- 172.21.15.97:0/3392600855 shutdown_connections 2024-09-13T18:43:37.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.528+0000 7f273275d640 1 -- 172.21.15.97:0/3392600855 wait complete. 2024-09-13T18:43:37.541 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-13T18:43:37.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.637+0000 7f1433857640 1 Processor -- start 2024-09-13T18:43:37.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.637+0000 7f1433857640 1 -- start start 2024-09-13T18:43:37.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f1433857640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f142c0688c0 0x7f142c09d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f1433857640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f142c134740 0x7f142c136b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f1433857640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c0975a0 con 0x7f142c09d2c0 2024-09-13T18:43:37.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f1433857640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142c068c90 con 0x7f142c134740 2024-09-13T18:43:37.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f1433857640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f142c09e410 con 0x7f142c0688c0 2024-09-13T18:43:37.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f14315f3640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f142c0688c0 0x7f142c09d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f1430df2640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f142c09d2c0 0x7f142c09dd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42674/0 (socket says 172.21.15.97:42674) 2024-09-13T18:43:37.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f1431df4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f142c134740 0x7f142c136b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f1430df2640 1 -- 172.21.15.97:0/2627666443 learned_addr learned my addr 172.21.15.97:0/2627666443 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:43:37.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f14315f3640 1 -- 172.21.15.97:0/2627666443 >> v2:172.21.15.97:3300/0 conn(0x7f142c134740 msgr2=0x7f142c136b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:37.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f14315f3640 1 --2- 172.21.15.97:0/2627666443 >> v2:172.21.15.97:3300/0 conn(0x7f142c134740 0x7f142c136b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f14315f3640 1 -- 172.21.15.97:0/2627666443 >> v1:172.21.15.97:6789/0 conn(0x7f142c09d2c0 legacy=0x7f142c09dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f14315f3640 1 -- 172.21.15.97:0/2627666443 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c069200 con 0x7f142c0688c0 2024-09-13T18:43:37.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.638+0000 7f1431df4640 1 --2- 172.21.15.97:0/2627666443 >> v2:172.21.15.97:3300/0 conn(0x7f142c134740 0x7f142c136b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:37.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.639+0000 7f14315f3640 1 --2- 172.21.15.97:0/2627666443 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f142c0688c0 0x7f142c09d7c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1424009e60 tx=0x7f1424009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a31ffb0884b69e79 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:37.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.639+0000 7f142bfff640 1 -- 172.21.15.97:0/2627666443 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424007550 con 0x7f142c0688c0 2024-09-13T18:43:37.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.639+0000 7f142bfff640 1 -- 172.21.15.97:0/2627666443 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142402d050 con 0x7f142c0688c0 2024-09-13T18:43:37.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.639+0000 7f142bfff640 1 -- 172.21.15.97:0/2627666443 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424007920 con 0x7f142c0688c0 2024-09-13T18:43:37.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.640+0000 7f1433857640 1 -- 172.21.15.97:0/2627666443 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f142c0688c0 msgr2=0x7f142c09d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.640+0000 7f1433857640 1 --2- 172.21.15.97:0/2627666443 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f142c0688c0 0x7f142c09d7c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1424009e60 tx=0x7f1424009780 comp rx=0 tx=0).stop 2024-09-13T18:43:37.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.640+0000 7f1433857640 1 -- 172.21.15.97:0/2627666443 shutdown_connections 2024-09-13T18:43:37.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.640+0000 7f1433857640 1 --2- 172.21.15.97:0/2627666443 >> v2:172.21.15.97:3300/0 conn(0x7f142c134740 0x7f142c136b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.640+0000 7f1433857640 1 --2- 172.21.15.97:0/2627666443 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f142c0688c0 0x7f142c09d7c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.640+0000 7f1433857640 1 -- 172.21.15.97:0/2627666443 >> 172.21.15.97:0/2627666443 conn(0x7f142c06f310 msgr2=0x7f142c0a29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:37.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.640+0000 7f1433857640 1 -- 172.21.15.97:0/2627666443 shutdown_connections 2024-09-13T18:43:37.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.640+0000 7f1433857640 1 -- 172.21.15.97:0/2627666443 wait complete. 2024-09-13T18:43:37.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f1433857640 1 Processor -- start 2024-09-13T18:43:37.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f1433857640 1 -- start start 2024-09-13T18:43:37.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f1433857640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f142c0688c0 0x7f142c11bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f1433857640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f142c09d2c0 0x7f142c119030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f1433857640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f142c134740 0x7f142c119570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f1433857640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c11b8f0 con 0x7f142c09d2c0 2024-09-13T18:43:37.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f1433857640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c136a40 con 0x7f142c0688c0 2024-09-13T18:43:37.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f1433857640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f142c12fe30 con 0x7f142c134740 2024-09-13T18:43:37.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f1430df2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f142c09d2c0 0x7f142c119030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f1431df4640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f142c134740 0x7f142c119570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f14315f3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f142c0688c0 0x7f142c11bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f1430df2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f142c09d2c0 0x7f142c119030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53856/0 (socket says 172.21.15.97:53856) 2024-09-13T18:43:37.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f1430df2640 1 -- 172.21.15.97:0/1659749899 learned_addr learned my addr 172.21.15.97:0/1659749899 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:37.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.641+0000 7f1431df4640 1 --2- 172.21.15.97:0/1659749899 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f142c134740 0x7f142c119570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:35856/0 (socket says 172.21.15.97:35856) 2024-09-13T18:43:37.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.642+0000 7f1430df2640 1 -- 172.21.15.97:0/1659749899 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f142c134740 msgr2=0x7f142c119570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.642+0000 7f1430df2640 1 --2- 172.21.15.97:0/1659749899 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f142c134740 0x7f142c119570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.642+0000 7f1430df2640 1 -- 172.21.15.97:0/1659749899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f142c0688c0 msgr2=0x7f142c11bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.642+0000 7f1430df2640 1 --2- 172.21.15.97:0/1659749899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f142c0688c0 0x7f142c11bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.642+0000 7f1430df2640 1 -- 172.21.15.97:0/1659749899 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c009390 con 0x7f142c09d2c0 2024-09-13T18:43:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.642+0000 7f1431df4640 1 --2- 172.21.15.97:0/1659749899 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f142c134740 0x7f142c119570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.642+0000 7f1430df2640 1 --2- 172.21.15.97:0/1659749899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f142c09d2c0 0x7f142c119030 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f142000c590 tx=0x7f1420007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.642+0000 7f14297fa640 1 -- 172.21.15.97:0/1659749899 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420005aa0 con 0x7f142c09d2c0 2024-09-13T18:43:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.642+0000 7f14297fa640 1 -- 172.21.15.97:0/1659749899 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1420005c20 con 0x7f142c09d2c0 2024-09-13T18:43:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.642+0000 7f14297fa640 1 -- 172.21.15.97:0/1659749899 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14200070d0 con 0x7f142c09d2c0 2024-09-13T18:43:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.642+0000 7f1433857640 1 -- 172.21.15.97:0/1659749899 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1424009a20 con 0x7f142c09d2c0 2024-09-13T18:43:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.642+0000 7f1433857640 1 -- 172.21.15.97:0/1659749899 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c09bb10 con 0x7f142c09d2c0 2024-09-13T18:43:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.643+0000 7f14297fa640 1 -- 172.21.15.97:0/1659749899 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f1420007520 con 0x7f142c09d2c0 2024-09-13T18:43:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.643+0000 7f14297fa640 1 -- 172.21.15.97:0/1659749899 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f14200418d0 con 0x7f142c09d2c0 2024-09-13T18:43:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.643+0000 7f1433857640 1 -- 172.21.15.97:0/1659749899 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142c11b6e0 con 0x7f142c09d2c0 2024-09-13T18:43:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.647+0000 7f14297fa640 1 -- 172.21.15.97:0/1659749899 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f142c11b6e0 con 0x7f142c09d2c0 2024-09-13T18:43:37.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.800+0000 7f1433857640 1 -- 172.21.15.97:0/1659749899 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f142c11b6e0 con 0x7f142c09d2c0 2024-09-13T18:43:37.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.801+0000 7f14297fa640 1 -- 172.21.15.97:0/1659749899 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f142c11b6e0 con 0x7f142c09d2c0 2024-09-13T18:43:37.804 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 8 2024-09-13T18:43:37.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.802+0000 7f1433857640 1 -- 172.21.15.97:0/1659749899 >> v1:172.21.15.97:6816/34603 conn(0x7f1418031160 legacy=0x7f1418033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.802+0000 7f1433857640 1 -- 172.21.15.97:0/1659749899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f142c09d2c0 msgr2=0x7f142c119030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.802+0000 7f1433857640 1 --2- 172.21.15.97:0/1659749899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f142c09d2c0 0x7f142c119030 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f142000c590 tx=0x7f1420007ee0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.803+0000 7f1433857640 1 -- 172.21.15.97:0/1659749899 shutdown_connections 2024-09-13T18:43:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.803+0000 7f1433857640 1 --2- 172.21.15.97:0/1659749899 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f142c134740 0x7f142c119570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.803+0000 7f1433857640 1 --2- 172.21.15.97:0/1659749899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f142c09d2c0 0x7f142c119030 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.803+0000 7f1433857640 1 --2- 172.21.15.97:0/1659749899 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f142c0688c0 0x7f142c11bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.803+0000 7f1433857640 1 -- 172.21.15.97:0/1659749899 >> 172.21.15.97:0/1659749899 conn(0x7f142c06f310 msgr2=0x7f142c133f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.803+0000 7f1433857640 1 -- 172.21.15.97:0/1659749899 shutdown_connections 2024-09-13T18:43:37.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.803+0000 7f1433857640 1 -- 172.21.15.97:0/1659749899 wait complete. 2024-09-13T18:43:37.816 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:43:37.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.910+0000 7f1d91d9d640 1 Processor -- start 2024-09-13T18:43:37.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.910+0000 7f1d91d9d640 1 -- start start 2024-09-13T18:43:37.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d91d9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1d8c067110 0x7f1d8c09a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d91d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d8c09ab50 0x7f1d8c12f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d91d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d8c09af20 0x7f1d8c12fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d91d9d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8c0674e0 con 0x7f1d8c09af20 2024-09-13T18:43:37.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d91d9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c09b640 con 0x7f1d8c09ab50 2024-09-13T18:43:37.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d91d9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c067b30 con 0x7f1d8c067110 2024-09-13T18:43:37.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d8affd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d8c09ab50 0x7f1d8c12f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d8bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d8c09af20 0x7f1d8c12fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d8affd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d8c09ab50 0x7f1d8c12f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:49240/0 (socket says 172.21.15.97:49240) 2024-09-13T18:43:37.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d8affd640 1 -- 172.21.15.97:0/1886041690 learned_addr learned my addr 172.21.15.97:0/1886041690 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:37.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d8bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d8c09af20 0x7f1d8c12fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53872/0 (socket says 172.21.15.97:53872) 2024-09-13T18:43:37.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d8b7fe640 1 --2- 172.21.15.97:0/1886041690 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1d8c067110 0x7f1d8c09a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d8affd640 1 -- 172.21.15.97:0/1886041690 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1d8c067110 msgr2=0x7f1d8c09a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:37.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d8affd640 1 --2- 172.21.15.97:0/1886041690 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1d8c067110 0x7f1d8c09a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d8affd640 1 -- 172.21.15.97:0/1886041690 >> v2:172.21.15.97:3300/0 conn(0x7f1d8c09af20 msgr2=0x7f1d8c12fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:37.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d8affd640 1 --2- 172.21.15.97:0/1886041690 >> v2:172.21.15.97:3300/0 conn(0x7f1d8c09af20 0x7f1d8c12fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d8affd640 1 -- 172.21.15.97:0/1886041690 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c067f20 con 0x7f1d8c09ab50 2024-09-13T18:43:37.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.911+0000 7f1d8bfff640 1 --2- 172.21.15.97:0/1886041690 >> v2:172.21.15.97:3300/0 conn(0x7f1d8c09af20 0x7f1d8c12fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:37.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.912+0000 7f1d8affd640 1 --2- 172.21.15.97:0/1886041690 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d8c09ab50 0x7f1d8c12f6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009910 tx=0x7f1d800091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a74eb9f7a612495 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:37.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.912+0000 7f1d8a7fc640 1 -- 172.21.15.97:0/1886041690 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8002ac80 con 0x7f1d8c09ab50 2024-09-13T18:43:37.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.912+0000 7f1d8a7fc640 1 -- 172.21.15.97:0/1886041690 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8002ade0 con 0x7f1d8c09ab50 2024-09-13T18:43:37.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.912+0000 7f1d8a7fc640 1 -- 172.21.15.97:0/1886041690 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80032670 con 0x7f1d8c09ab50 2024-09-13T18:43:37.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.912+0000 7f1d91d9d640 1 -- 172.21.15.97:0/1886041690 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d8c09ab50 msgr2=0x7f1d8c12f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.912+0000 7f1d91d9d640 1 --2- 172.21.15.97:0/1886041690 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d8c09ab50 0x7f1d8c12f6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009910 tx=0x7f1d800091d0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.912+0000 7f1d91d9d640 1 -- 172.21.15.97:0/1886041690 shutdown_connections 2024-09-13T18:43:37.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.912+0000 7f1d91d9d640 1 --2- 172.21.15.97:0/1886041690 >> v2:172.21.15.97:3300/0 conn(0x7f1d8c09af20 0x7f1d8c12fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.912+0000 7f1d91d9d640 1 --2- 172.21.15.97:0/1886041690 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d8c09ab50 0x7f1d8c12f6d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.912+0000 7f1d91d9d640 1 --2- 172.21.15.97:0/1886041690 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1d8c067110 0x7f1d8c09a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.913+0000 7f1d91d9d640 1 -- 172.21.15.97:0/1886041690 >> 172.21.15.97:0/1886041690 conn(0x7f1d8c09f790 msgr2=0x7f1d8c09fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:37.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.913+0000 7f1d91d9d640 1 -- 172.21.15.97:0/1886041690 shutdown_connections 2024-09-13T18:43:37.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.913+0000 7f1d91d9d640 1 -- 172.21.15.97:0/1886041690 wait complete. 2024-09-13T18:43:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.913+0000 7f1d91d9d640 1 Processor -- start 2024-09-13T18:43:37.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.913+0000 7f1d91d9d640 1 -- start start 2024-09-13T18:43:37.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d91d9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1d8c067110 0x7f1d8c11c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d91d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d8c09ab50 0x7f1d8c1328c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d91d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d8c09af20 0x7f1d8c132e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:37.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d91d9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c09bb10 con 0x7f1d8c09af20 2024-09-13T18:43:37.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d91d9d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c11bd40 con 0x7f1d8c09ab50 2024-09-13T18:43:37.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d91d9d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c11a460 con 0x7f1d8c067110 2024-09-13T18:43:37.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d8b7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1d8c067110 0x7f1d8c11c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d8b7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1d8c067110 0x7f1d8c11c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:35864/0 (socket says 172.21.15.97:35864) 2024-09-13T18:43:37.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d8affd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d8c09ab50 0x7f1d8c1328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d8bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d8c09af20 0x7f1d8c132e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:37.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d8b7fe640 1 -- 172.21.15.97:0/2721378190 learned_addr learned my addr 172.21.15.97:0/2721378190 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:37.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d8affd640 1 -- 172.21.15.97:0/2721378190 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1d8c067110 msgr2=0x7f1d8c11c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d8affd640 1 --2- 172.21.15.97:0/2721378190 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1d8c067110 0x7f1d8c11c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d8affd640 1 -- 172.21.15.97:0/2721378190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d8c09af20 msgr2=0x7f1d8c132e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d8affd640 1 --2- 172.21.15.97:0/2721378190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d8c09af20 0x7f1d8c132e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d8affd640 1 -- 172.21.15.97:0/2721378190 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d84009a20 con 0x7f1d8c09ab50 2024-09-13T18:43:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.914+0000 7f1d8affd640 1 --2- 172.21.15.97:0/2721378190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d8c09ab50 0x7f1d8c1328c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c097280 tx=0x7f1d80032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.915+0000 7f1d737fe640 1 -- 172.21.15.97:0/2721378190 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8002ac80 con 0x7f1d8c09ab50 2024-09-13T18:43:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.915+0000 7f1d737fe640 1 -- 172.21.15.97:0/2721378190 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8003d650 con 0x7f1d8c09ab50 2024-09-13T18:43:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.915+0000 7f1d91d9d640 1 -- 172.21.15.97:0/2721378190 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d80009450 con 0x7f1d8c09ab50 2024-09-13T18:43:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.915+0000 7f1d737fe640 1 -- 172.21.15.97:0/2721378190 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8003d9f0 con 0x7f1d8c09ab50 2024-09-13T18:43:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.915+0000 7f1d91d9d640 1 -- 172.21.15.97:0/2721378190 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c1323a0 con 0x7f1d8c09ab50 2024-09-13T18:43:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.915+0000 7f1d737fe640 1 -- 172.21.15.97:0/2721378190 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f1d80039040 con 0x7f1d8c09ab50 2024-09-13T18:43:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.916+0000 7f1d737fe640 1 -- 172.21.15.97:0/2721378190 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f1d800619f0 con 0x7f1d8c09ab50 2024-09-13T18:43:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.916+0000 7f1d91d9d640 1 -- 172.21.15.97:0/2721378190 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c133530 con 0x7f1d8c09ab50 2024-09-13T18:43:37.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:37.920+0000 7f1d737fe640 1 -- 172.21.15.97:0/2721378190 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f1d80037020 con 0x7f1d8c09ab50 2024-09-13T18:43:38.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.073+0000 7f1d91d9d640 1 -- 172.21.15.97:0/2721378190 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d8c064000 con 0x7f1d8c09ab50 2024-09-13T18:43:38.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.073+0000 7f1d737fe640 1 -- 172.21.15.97:0/2721378190 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d8004a0a0 con 0x7f1d8c09ab50 2024-09-13T18:43:38.076 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2024-09-13T18:43:38.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.075+0000 7f1d91d9d640 1 -- 172.21.15.97:0/2721378190 >> v1:172.21.15.97:6816/34603 conn(0x7f1d78031160 legacy=0x7f1d78033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:38.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.075+0000 7f1d91d9d640 1 -- 172.21.15.97:0/2721378190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d8c09ab50 msgr2=0x7f1d8c1328c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:38.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.075+0000 7f1d91d9d640 1 --2- 172.21.15.97:0/2721378190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d8c09ab50 0x7f1d8c1328c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c097280 tx=0x7f1d80032000 comp rx=0 tx=0).stop 2024-09-13T18:43:38.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.075+0000 7f1d91d9d640 1 -- 172.21.15.97:0/2721378190 shutdown_connections 2024-09-13T18:43:38.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.075+0000 7f1d91d9d640 1 --2- 172.21.15.97:0/2721378190 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d8c09af20 0x7f1d8c132e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.075+0000 7f1d91d9d640 1 --2- 172.21.15.97:0/2721378190 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1d8c09ab50 0x7f1d8c1328c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.075+0000 7f1d91d9d640 1 --2- 172.21.15.97:0/2721378190 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1d8c067110 0x7f1d8c11c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.075+0000 7f1d91d9d640 1 -- 172.21.15.97:0/2721378190 >> 172.21.15.97:0/2721378190 conn(0x7f1d8c09f790 msgr2=0x7f1d8c098a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:38.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.075+0000 7f1d91d9d640 1 -- 172.21.15.97:0/2721378190 shutdown_connections 2024-09-13T18:43:38.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.075+0000 7f1d91d9d640 1 -- 172.21.15.97:0/2721378190 wait complete. 2024-09-13T18:43:38.089 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:43:38.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.181+0000 7fbc55eef640 1 Processor -- start 2024-09-13T18:43:38.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.181+0000 7fbc55eef640 1 -- start start 2024-09-13T18:43:38.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc55eef640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbc5009af80 0x7fbc50135030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:38.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc55eef640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbc5009b380 0x7fbc50137580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:38.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc55eef640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc50096b70 con 0x7fbc50097580 2024-09-13T18:43:38.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc55eef640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc50069cd0 con 0x7fbc5009af80 2024-09-13T18:43:38.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc55eef640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50069fe0 con 0x7fbc5009b380 2024-09-13T18:43:38.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc4effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbc5009af80 0x7fbc50135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:38.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc4ffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbc5009b380 0x7fbc50137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:38.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc4effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbc5009af80 0x7fbc50135030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53886/0 (socket says 172.21.15.97:53886) 2024-09-13T18:43:38.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc4effd640 1 -- 172.21.15.97:0/1955034719 learned_addr learned my addr 172.21.15.97:0/1955034719 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:38.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc4f7fe640 1 --1- 172.21.15.97:0/1955034719 >> v1:172.21.15.97:6789/0 conn(0x7fbc50097580 0x7fbc5009a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42690/0 (socket says 172.21.15.97:42690) 2024-09-13T18:43:38.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc4effd640 1 -- 172.21.15.97:0/1955034719 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbc5009b380 msgr2=0x7fbc50137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:38.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc4effd640 1 --2- 172.21.15.97:0/1955034719 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbc5009b380 0x7fbc50137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc4effd640 1 -- 172.21.15.97:0/1955034719 >> v1:172.21.15.97:6789/0 conn(0x7fbc50097580 legacy=0x7fbc5009a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:38.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc4effd640 1 -- 172.21.15.97:0/1955034719 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc500970d0 con 0x7fbc5009af80 2024-09-13T18:43:38.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.182+0000 7fbc4e7fc640 1 -- 172.21.15.97:0/1955034719 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266053449 0 0) 0x7fbc50096b70 con 0x7fbc50097580 2024-09-13T18:43:38.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.183+0000 7fbc4effd640 1 --2- 172.21.15.97:0/1955034719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc5009af80 0x7fbc50135030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009940 tx=0x7fbc380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d6efa038c0bbe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:38.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.183+0000 7fbc4e7fc640 1 -- 172.21.15.97:0/1955034719 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3802adb0 con 0x7fbc5009af80 2024-09-13T18:43:38.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.183+0000 7fbc4e7fc640 1 -- 172.21.15.97:0/1955034719 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38032440 con 0x7fbc5009af80 2024-09-13T18:43:38.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.183+0000 7fbc4e7fc640 1 -- 172.21.15.97:0/1955034719 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380327e0 con 0x7fbc5009af80 2024-09-13T18:43:38.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.184+0000 7fbc55eef640 1 -- 172.21.15.97:0/1955034719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc5009af80 msgr2=0x7fbc50135030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:38.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.184+0000 7fbc55eef640 1 --2- 172.21.15.97:0/1955034719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc5009af80 0x7fbc50135030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009940 tx=0x7fbc380091d0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.184+0000 7fbc55eef640 1 -- 172.21.15.97:0/1955034719 shutdown_connections 2024-09-13T18:43:38.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.184+0000 7fbc55eef640 1 --2- 172.21.15.97:0/1955034719 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc5009af80 0x7fbc50135030 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.184+0000 7fbc55eef640 1 --2- 172.21.15.97:0/1955034719 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbc5009b380 0x7fbc50137580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.184+0000 7fbc55eef640 1 -- 172.21.15.97:0/1955034719 >> 172.21.15.97:0/1955034719 conn(0x7fbc5009f910 msgr2=0x7fbc5009b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.184+0000 7fbc55eef640 1 -- 172.21.15.97:0/1955034719 shutdown_connections 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.184+0000 7fbc55eef640 1 -- 172.21.15.97:0/1955034719 wait complete. 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.185+0000 7fbc55eef640 1 Processor -- start 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.185+0000 7fbc55eef640 1 -- start start 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.185+0000 7fbc55eef640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbc50097580 0x7fbc500905e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.185+0000 7fbc55eef640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc5009af80 0x7fbc50090b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.185+0000 7fbc55eef640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc5009b380 0x7fbc50091060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.185+0000 7fbc55eef640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50093670 con 0x7fbc5009af80 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.185+0000 7fbc55eef640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5006f230 con 0x7fbc5009b380 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.185+0000 7fbc55eef640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50094aa0 con 0x7fbc50097580 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.185+0000 7fbc4f7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbc50097580 0x7fbc500905e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.185+0000 7fbc4effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc5009af80 0x7fbc50090b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.185+0000 7fbc4f7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbc50097580 0x7fbc500905e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:35892/0 (socket says 172.21.15.97:35892) 2024-09-13T18:43:38.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.185+0000 7fbc4f7fe640 1 -- 172.21.15.97:0/3094121724 learned_addr learned my addr 172.21.15.97:0/3094121724 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.185+0000 7fbc4ffff640 1 --2- 172.21.15.97:0/3094121724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc5009b380 0x7fbc50091060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.186+0000 7fbc4effd640 1 -- 172.21.15.97:0/3094121724 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbc50097580 msgr2=0x7fbc500905e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.186+0000 7fbc4effd640 1 --2- 172.21.15.97:0/3094121724 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbc50097580 0x7fbc500905e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.186+0000 7fbc4effd640 1 -- 172.21.15.97:0/3094121724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc5009b380 msgr2=0x7fbc50091060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.186+0000 7fbc4effd640 1 --2- 172.21.15.97:0/3094121724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc5009b380 0x7fbc50091060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.186+0000 7fbc4effd640 1 -- 172.21.15.97:0/3094121724 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38009450 con 0x7fbc5009af80 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.186+0000 7fbc4f7fe640 1 --2- 172.21.15.97:0/3094121724 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbc50097580 0x7fbc500905e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.186+0000 7fbc4effd640 1 --2- 172.21.15.97:0/3094121724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc5009af80 0x7fbc50090b20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbc50069ba0 tx=0x7fbc38032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.186+0000 7fbc477fe640 1 -- 172.21.15.97:0/3094121724 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38000d10 con 0x7fbc5009af80 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.186+0000 7fbc477fe640 1 -- 172.21.15.97:0/3094121724 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38031de0 con 0x7fbc5009af80 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.186+0000 7fbc55eef640 1 -- 172.21.15.97:0/3094121724 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc50099060 con 0x7fbc5009af80 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.186+0000 7fbc477fe640 1 -- 172.21.15.97:0/3094121724 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3803d6b0 con 0x7fbc5009af80 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.186+0000 7fbc55eef640 1 -- 172.21.15.97:0/3094121724 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc50092730 con 0x7fbc5009af80 2024-09-13T18:43:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.187+0000 7fbc477fe640 1 -- 172.21.15.97:0/3094121724 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fbc38039040 con 0x7fbc5009af80 2024-09-13T18:43:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.187+0000 7fbc477fe640 1 -- 172.21.15.97:0/3094121724 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fbc38062160 con 0x7fbc5009af80 2024-09-13T18:43:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.187+0000 7fbc55eef640 1 -- 172.21.15.97:0/3094121724 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc50096d00 con 0x7fbc5009af80 2024-09-13T18:43:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.191+0000 7fbc477fe640 1 -- 172.21.15.97:0/3094121724 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fbc38037020 con 0x7fbc5009af80 2024-09-13T18:43:38.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.343+0000 7fbc55eef640 1 -- 172.21.15.97:0/3094121724 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc500714b0 con 0x7fbc5009af80 2024-09-13T18:43:38.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.343+0000 7fbc477fe640 1 -- 172.21.15.97:0/3094121724 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc3803a390 con 0x7fbc5009af80 2024-09-13T18:43:38.346 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2024-09-13T18:43:38.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.345+0000 7fbc55eef640 1 -- 172.21.15.97:0/3094121724 >> v1:172.21.15.97:6816/34603 conn(0x7fbc30031160 legacy=0x7fbc30033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:38.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.345+0000 7fbc55eef640 1 -- 172.21.15.97:0/3094121724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc5009af80 msgr2=0x7fbc50090b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:38.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.345+0000 7fbc55eef640 1 --2- 172.21.15.97:0/3094121724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc5009af80 0x7fbc50090b20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbc50069ba0 tx=0x7fbc38032000 comp rx=0 tx=0).stop 2024-09-13T18:43:38.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.345+0000 7fbc55eef640 1 -- 172.21.15.97:0/3094121724 shutdown_connections 2024-09-13T18:43:38.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.345+0000 7fbc55eef640 1 --2- 172.21.15.97:0/3094121724 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbc5009b380 0x7fbc50091060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.345+0000 7fbc55eef640 1 --2- 172.21.15.97:0/3094121724 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbc5009af80 0x7fbc50090b20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.345+0000 7fbc55eef640 1 --2- 172.21.15.97:0/3094121724 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbc50097580 0x7fbc500905e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.345+0000 7fbc55eef640 1 -- 172.21.15.97:0/3094121724 >> 172.21.15.97:0/3094121724 conn(0x7fbc5009f910 msgr2=0x7fbc50099840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:38.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.345+0000 7fbc55eef640 1 -- 172.21.15.97:0/3094121724 shutdown_connections 2024-09-13T18:43:38.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.345+0000 7fbc55eef640 1 -- 172.21.15.97:0/3094121724 wait complete. 2024-09-13T18:43:38.359 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:43:38.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.450+0000 7fe8e659d640 1 Processor -- start 2024-09-13T18:43:38.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.450+0000 7fe8e659d640 1 -- start start 2024-09-13T18:43:38.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e659d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe8e00a32b0 0x7fe8e012f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:38.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e659d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8e012fed0 0x7fe8e0068970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:38.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e659d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 0x7fe8e0069330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:38.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e659d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e0096b70 con 0x7fe8e00a32b0 2024-09-13T18:43:38.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e659d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00a3680 con 0x7fe8e012fed0 2024-09-13T18:43:38.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e659d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e0097460 con 0x7fe8e0068eb0 2024-09-13T18:43:38.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e4b3a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 0x7fe8e0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:38.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8df7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8e012fed0 0x7fe8e0068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:38.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8dffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe8e00a32b0 0x7fe8e012f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:38.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e4b3a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 0x7fe8e0069330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:35898/0 (socket says 172.21.15.97:35898) 2024-09-13T18:43:38.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8df7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8e012fed0 0x7fe8e0068970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:49260/0 (socket says 172.21.15.97:49260) 2024-09-13T18:43:38.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e4b3a640 1 -- 172.21.15.97:0/678409843 learned_addr learned my addr 172.21.15.97:0/678409843 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:38.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e4b3a640 1 -- 172.21.15.97:0/678409843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8e012fed0 msgr2=0x7fe8e0068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:38.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e4b3a640 1 --2- 172.21.15.97:0/678409843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8e012fed0 0x7fe8e0068970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e4b3a640 1 -- 172.21.15.97:0/678409843 >> v2:172.21.15.97:3300/0 conn(0x7fe8e00a32b0 msgr2=0x7fe8e012f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:38.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e4b3a640 1 --2- 172.21.15.97:0/678409843 >> v2:172.21.15.97:3300/0 conn(0x7fe8e00a32b0 0x7fe8e012f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8e4b3a640 1 -- 172.21.15.97:0/678409843 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e01302c0 con 0x7fe8e0068eb0 2024-09-13T18:43:38.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8dffff640 1 --2- 172.21.15.97:0/678409843 >> v2:172.21.15.97:3300/0 conn(0x7fe8e00a32b0 0x7fe8e012f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:38.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.451+0000 7fe8df7fe640 1 --2- 172.21.15.97:0/678409843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8e012fed0 0x7fe8e0068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:38.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.452+0000 7fe8e4b3a640 1 --2- 172.21.15.97:0/678409843 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 0x7fe8e0069330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009f20 tx=0x7fe8d8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4fb6ff65afbf587 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:38.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.452+0000 7fe8deffd640 1 -- 172.21.15.97:0/678409843 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8031400 con 0x7fe8e0068eb0 2024-09-13T18:43:38.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.452+0000 7fe8deffd640 1 -- 172.21.15.97:0/678409843 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d802d050 con 0x7fe8e0068eb0 2024-09-13T18:43:38.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.452+0000 7fe8deffd640 1 -- 172.21.15.97:0/678409843 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8031790 con 0x7fe8e0068eb0 2024-09-13T18:43:38.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.453+0000 7fe8e659d640 1 -- 172.21.15.97:0/678409843 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 msgr2=0x7fe8e0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:38.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.453+0000 7fe8e659d640 1 --2- 172.21.15.97:0/678409843 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 0x7fe8e0069330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009f20 tx=0x7fe8d8009840 comp rx=0 tx=0).stop 2024-09-13T18:43:38.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.453+0000 7fe8e659d640 1 -- 172.21.15.97:0/678409843 shutdown_connections 2024-09-13T18:43:38.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.453+0000 7fe8e659d640 1 --2- 172.21.15.97:0/678409843 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 0x7fe8e0069330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.453+0000 7fe8e659d640 1 --2- 172.21.15.97:0/678409843 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8e012fed0 0x7fe8e0068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.453+0000 7fe8e659d640 1 --2- 172.21.15.97:0/678409843 >> v2:172.21.15.97:3300/0 conn(0x7fe8e00a32b0 0x7fe8e012f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.453+0000 7fe8e659d640 1 -- 172.21.15.97:0/678409843 >> 172.21.15.97:0/678409843 conn(0x7fe8e006eef0 msgr2=0x7fe8e00a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:38.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.453+0000 7fe8e659d640 1 -- 172.21.15.97:0/678409843 shutdown_connections 2024-09-13T18:43:38.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.453+0000 7fe8e659d640 1 -- 172.21.15.97:0/678409843 wait complete. 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.454+0000 7fe8e659d640 1 Processor -- start 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.454+0000 7fe8e659d640 1 -- start start 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.454+0000 7fe8e659d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 0x7fe8e012c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.454+0000 7fe8e659d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8e00a32b0 0x7fe8e012c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.454+0000 7fe8e659d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8e012fed0 0x7fe8e011b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.454+0000 7fe8e659d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00a27a0 con 0x7fe8e00a32b0 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.454+0000 7fe8e659d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e009e710 con 0x7fe8e012fed0 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.454+0000 7fe8e659d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e011ea90 con 0x7fe8e0068eb0 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.454+0000 7fe8dffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 0x7fe8e012c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.454+0000 7fe8dffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 0x7fe8e012c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:35910/0 (socket says 172.21.15.97:35910) 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.454+0000 7fe8dffff640 1 -- 172.21.15.97:0/4073400440 learned_addr learned my addr 172.21.15.97:0/4073400440 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.454+0000 7fe8df7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8e00a32b0 0x7fe8e012c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.454+0000 7fe8e4b3a640 1 --2- 172.21.15.97:0/4073400440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8e012fed0 0x7fe8e011b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:38.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.455+0000 7fe8dffff640 1 -- 172.21.15.97:0/4073400440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8e012fed0 msgr2=0x7fe8e011b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:38.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.455+0000 7fe8dffff640 1 --2- 172.21.15.97:0/4073400440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8e012fed0 0x7fe8e011b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.455+0000 7fe8dffff640 1 -- 172.21.15.97:0/4073400440 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8e00a32b0 msgr2=0x7fe8e012c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:38.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.455+0000 7fe8dffff640 1 --2- 172.21.15.97:0/4073400440 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8e00a32b0 0x7fe8e012c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.455+0000 7fe8dffff640 1 -- 172.21.15.97:0/4073400440 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0009390 con 0x7fe8e0068eb0 2024-09-13T18:43:38.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.455+0000 7fe8df7fe640 1 --2- 172.21.15.97:0/4073400440 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8e00a32b0 0x7fe8e012c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:38.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.455+0000 7fe8dffff640 1 --2- 172.21.15.97:0/4073400440 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 0x7fe8e012c1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000ec80 tx=0x7fe8d00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:38.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.455+0000 7fe8d7fff640 1 -- 172.21.15.97:0/4073400440 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000eec0 con 0x7fe8e0068eb0 2024-09-13T18:43:38.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.455+0000 7fe8d7fff640 1 -- 172.21.15.97:0/4073400440 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d000cbc0 con 0x7fe8e0068eb0 2024-09-13T18:43:38.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.455+0000 7fe8e659d640 1 -- 172.21.15.97:0/4073400440 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c8009390 con 0x7fe8e0068eb0 2024-09-13T18:43:38.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.455+0000 7fe8d7fff640 1 -- 172.21.15.97:0/4073400440 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0013470 con 0x7fe8e0068eb0 2024-09-13T18:43:38.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.455+0000 7fe8e659d640 1 -- 172.21.15.97:0/4073400440 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d8009ae0 con 0x7fe8e0068eb0 2024-09-13T18:43:38.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.456+0000 7fe8d7fff640 1 -- 172.21.15.97:0/4073400440 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fe8d00137e0 con 0x7fe8e0068eb0 2024-09-13T18:43:38.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.456+0000 7fe8d7fff640 1 -- 172.21.15.97:0/4073400440 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fe8d0042530 con 0x7fe8e0068eb0 2024-09-13T18:43:38.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.456+0000 7fe8e659d640 1 -- 172.21.15.97:0/4073400440 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e0064000 con 0x7fe8e0068eb0 2024-09-13T18:43:38.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.460+0000 7fe8d7fff640 1 -- 172.21.15.97:0/4073400440 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fe8d0021020 con 0x7fe8e0068eb0 2024-09-13T18:43:38.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.628+0000 7fe8e659d640 1 -- 172.21.15.97:0/4073400440 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe8e005e0b0 con 0x7fe8e0068eb0 2024-09-13T18:43:38.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.628+0000 7fe8d7fff640 1 -- 172.21.15.97:0/4073400440 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe8d0023ad0 con 0x7fe8e0068eb0 2024-09-13T18:43:38.631 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2024-09-13T18:43:38.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.630+0000 7fe8e659d640 1 -- 172.21.15.97:0/4073400440 >> v1:172.21.15.97:6816/34603 conn(0x7fe8c0031160 legacy=0x7fe8c0033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:38.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.630+0000 7fe8e659d640 1 -- 172.21.15.97:0/4073400440 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 msgr2=0x7fe8e012c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:38.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.630+0000 7fe8e659d640 1 --2- 172.21.15.97:0/4073400440 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 0x7fe8e012c1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000ec80 tx=0x7fe8d00090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.630+0000 7fe8e659d640 1 -- 172.21.15.97:0/4073400440 shutdown_connections 2024-09-13T18:43:38.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.630+0000 7fe8e659d640 1 --2- 172.21.15.97:0/4073400440 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe8e012fed0 0x7fe8e011b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.630+0000 7fe8e659d640 1 --2- 172.21.15.97:0/4073400440 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe8e00a32b0 0x7fe8e012c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.630+0000 7fe8e659d640 1 --2- 172.21.15.97:0/4073400440 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe8e0068eb0 0x7fe8e012c1a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.630+0000 7fe8e659d640 1 -- 172.21.15.97:0/4073400440 >> 172.21.15.97:0/4073400440 conn(0x7fe8e006eef0 msgr2=0x7fe8e00a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.630+0000 7fe8e659d640 1 -- 172.21.15.97:0/4073400440 shutdown_connections 2024-09-13T18:43:38.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:38.630+0000 7fe8e659d640 1 -- 172.21.15.97:0/4073400440 wait complete. 2024-09-13T18:43:38.643 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi142.front.sepia.ceph.com... 2024-09-13T18:43:38.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:38.644 DEBUG:teuthology.orchestra.run.smithi142:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:43:38.674 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi142.stderr:ceph-fuse[30428]: fuse finished with error 0 and tester_r 0 2024-09-13T18:43:38.675 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:43:44.777 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-09-13T18:43:44.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:44.777 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:43:44.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:44.797 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-13T18:43:44.856 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:43:44.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:44.856 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:43:44.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:44.925 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-09-13T18:43:45.031 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2024-09-13T18:43:45.041 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T18:43:45.058 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T18:43:45.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:45.059 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-13T18:43:45.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:45.075 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-09-13T18:43:45.143 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-09-13T18:43:45.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:43:45.145 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T18:43:45.157 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T18:43:45.157 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T18:43:45.157 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:45.201 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16093 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 2024-09-13T18:43:45.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:45.202 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-13T18:43:45.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:45.257 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-09-13T18:43:45.323 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-09-13T18:43:45.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:43:45.325 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T18:43:45.335 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:43:45.335 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:43:45.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.437+0000 7fa1d8f1d640 1 Processor -- start 2024-09-13T18:43:45.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d8f1d640 1 -- start start 2024-09-13T18:43:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d8f1d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d409dfb0 0x7fa1d4096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d8f1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1d40969d0 0x7fa1d40974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d8f1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa1d412bf70 0x7fa1d412c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d8f1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d409e380 con 0x7fa1d412bf70 2024-09-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d8f1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d406a190 con 0x7fa1d40969d0 2024-09-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d8f1d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d4098870 con 0x7fa1d409dfb0 2024-09-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d2d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa1d412bf70 0x7fa1d412c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d1d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1d40969d0 0x7fa1d40974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d259c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d409dfb0 0x7fa1d4096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d1d9b640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1d40969d0 0x7fa1d40974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:49286/0 (socket says 172.21.15.97:49286) 2024-09-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d2d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa1d412bf70 0x7fa1d412c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53908/0 (socket says 172.21.15.97:53908) 2024-09-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d1d9b640 1 -- 172.21.15.97:0/1621733184 learned_addr learned my addr 172.21.15.97:0/1621733184 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.438+0000 7fa1d259c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d409dfb0 0x7fa1d4096f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:35916/0 (socket says 172.21.15.97:35916) 2024-09-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.439+0000 7fa1d2d9d640 1 -- 172.21.15.97:0/1621733184 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d409dfb0 msgr2=0x7fa1d4096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:45.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.439+0000 7fa1d2d9d640 1 --2- 172.21.15.97:0/1621733184 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d409dfb0 0x7fa1d4096f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.439+0000 7fa1d2d9d640 1 -- 172.21.15.97:0/1621733184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1d40969d0 msgr2=0x7fa1d40974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:45.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.439+0000 7fa1d2d9d640 1 --2- 172.21.15.97:0/1621733184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1d40969d0 0x7fa1d40974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.439+0000 7fa1d2d9d640 1 -- 172.21.15.97:0/1621733184 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d4098e10 con 0x7fa1d412bf70 2024-09-13T18:43:45.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.439+0000 7fa1d259c640 1 --2- 172.21.15.97:0/1621733184 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d409dfb0 0x7fa1d4096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:45.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.439+0000 7fa1d1d9b640 1 --2- 172.21.15.97:0/1621733184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1d40969d0 0x7fa1d40974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:45.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.439+0000 7fa1d2d9d640 1 --2- 172.21.15.97:0/1621733184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1d412bf70 0x7fa1d412c410 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009e60 tx=0x7fa1cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580c7790d4cb23d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:45.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.440+0000 7fa1d159a640 1 -- 172.21.15.97:0/1621733184 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc007550 con 0x7fa1d412bf70 2024-09-13T18:43:45.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.440+0000 7fa1d159a640 1 -- 172.21.15.97:0/1621733184 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc02d050 con 0x7fa1d412bf70 2024-09-13T18:43:45.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.440+0000 7fa1d159a640 1 -- 172.21.15.97:0/1621733184 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0078e0 con 0x7fa1d412bf70 2024-09-13T18:43:45.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.440+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/1621733184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1d412bf70 msgr2=0x7fa1d412c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:45.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.440+0000 7fa1d8f1d640 1 --2- 172.21.15.97:0/1621733184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1d412bf70 0x7fa1d412c410 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009e60 tx=0x7fa1cc009780 comp rx=0 tx=0).stop 2024-09-13T18:43:45.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.440+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/1621733184 shutdown_connections 2024-09-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.440+0000 7fa1d8f1d640 1 --2- 172.21.15.97:0/1621733184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1d412bf70 0x7fa1d412c410 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.440+0000 7fa1d8f1d640 1 --2- 172.21.15.97:0/1621733184 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1d40969d0 0x7fa1d40974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.440+0000 7fa1d8f1d640 1 --2- 172.21.15.97:0/1621733184 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d409dfb0 0x7fa1d4096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.440+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/1621733184 >> 172.21.15.97:0/1621733184 conn(0x7fa1d409b200 msgr2=0x7fa1d409b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.440+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/1621733184 shutdown_connections 2024-09-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.440+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/1621733184 wait complete. 2024-09-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.441+0000 7fa1d8f1d640 1 Processor -- start 2024-09-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.441+0000 7fa1d8f1d640 1 -- start start 2024-09-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d8f1d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d40969d0 0x7fa1d411ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d8f1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1d409dfb0 0x7fa1d411b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d8f1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1d412bf70 0x7fa1d411b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d8f1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d4097e10 con 0x7fa1d409dfb0 2024-09-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d8f1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d411a8f0 con 0x7fa1d412bf70 2024-09-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d8f1d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d411ca30 con 0x7fa1d40969d0 2024-09-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d259c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d40969d0 0x7fa1d411ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d259c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d40969d0 0x7fa1d411ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:35924/0 (socket says 172.21.15.97:35924) 2024-09-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d1d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1d409dfb0 0x7fa1d411b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d259c640 1 -- 172.21.15.97:0/134685214 learned_addr learned my addr 172.21.15.97:0/134685214 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d2d9d640 1 --2- 172.21.15.97:0/134685214 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1d412bf70 0x7fa1d411b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d259c640 1 -- 172.21.15.97:0/134685214 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1d412bf70 msgr2=0x7fa1d411b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d259c640 1 --2- 172.21.15.97:0/134685214 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1d412bf70 0x7fa1d411b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d259c640 1 -- 172.21.15.97:0/134685214 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1d409dfb0 msgr2=0x7fa1d411b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d259c640 1 --2- 172.21.15.97:0/134685214 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1d409dfb0 0x7fa1d411b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d259c640 1 -- 172.21.15.97:0/134685214 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c4009450 con 0x7fa1d40969d0 2024-09-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d1d9b640 1 --2- 172.21.15.97:0/134685214 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1d409dfb0 0x7fa1d411b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d259c640 1 --2- 172.21.15.97:0/134685214 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d40969d0 0x7fa1d411ab40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00ecb0 tx=0x7fa1bc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:45.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1ca7fc640 1 -- 172.21.15.97:0/134685214 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc00cbc0 con 0x7fa1d40969d0 2024-09-13T18:43:45.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1ca7fc640 1 -- 172.21.15.97:0/134685214 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1bc00cd20 con 0x7fa1d40969d0 2024-09-13T18:43:45.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1ca7fc640 1 -- 172.21.15.97:0/134685214 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc0136a0 con 0x7fa1d40969d0 2024-09-13T18:43:45.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/134685214 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc009390 con 0x7fa1d40969d0 2024-09-13T18:43:45.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.442+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/134685214 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1cc009a20 con 0x7fa1d40969d0 2024-09-13T18:43:45.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.443+0000 7fa1ca7fc640 1 -- 172.21.15.97:0/134685214 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fa1bc013a10 con 0x7fa1d40969d0 2024-09-13T18:43:45.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.443+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/134685214 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d4064000 con 0x7fa1d40969d0 2024-09-13T18:43:45.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.443+0000 7fa1ca7fc640 1 -- 172.21.15.97:0/134685214 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fa1bc0424f0 con 0x7fa1d40969d0 2024-09-13T18:43:45.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.448+0000 7fa1ca7fc640 1 -- 172.21.15.97:0/134685214 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fa1bc013cc0 con 0x7fa1d40969d0 2024-09-13T18:43:45.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.600+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/134685214 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1d411d700 con 0x7fa1b4031160 2024-09-13T18:43:45.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.606+0000 7fa1ca7fc640 1 -- 172.21.15.97:0/134685214 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277541 (unknown 2965378022 0 1225159791) 0x7fa1c4009cf0 con 0x7fa1b4031160 2024-09-13T18:43:45.612 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:43:45.614 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:43:45.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.609+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/134685214 >> v1:172.21.15.97:6816/34603 conn(0x7fa1b4031160 legacy=0x7fa1b4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:45.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.609+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/134685214 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d40969d0 msgr2=0x7fa1d411ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:45.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.609+0000 7fa1d8f1d640 1 --2- 172.21.15.97:0/134685214 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d40969d0 0x7fa1d411ab40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00ecb0 tx=0x7fa1bc0090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.609+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/134685214 shutdown_connections 2024-09-13T18:43:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.609+0000 7fa1d8f1d640 1 --2- 172.21.15.97:0/134685214 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa1d412bf70 0x7fa1d411b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.609+0000 7fa1d8f1d640 1 --2- 172.21.15.97:0/134685214 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1d409dfb0 0x7fa1d411b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.609+0000 7fa1d8f1d640 1 --2- 172.21.15.97:0/134685214 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa1d40969d0 0x7fa1d411ab40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.609+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/134685214 >> 172.21.15.97:0/134685214 conn(0x7fa1d409b200 msgr2=0x7fa1d406d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.609+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/134685214 shutdown_connections 2024-09-13T18:43:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.609+0000 7fa1d8f1d640 1 -- 172.21.15.97:0/134685214 wait complete. 2024-09-13T18:43:45.622 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-13T18:43:45.412612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":789879,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":60,"num_read_kb":50,"num_write":9457,"num_write_kb":25167188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9924,"ondisk_log_size":9924,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1225076,"kb_used_data":2388,"kb_used_omap":6,"kb_used_meta":1222649,"kb_avail":376262284,"statfs":{"total":386547056640,"available":385292578816,"internally_reserved":0,"allocated":2445312,"data_stored":1850528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1251992928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,4,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737399423,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2577,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002908"},"pg_stats":[{"pgid":"4.3f","version":"23'146","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719578+0000","last_change":"2024-09-13T18:39:14.592723+0000","last_active":"2024-09-13T18:43:38.719578+0000","last_peered":"2024-09-13T18:43:38.719578+0000","last_clean":"2024-09-13T18:43:38.719578+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:43:38.719578+0000","last_undegraded":"2024-09-13T18:43:38.719578+0000","last_fullsized":"2024-09-13T18:43:38.719578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:09.304808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'130","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727590+0000","last_change":"2024-09-13T18:39:14.581266+0000","last_active":"2024-09-13T18:43:38.727590+0000","last_peered":"2024-09-13T18:43:38.727590+0000","last_clean":"2024-09-13T18:43:38.727590+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:43:38.727590+0000","last_undegraded":"2024-09-13T18:43:38.727590+0000","last_fullsized":"2024-09-13T18:43:38.727590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.732104+0000","last_change":"2024-09-13T18:39:14.586254+0000","last_active":"2024-09-13T18:43:38.732104+0000","last_peered":"2024-09-13T18:43:38.732104+0000","last_clean":"2024-09-13T18:43:38.732104+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:43:38.732104+0000","last_undegraded":"2024-09-13T18:43:38.732104+0000","last_fullsized":"2024-09-13T18:43:38.732104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"23'173","reported_seq":185,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.733542+0000","last_change":"2024-09-13T18:39:14.583960+0000","last_active":"2024-09-13T18:43:38.733542+0000","last_peered":"2024-09-13T18:43:38.733542+0000","last_clean":"2024-09-13T18:43:38.733542+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:43:38.733542+0000","last_undegraded":"2024-09-13T18:43:38.733542+0000","last_fullsized":"2024-09-13T18:43:38.733542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"23'148","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727037+0000","last_change":"2024-09-13T18:39:14.577865+0000","last_active":"2024-09-13T18:43:38.727037+0000","last_peered":"2024-09-13T18:43:38.727037+0000","last_clean":"2024-09-13T18:43:38.727037+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:43:38.727037+0000","last_undegraded":"2024-09-13T18:43:38.727037+0000","last_fullsized":"2024-09-13T18:43:38.727037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'135","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.729288+0000","last_change":"2024-09-13T18:39:14.590785+0000","last_active":"2024-09-13T18:43:38.729288+0000","last_peered":"2024-09-13T18:43:38.729288+0000","last_clean":"2024-09-13T18:43:38.729288+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:43:38.729288+0000","last_undegraded":"2024-09-13T18:43:38.729288+0000","last_fullsized":"2024-09-13T18:43:38.729288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:24.453184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'164","reported_seq":176,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734491+0000","last_change":"2024-09-13T18:39:14.590893+0000","last_active":"2024-09-13T18:43:38.734491+0000","last_peered":"2024-09-13T18:43:38.734491+0000","last_clean":"2024-09-13T18:43:38.734491+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:43:38.734491+0000","last_undegraded":"2024-09-13T18:43:38.734491+0000","last_fullsized":"2024-09-13T18:43:38.734491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:57.986187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'186","reported_seq":198,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717710+0000","last_change":"2024-09-13T18:39:14.595160+0000","last_active":"2024-09-13T18:43:38.717710+0000","last_peered":"2024-09-13T18:43:38.717710+0000","last_clean":"2024-09-13T18:43:38.717710+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:43:38.717710+0000","last_undegraded":"2024-09-13T18:43:38.717710+0000","last_fullsized":"2024-09-13T18:43:38.717710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"23'152","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.722317+0000","last_change":"2024-09-13T18:39:14.586790+0000","last_active":"2024-09-13T18:43:38.722317+0000","last_peered":"2024-09-13T18:43:38.722317+0000","last_clean":"2024-09-13T18:43:38.722317+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:43:38.722317+0000","last_undegraded":"2024-09-13T18:43:38.722317+0000","last_fullsized":"2024-09-13T18:43:38.722317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:49.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'156","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736032+0000","last_change":"2024-09-13T18:39:14.591231+0000","last_active":"2024-09-13T18:43:38.736032+0000","last_peered":"2024-09-13T18:43:38.736032+0000","last_clean":"2024-09-13T18:43:38.736032+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:43:38.736032+0000","last_undegraded":"2024-09-13T18:43:38.736032+0000","last_fullsized":"2024-09-13T18:43:38.736032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"23'189","reported_seq":201,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730161+0000","last_change":"2024-09-13T18:39:14.589017+0000","last_active":"2024-09-13T18:43:38.730161+0000","last_peered":"2024-09-13T18:43:38.730161+0000","last_clean":"2024-09-13T18:43:38.730161+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:43:38.730161+0000","last_undegraded":"2024-09-13T18:43:38.730161+0000","last_fullsized":"2024-09-13T18:43:38.730161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"23'142","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.715282+0000","last_change":"2024-09-13T18:39:14.592629+0000","last_active":"2024-09-13T18:43:38.715282+0000","last_peered":"2024-09-13T18:43:38.715282+0000","last_clean":"2024-09-13T18:43:38.715282+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:43:38.715282+0000","last_undegraded":"2024-09-13T18:43:38.715282+0000","last_fullsized":"2024-09-13T18:43:38.715282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738828+0000","last_change":"2024-09-13T18:39:14.597709+0000","last_active":"2024-09-13T18:43:38.738828+0000","last_peered":"2024-09-13T18:43:38.738828+0000","last_clean":"2024-09-13T18:43:38.738828+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:43:38.738828+0000","last_undegraded":"2024-09-13T18:43:38.738828+0000","last_fullsized":"2024-09-13T18:43:38.738828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.367739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'149","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731243+0000","last_change":"2024-09-13T18:39:14.572267+0000","last_active":"2024-09-13T18:43:38.731243+0000","last_peered":"2024-09-13T18:43:38.731243+0000","last_clean":"2024-09-13T18:43:38.731243+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:43:38.731243+0000","last_undegraded":"2024-09-13T18:43:38.731243+0000","last_fullsized":"2024-09-13T18:43:38.731243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.728216+0000","last_change":"2024-09-13T18:39:14.583318+0000","last_active":"2024-09-13T18:43:38.728216+0000","last_peered":"2024-09-13T18:43:38.728216+0000","last_clean":"2024-09-13T18:43:38.728216+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:43:38.728216+0000","last_undegraded":"2024-09-13T18:43:38.728216+0000","last_fullsized":"2024-09-13T18:43:38.728216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"23'147","reported_seq":159,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741185+0000","last_change":"2024-09-13T18:39:14.592378+0000","last_active":"2024-09-13T18:43:38.741185+0000","last_peered":"2024-09-13T18:43:38.741185+0000","last_clean":"2024-09-13T18:43:38.741185+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:43:38.741185+0000","last_undegraded":"2024-09-13T18:43:38.741185+0000","last_fullsized":"2024-09-13T18:43:38.741185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:02.414361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'146","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.721992+0000","last_change":"2024-09-13T18:39:14.586945+0000","last_active":"2024-09-13T18:43:38.721992+0000","last_peered":"2024-09-13T18:43:38.721992+0000","last_clean":"2024-09-13T18:43:38.721992+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:43:38.721992+0000","last_undegraded":"2024-09-13T18:43:38.721992+0000","last_fullsized":"2024-09-13T18:43:38.721992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:57.889039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'157","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734859+0000","last_change":"2024-09-13T18:39:14.587172+0000","last_active":"2024-09-13T18:43:38.734859+0000","last_peered":"2024-09-13T18:43:38.734859+0000","last_clean":"2024-09-13T18:43:38.734859+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:43:38.734859+0000","last_undegraded":"2024-09-13T18:43:38.734859+0000","last_fullsized":"2024-09-13T18:43:38.734859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"23'172","reported_seq":184,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719162+0000","last_change":"2024-09-13T18:39:14.594291+0000","last_active":"2024-09-13T18:43:38.719162+0000","last_peered":"2024-09-13T18:43:38.719162+0000","last_clean":"2024-09-13T18:43:38.719162+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:43:38.719162+0000","last_undegraded":"2024-09-13T18:43:38.719162+0000","last_fullsized":"2024-09-13T18:43:38.719162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:29.208875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'161","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737482+0000","last_change":"2024-09-13T18:39:14.585973+0000","last_active":"2024-09-13T18:43:38.737482+0000","last_peered":"2024-09-13T18:43:38.737482+0000","last_clean":"2024-09-13T18:43:38.737482+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:43:38.737482+0000","last_undegraded":"2024-09-13T18:43:38.737482+0000","last_fullsized":"2024-09-13T18:43:38.737482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:48.875040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"23'137","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727488+0000","last_change":"2024-09-13T18:39:14.595451+0000","last_active":"2024-09-13T18:43:38.727488+0000","last_peered":"2024-09-13T18:43:38.727488+0000","last_clean":"2024-09-13T18:43:38.727488+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:43:38.727488+0000","last_undegraded":"2024-09-13T18:43:38.727488+0000","last_fullsized":"2024-09-13T18:43:38.727488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:45.368802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"23'166","reported_seq":178,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727552+0000","last_change":"2024-09-13T18:39:14.583590+0000","last_active":"2024-09-13T18:43:38.727552+0000","last_peered":"2024-09-13T18:43:38.727552+0000","last_clean":"2024-09-13T18:43:38.727552+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:43:38.727552+0000","last_undegraded":"2024-09-13T18:43:38.727552+0000","last_fullsized":"2024-09-13T18:43:38.727552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'134","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737455+0000","last_change":"2024-09-13T18:39:14.590724+0000","last_active":"2024-09-13T18:43:38.737455+0000","last_peered":"2024-09-13T18:43:38.737455+0000","last_clean":"2024-09-13T18:43:38.737455+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:43:38.737455+0000","last_undegraded":"2024-09-13T18:43:38.737455+0000","last_fullsized":"2024-09-13T18:43:38.737455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:09.353955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"23'180","reported_seq":192,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731840+0000","last_change":"2024-09-13T18:39:14.577642+0000","last_active":"2024-09-13T18:43:38.731840+0000","last_peered":"2024-09-13T18:43:38.731840+0000","last_clean":"2024-09-13T18:43:38.731840+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:43:38.731840+0000","last_undegraded":"2024-09-13T18:43:38.731840+0000","last_fullsized":"2024-09-13T18:43:38.731840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"23'134","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736869+0000","last_change":"2024-09-13T18:39:14.592432+0000","last_active":"2024-09-13T18:43:38.736869+0000","last_peered":"2024-09-13T18:43:38.736869+0000","last_clean":"2024-09-13T18:43:38.736869+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:43:38.736869+0000","last_undegraded":"2024-09-13T18:43:38.736869+0000","last_fullsized":"2024-09-13T18:43:38.736869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:43.945214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'198","reported_seq":210,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.728569+0000","last_change":"2024-09-13T18:39:14.571893+0000","last_active":"2024-09-13T18:43:38.728569+0000","last_peered":"2024-09-13T18:43:38.728569+0000","last_clean":"2024-09-13T18:43:38.728569+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:43:38.728569+0000","last_undegraded":"2024-09-13T18:43:38.728569+0000","last_fullsized":"2024-09-13T18:43:38.728569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'144","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719698+0000","last_change":"2024-09-13T18:39:14.594222+0000","last_active":"2024-09-13T18:43:38.719698+0000","last_peered":"2024-09-13T18:43:38.719698+0000","last_clean":"2024-09-13T18:43:38.719698+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:43:38.719698+0000","last_undegraded":"2024-09-13T18:43:38.719698+0000","last_fullsized":"2024-09-13T18:43:38.719698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:20.265556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'133","reported_seq":145,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739499+0000","last_change":"2024-09-13T18:39:14.576203+0000","last_active":"2024-09-13T18:43:38.739499+0000","last_peered":"2024-09-13T18:43:38.739499+0000","last_clean":"2024-09-13T18:43:38.739499+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:43:38.739499+0000","last_undegraded":"2024-09-13T18:43:38.739499+0000","last_fullsized":"2024-09-13T18:43:38.739499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"23'118","reported_seq":130,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740575+0000","last_change":"2024-09-13T18:39:14.586374+0000","last_active":"2024-09-13T18:43:38.740575+0000","last_peered":"2024-09-13T18:43:38.740575+0000","last_clean":"2024-09-13T18:43:38.740575+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:43:38.740575+0000","last_undegraded":"2024-09-13T18:43:38.740575+0000","last_fullsized":"2024-09-13T18:43:38.740575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:03.191196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'131","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.714196+0000","last_change":"2024-09-13T18:39:14.577392+0000","last_active":"2024-09-13T18:43:38.714196+0000","last_peered":"2024-09-13T18:43:38.714196+0000","last_clean":"2024-09-13T18:43:38.714196+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:43:38.714196+0000","last_undegraded":"2024-09-13T18:43:38.714196+0000","last_fullsized":"2024-09-13T18:43:38.714196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:26.709807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"23'135","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740453+0000","last_change":"2024-09-13T18:39:14.580898+0000","last_active":"2024-09-13T18:43:38.740453+0000","last_peered":"2024-09-13T18:43:38.740453+0000","last_clean":"2024-09-13T18:43:38.740453+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:43:38.740453+0000","last_undegraded":"2024-09-13T18:43:38.740453+0000","last_fullsized":"2024-09-13T18:43:38.740453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:23.630337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"23'150","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.716995+0000","last_change":"2024-09-13T18:39:14.574811+0000","last_active":"2024-09-13T18:43:38.716995+0000","last_peered":"2024-09-13T18:43:38.716995+0000","last_clean":"2024-09-13T18:43:38.716995+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:43:38.716995+0000","last_undegraded":"2024-09-13T18:43:38.716995+0000","last_fullsized":"2024-09-13T18:43:38.716995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"23'149","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730224+0000","last_change":"2024-09-13T18:39:14.579494+0000","last_active":"2024-09-13T18:43:38.730224+0000","last_peered":"2024-09-13T18:43:38.730224+0000","last_clean":"2024-09-13T18:43:38.730224+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:43:38.730224+0000","last_undegraded":"2024-09-13T18:43:38.730224+0000","last_fullsized":"2024-09-13T18:43:38.730224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:19.432936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660311+0000","last_change":"2024-09-13T18:39:13.575179+0000","last_active":"2024-09-13T18:39:53.660311+0000","last_peered":"2024-09-13T18:39:53.660311+0000","last_clean":"2024-09-13T18:39:53.660311+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:39:53.660311+0000","last_undegraded":"2024-09-13T18:39:53.660311+0000","last_fullsized":"2024-09-13T18:39:53.660311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:25.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"23'150","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717407+0000","last_change":"2024-09-13T18:39:14.594066+0000","last_active":"2024-09-13T18:43:38.717407+0000","last_peered":"2024-09-13T18:43:38.717407+0000","last_clean":"2024-09-13T18:43:38.717407+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:43:38.717407+0000","last_undegraded":"2024-09-13T18:43:38.717407+0000","last_fullsized":"2024-09-13T18:43:38.717407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:14.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665780+0000","last_change":"2024-09-13T18:39:13.570778+0000","last_active":"2024-09-13T18:39:53.665780+0000","last_peered":"2024-09-13T18:39:53.665780+0000","last_clean":"2024-09-13T18:39:53.665780+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:39:53.665780+0000","last_undegraded":"2024-09-13T18:39:53.665780+0000","last_fullsized":"2024-09-13T18:39:53.665780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"23'229","reported_seq":250,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739934+0000","last_change":"2024-09-13T18:39:54.668508+0000","last_active":"2024-09-13T18:43:38.739934+0000","last_peered":"2024-09-13T18:43:38.739934+0000","last_clean":"2024-09-13T18:43:38.739934+0000","last_became_active":"2024-09-13T18:39:54.668035+0000","last_became_peered":"2024-09-13T18:39:54.668035+0000","last_unstale":"2024-09-13T18:43:38.739934+0000","last_undegraded":"2024-09-13T18:43:38.739934+0000","last_fullsized":"2024-09-13T18:43:38.739934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:40.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663232+0000","last_change":"2024-09-13T18:39:13.575436+0000","last_active":"2024-09-13T18:39:53.663232+0000","last_peered":"2024-09-13T18:39:53.663232+0000","last_clean":"2024-09-13T18:39:53.663232+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:39:53.663232+0000","last_undegraded":"2024-09-13T18:39:53.663232+0000","last_fullsized":"2024-09-13T18:39:53.663232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:34.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'141","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737866+0000","last_change":"2024-09-13T18:39:14.584791+0000","last_active":"2024-09-13T18:43:38.737866+0000","last_peered":"2024-09-13T18:43:38.737866+0000","last_clean":"2024-09-13T18:43:38.737866+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:43:38.737866+0000","last_undegraded":"2024-09-13T18:43:38.737866+0000","last_fullsized":"2024-09-13T18:43:38.737866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:08.799126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'9","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.663475+0000","last_change":"2024-09-13T18:39:13.578940+0000","last_active":"2024-09-13T18:39:54.663475+0000","last_peered":"2024-09-13T18:39:54.663475+0000","last_clean":"2024-09-13T18:39:54.663475+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:39:54.663475+0000","last_undegraded":"2024-09-13T18:39:54.663475+0000","last_fullsized":"2024-09-13T18:39:54.663475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:34.109209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666409+0000","last_change":"2024-09-13T18:39:13.583184+0000","last_active":"2024-09-13T18:39:53.666409+0000","last_peered":"2024-09-13T18:39:53.666409+0000","last_clean":"2024-09-13T18:39:53.666409+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:39:53.666409+0000","last_undegraded":"2024-09-13T18:39:53.666409+0000","last_fullsized":"2024-09-13T18:39:53.666409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"23'153","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741409+0000","last_change":"2024-09-13T18:39:54.668672+0000","last_active":"2024-09-13T18:43:38.741409+0000","last_peered":"2024-09-13T18:43:38.741409+0000","last_clean":"2024-09-13T18:43:38.741409+0000","last_became_active":"2024-09-13T18:39:54.668322+0000","last_became_peered":"2024-09-13T18:39:54.668322+0000","last_unstale":"2024-09-13T18:43:38.741409+0000","last_undegraded":"2024-09-13T18:43:38.741409+0000","last_fullsized":"2024-09-13T18:43:38.741409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:43.914025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662667+0000","last_change":"2024-09-13T18:39:13.571043+0000","last_active":"2024-09-13T18:39:53.662667+0000","last_peered":"2024-09-13T18:39:53.662667+0000","last_clean":"2024-09-13T18:39:53.662667+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:39:53.662667+0000","last_undegraded":"2024-09-13T18:39:53.662667+0000","last_fullsized":"2024-09-13T18:39:53.662667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.757855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'134","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.709074+0000","last_change":"2024-09-13T18:39:14.577177+0000","last_active":"2024-09-13T18:43:38.709074+0000","last_peered":"2024-09-13T18:43:38.709074+0000","last_clean":"2024-09-13T18:43:38.709074+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:43:38.709074+0000","last_undegraded":"2024-09-13T18:43:38.709074+0000","last_fullsized":"2024-09-13T18:43:38.709074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667326+0000","last_change":"2024-09-13T18:39:13.581627+0000","last_active":"2024-09-13T18:39:53.667326+0000","last_peered":"2024-09-13T18:39:53.667326+0000","last_clean":"2024-09-13T18:39:53.667326+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:39:53.667326+0000","last_undegraded":"2024-09-13T18:39:53.667326+0000","last_fullsized":"2024-09-13T18:39:53.667326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:48.023626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'128","reported_seq":140,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.724030+0000","last_change":"2024-09-13T18:39:14.596602+0000","last_active":"2024-09-13T18:43:38.724030+0000","last_peered":"2024-09-13T18:43:38.724030+0000","last_clean":"2024-09-13T18:43:38.724030+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:43:38.724030+0000","last_undegraded":"2024-09-13T18:43:38.724030+0000","last_fullsized":"2024-09-13T18:43:38.724030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:35.414913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666092+0000","last_change":"2024-09-13T18:39:13.570169+0000","last_active":"2024-09-13T18:39:53.666092+0000","last_peered":"2024-09-13T18:39:53.666092+0000","last_clean":"2024-09-13T18:39:53.666092+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:39:53.666092+0000","last_undegraded":"2024-09-13T18:39:53.666092+0000","last_fullsized":"2024-09-13T18:39:53.666092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"23'143","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727371+0000","last_change":"2024-09-13T18:39:14.584580+0000","last_active":"2024-09-13T18:43:38.727371+0000","last_peered":"2024-09-13T18:43:38.727371+0000","last_clean":"2024-09-13T18:43:38.727371+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:43:38.727371+0000","last_undegraded":"2024-09-13T18:43:38.727371+0000","last_fullsized":"2024-09-13T18:43:38.727371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664054+0000","last_change":"2024-09-13T18:39:13.575713+0000","last_active":"2024-09-13T18:39:54.664054+0000","last_peered":"2024-09-13T18:39:54.664054+0000","last_clean":"2024-09-13T18:39:54.664054+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:39:54.664054+0000","last_undegraded":"2024-09-13T18:39:54.664054+0000","last_fullsized":"2024-09-13T18:39:54.664054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:59.985917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'144","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.711181+0000","last_change":"2024-09-13T18:39:14.577151+0000","last_active":"2024-09-13T18:43:38.711181+0000","last_peered":"2024-09-13T18:43:38.711181+0000","last_clean":"2024-09-13T18:43:38.711181+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:43:38.711181+0000","last_undegraded":"2024-09-13T18:43:38.711181+0000","last_fullsized":"2024-09-13T18:43:38.711181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663898+0000","last_change":"2024-09-13T18:39:13.581445+0000","last_active":"2024-09-13T18:39:53.663898+0000","last_peered":"2024-09-13T18:39:53.663898+0000","last_clean":"2024-09-13T18:39:53.663898+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:39:53.663898+0000","last_undegraded":"2024-09-13T18:39:53.663898+0000","last_fullsized":"2024-09-13T18:39:53.663898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:39.003339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734368+0000","last_change":"2024-09-13T18:39:14.584122+0000","last_active":"2024-09-13T18:43:38.734368+0000","last_peered":"2024-09-13T18:43:38.734368+0000","last_clean":"2024-09-13T18:43:38.734368+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:43:38.734368+0000","last_undegraded":"2024-09-13T18:43:38.734368+0000","last_fullsized":"2024-09-13T18:43:38.734368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:30.405734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663324+0000","last_change":"2024-09-13T18:39:13.575316+0000","last_active":"2024-09-13T18:39:53.663324+0000","last_peered":"2024-09-13T18:39:53.663324+0000","last_clean":"2024-09-13T18:39:53.663324+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:39:53.663324+0000","last_undegraded":"2024-09-13T18:39:53.663324+0000","last_fullsized":"2024-09-13T18:39:53.663324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:06.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'146","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719389+0000","last_change":"2024-09-13T18:39:14.593058+0000","last_active":"2024-09-13T18:43:38.719389+0000","last_peered":"2024-09-13T18:43:38.719389+0000","last_clean":"2024-09-13T18:43:38.719389+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:43:38.719389+0000","last_undegraded":"2024-09-13T18:43:38.719389+0000","last_fullsized":"2024-09-13T18:43:38.719389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:24.454698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661099+0000","last_change":"2024-09-13T18:39:13.581217+0000","last_active":"2024-09-13T18:39:53.661099+0000","last_peered":"2024-09-13T18:39:53.661099+0000","last_clean":"2024-09-13T18:39:53.661099+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:39:53.661099+0000","last_undegraded":"2024-09-13T18:39:53.661099+0000","last_fullsized":"2024-09-13T18:39:53.661099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:27.361025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'138","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739846+0000","last_change":"2024-09-13T18:39:14.596597+0000","last_active":"2024-09-13T18:43:38.739846+0000","last_peered":"2024-09-13T18:43:38.739846+0000","last_clean":"2024-09-13T18:43:38.739846+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:43:38.739846+0000","last_undegraded":"2024-09-13T18:43:38.739846+0000","last_fullsized":"2024-09-13T18:43:38.739846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:47.680908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":87,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661174+0000","last_change":"2024-09-13T18:39:03.413753+0000","last_active":"2024-09-13T18:39:53.661174+0000","last_peered":"2024-09-13T18:39:53.661174+0000","last_clean":"2024-09-13T18:39:53.661174+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:39:53.661174+0000","last_undegraded":"2024-09-13T18:39:53.661174+0000","last_fullsized":"2024-09-13T18:39:53.661174+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.425159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:05.703287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660538+0000","last_change":"2024-09-13T18:39:09.531787+0000","last_active":"2024-09-13T18:39:53.660538+0000","last_peered":"2024-09-13T18:39:53.660538+0000","last_clean":"2024-09-13T18:39:53.660538+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:39:53.660538+0000","last_undegraded":"2024-09-13T18:39:53.660538+0000","last_fullsized":"2024-09-13T18:39:53.660538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:21.652872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664040+0000","last_change":"2024-09-13T18:39:13.575940+0000","last_active":"2024-09-13T18:39:53.664040+0000","last_peered":"2024-09-13T18:39:53.664040+0000","last_clean":"2024-09-13T18:39:53.664040+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:39:53.664040+0000","last_undegraded":"2024-09-13T18:39:53.664040+0000","last_fullsized":"2024-09-13T18:39:53.664040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:23.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'143","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730832+0000","last_change":"2024-09-13T18:39:54.668486+0000","last_active":"2024-09-13T18:43:38.730832+0000","last_peered":"2024-09-13T18:43:38.730832+0000","last_clean":"2024-09-13T18:43:38.730832+0000","last_became_active":"2024-09-13T18:39:54.668177+0000","last_became_peered":"2024-09-13T18:39:54.668177+0000","last_unstale":"2024-09-13T18:43:38.730832+0000","last_undegraded":"2024-09-13T18:43:38.730832+0000","last_fullsized":"2024-09-13T18:43:38.730832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:01.415577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661120+0000","last_change":"2024-09-13T18:39:09.531377+0000","last_active":"2024-09-13T18:39:53.661120+0000","last_peered":"2024-09-13T18:39:53.661120+0000","last_clean":"2024-09-13T18:39:53.661120+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:39:53.661120+0000","last_undegraded":"2024-09-13T18:39:53.661120+0000","last_fullsized":"2024-09-13T18:39:53.661120+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.437998+0000","last_change":"2024-09-13T18:39:13.563570+0000","last_active":"2024-09-13T18:43:37.437998+0000","last_peered":"2024-09-13T18:43:37.437998+0000","last_clean":"2024-09-13T18:43:37.437998+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:43:37.437998+0000","last_undegraded":"2024-09-13T18:43:37.437998+0000","last_fullsized":"2024-09-13T18:43:37.437998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'163","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736074+0000","last_change":"2024-09-13T18:39:14.587017+0000","last_active":"2024-09-13T18:43:38.736074+0000","last_peered":"2024-09-13T18:43:38.736074+0000","last_clean":"2024-09-13T18:43:38.736074+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:43:38.736074+0000","last_undegraded":"2024-09-13T18:43:38.736074+0000","last_fullsized":"2024-09-13T18:43:38.736074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661881+0000","last_change":"2024-09-13T18:39:09.533004+0000","last_active":"2024-09-13T18:39:53.661881+0000","last_peered":"2024-09-13T18:39:53.661881+0000","last_clean":"2024-09-13T18:39:53.661881+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:39:53.661881+0000","last_undegraded":"2024-09-13T18:39:53.661881+0000","last_fullsized":"2024-09-13T18:39:53.661881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:41.079838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660963+0000","last_change":"2024-09-13T18:39:13.579066+0000","last_active":"2024-09-13T18:39:53.660963+0000","last_peered":"2024-09-13T18:39:53.660963+0000","last_clean":"2024-09-13T18:39:53.660963+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:39:53.660963+0000","last_undegraded":"2024-09-13T18:39:53.660963+0000","last_fullsized":"2024-09-13T18:39:53.660963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'143","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730317+0000","last_change":"2024-09-13T18:39:14.589734+0000","last_active":"2024-09-13T18:43:38.730317+0000","last_peered":"2024-09-13T18:43:38.730317+0000","last_clean":"2024-09-13T18:43:38.730317+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:43:38.730317+0000","last_undegraded":"2024-09-13T18:43:38.730317+0000","last_fullsized":"2024-09-13T18:43:38.730317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664123+0000","last_change":"2024-09-13T18:39:09.532311+0000","last_active":"2024-09-13T18:39:53.664123+0000","last_peered":"2024-09-13T18:39:53.664123+0000","last_clean":"2024-09-13T18:39:53.664123+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:39:53.664123+0000","last_undegraded":"2024-09-13T18:39:53.664123+0000","last_fullsized":"2024-09-13T18:39:53.664123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:53.060128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666753+0000","last_change":"2024-09-13T18:39:13.571488+0000","last_active":"2024-09-13T18:39:53.666753+0000","last_peered":"2024-09-13T18:39:53.666753+0000","last_clean":"2024-09-13T18:39:53.666753+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:39:53.666753+0000","last_undegraded":"2024-09-13T18:39:53.666753+0000","last_fullsized":"2024-09-13T18:39:53.666753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:44.121699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"23'144","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730418+0000","last_change":"2024-09-13T18:39:14.579779+0000","last_active":"2024-09-13T18:43:38.730418+0000","last_peered":"2024-09-13T18:43:38.730418+0000","last_clean":"2024-09-13T18:43:38.730418+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:43:38.730418+0000","last_undegraded":"2024-09-13T18:43:38.730418+0000","last_fullsized":"2024-09-13T18:43:38.730418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660742+0000","last_change":"2024-09-13T18:39:13.577844+0000","last_active":"2024-09-13T18:39:53.660742+0000","last_peered":"2024-09-13T18:39:53.660742+0000","last_clean":"2024-09-13T18:39:53.660742+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:39:53.660742+0000","last_undegraded":"2024-09-13T18:39:53.660742+0000","last_fullsized":"2024-09-13T18:39:53.660742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661619+0000","last_change":"2024-09-13T18:39:09.533091+0000","last_active":"2024-09-13T18:39:53.661619+0000","last_peered":"2024-09-13T18:39:53.661619+0000","last_clean":"2024-09-13T18:39:53.661619+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:39:53.661619+0000","last_undegraded":"2024-09-13T18:39:53.661619+0000","last_fullsized":"2024-09-13T18:39:53.661619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"23'158","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.728247+0000","last_change":"2024-09-13T18:39:14.597238+0000","last_active":"2024-09-13T18:43:38.728247+0000","last_peered":"2024-09-13T18:43:38.728247+0000","last_clean":"2024-09-13T18:43:38.728247+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:43:38.728247+0000","last_undegraded":"2024-09-13T18:43:38.728247+0000","last_fullsized":"2024-09-13T18:43:38.728247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.849783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660988+0000","last_change":"2024-09-13T18:39:13.583071+0000","last_active":"2024-09-13T18:39:53.660988+0000","last_peered":"2024-09-13T18:39:53.660988+0000","last_clean":"2024-09-13T18:39:53.660988+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:39:53.660988+0000","last_undegraded":"2024-09-13T18:39:53.660988+0000","last_fullsized":"2024-09-13T18:39:53.660988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667429+0000","last_change":"2024-09-13T18:39:09.532042+0000","last_active":"2024-09-13T18:39:53.667429+0000","last_peered":"2024-09-13T18:39:53.667429+0000","last_clean":"2024-09-13T18:39:53.667429+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:39:53.667429+0000","last_undegraded":"2024-09-13T18:39:53.667429+0000","last_fullsized":"2024-09-13T18:39:53.667429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:24.541036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"23'145","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717323+0000","last_change":"2024-09-13T18:39:14.584428+0000","last_active":"2024-09-13T18:43:38.717323+0000","last_peered":"2024-09-13T18:43:38.717323+0000","last_clean":"2024-09-13T18:43:38.717323+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:43:38.717323+0000","last_undegraded":"2024-09-13T18:43:38.717323+0000","last_fullsized":"2024-09-13T18:43:38.717323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.662382+0000","last_change":"2024-09-13T18:39:13.583868+0000","last_active":"2024-09-13T18:39:54.662382+0000","last_peered":"2024-09-13T18:39:54.662382+0000","last_clean":"2024-09-13T18:39:54.662382+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:39:54.662382+0000","last_undegraded":"2024-09-13T18:39:54.662382+0000","last_fullsized":"2024-09-13T18:39:54.662382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:52.540883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662865+0000","last_change":"2024-09-13T18:39:09.532757+0000","last_active":"2024-09-13T18:39:53.662865+0000","last_peered":"2024-09-13T18:39:53.662865+0000","last_clean":"2024-09-13T18:39:53.662865+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:39:53.662865+0000","last_undegraded":"2024-09-13T18:39:53.662865+0000","last_fullsized":"2024-09-13T18:39:53.662865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:32.617744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"23'131","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741518+0000","last_change":"2024-09-13T18:39:14.582490+0000","last_active":"2024-09-13T18:43:38.741518+0000","last_peered":"2024-09-13T18:43:38.741518+0000","last_clean":"2024-09-13T18:43:38.741518+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:43:38.741518+0000","last_undegraded":"2024-09-13T18:43:38.741518+0000","last_fullsized":"2024-09-13T18:43:38.741518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:44.239715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'10","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:34.630546+0000","last_change":"2024-09-13T18:39:13.583929+0000","last_active":"2024-09-13T18:43:34.630546+0000","last_peered":"2024-09-13T18:43:34.630546+0000","last_clean":"2024-09-13T18:43:34.630546+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:43:34.630546+0000","last_undegraded":"2024-09-13T18:43:34.630546+0000","last_fullsized":"2024-09-13T18:43:34.630546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:57.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663547+0000","last_change":"2024-09-13T18:39:09.531717+0000","last_active":"2024-09-13T18:39:53.663547+0000","last_peered":"2024-09-13T18:39:53.663547+0000","last_clean":"2024-09-13T18:39:53.663547+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:39:53.663547+0000","last_undegraded":"2024-09-13T18:39:53.663547+0000","last_fullsized":"2024-09-13T18:39:53.663547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:33.878130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"23'131","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.715217+0000","last_change":"2024-09-13T18:39:54.667668+0000","last_active":"2024-09-13T18:43:38.715217+0000","last_peered":"2024-09-13T18:43:38.715217+0000","last_clean":"2024-09-13T18:43:38.715217+0000","last_became_active":"2024-09-13T18:39:54.667244+0000","last_became_peered":"2024-09-13T18:39:54.667244+0000","last_unstale":"2024-09-13T18:43:38.715217+0000","last_undegraded":"2024-09-13T18:43:38.715217+0000","last_fullsized":"2024-09-13T18:43:38.715217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:56.127916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"23'171","reported_seq":183,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739130+0000","last_change":"2024-09-13T18:39:14.593754+0000","last_active":"2024-09-13T18:43:38.739130+0000","last_peered":"2024-09-13T18:43:38.739130+0000","last_clean":"2024-09-13T18:43:38.739130+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:43:38.739130+0000","last_undegraded":"2024-09-13T18:43:38.739130+0000","last_fullsized":"2024-09-13T18:43:38.739130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:07.651837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"23'95","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.742654+0000","last_change":"2024-09-13T18:39:13.575507+0000","last_active":"2024-09-13T18:43:38.742654+0000","last_peered":"2024-09-13T18:43:38.742654+0000","last_clean":"2024-09-13T18:43:38.742654+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:43:38.742654+0000","last_undegraded":"2024-09-13T18:43:38.742654+0000","last_fullsized":"2024-09-13T18:43:38.742654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:42.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198201,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"23'157","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.735249+0000","last_change":"2024-09-13T18:39:14.598160+0000","last_active":"2024-09-13T18:43:38.735249+0000","last_peered":"2024-09-13T18:43:38.735249+0000","last_clean":"2024-09-13T18:43:38.735249+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:43:38.735249+0000","last_undegraded":"2024-09-13T18:43:38.735249+0000","last_fullsized":"2024-09-13T18:43:38.735249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.437719+0000","last_change":"2024-09-13T18:39:13.572017+0000","last_active":"2024-09-13T18:43:37.437719+0000","last_peered":"2024-09-13T18:43:37.437719+0000","last_clean":"2024-09-13T18:43:37.437719+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:43:37.437719+0000","last_undegraded":"2024-09-13T18:43:37.437719+0000","last_fullsized":"2024-09-13T18:43:37.437719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:25.536255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662584+0000","last_change":"2024-09-13T18:39:13.571792+0000","last_active":"2024-09-13T18:39:53.662584+0000","last_peered":"2024-09-13T18:39:53.662584+0000","last_clean":"2024-09-13T18:39:53.662584+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:39:53.662584+0000","last_undegraded":"2024-09-13T18:39:53.662584+0000","last_fullsized":"2024-09-13T18:39:53.662584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'189","reported_seq":201,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737335+0000","last_change":"2024-09-13T18:39:14.590748+0000","last_active":"2024-09-13T18:43:38.737335+0000","last_peered":"2024-09-13T18:43:38.737335+0000","last_clean":"2024-09-13T18:43:38.737335+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:43:38.737335+0000","last_undegraded":"2024-09-13T18:43:38.737335+0000","last_fullsized":"2024-09-13T18:43:38.737335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:49.557245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.666030+0000","last_change":"2024-09-13T18:39:13.569863+0000","last_active":"2024-09-13T18:39:54.666030+0000","last_peered":"2024-09-13T18:39:54.666030+0000","last_clean":"2024-09-13T18:39:54.666030+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:39:54.666030+0000","last_undegraded":"2024-09-13T18:39:54.666030+0000","last_fullsized":"2024-09-13T18:39:54.666030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'165","reported_seq":177,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740654+0000","last_change":"2024-09-13T18:39:14.582205+0000","last_active":"2024-09-13T18:43:38.740654+0000","last_peered":"2024-09-13T18:43:38.740654+0000","last_clean":"2024-09-13T18:43:38.740654+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:43:38.740654+0000","last_undegraded":"2024-09-13T18:43:38.740654+0000","last_fullsized":"2024-09-13T18:43:38.740654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.186210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'135","reported_seq":144,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730768+0000","last_change":"2024-09-13T18:39:54.668351+0000","last_active":"2024-09-13T18:43:38.730768+0000","last_peered":"2024-09-13T18:43:38.730768+0000","last_clean":"2024-09-13T18:43:38.730768+0000","last_became_active":"2024-09-13T18:39:54.667809+0000","last_became_peered":"2024-09-13T18:39:54.667809+0000","last_unstale":"2024-09-13T18:43:38.730768+0000","last_undegraded":"2024-09-13T18:43:38.730768+0000","last_fullsized":"2024-09-13T18:43:38.730768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:40.114429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661053+0000","last_change":"2024-09-13T18:39:13.573803+0000","last_active":"2024-09-13T18:39:53.661053+0000","last_peered":"2024-09-13T18:39:53.661053+0000","last_clean":"2024-09-13T18:39:53.661053+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:39:53.661053+0000","last_undegraded":"2024-09-13T18:39:53.661053+0000","last_fullsized":"2024-09-13T18:39:53.661053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:08.298094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"23'152","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734010+0000","last_change":"2024-09-13T18:39:14.586848+0000","last_active":"2024-09-13T18:43:38.734010+0000","last_peered":"2024-09-13T18:43:38.734010+0000","last_clean":"2024-09-13T18:43:38.734010+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:43:38.734010+0000","last_undegraded":"2024-09-13T18:43:38.734010+0000","last_fullsized":"2024-09-13T18:43:38.734010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660115+0000","last_change":"2024-09-13T18:39:13.586123+0000","last_active":"2024-09-13T18:39:53.660115+0000","last_peered":"2024-09-13T18:39:53.660115+0000","last_clean":"2024-09-13T18:39:53.660115+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:39:53.660115+0000","last_undegraded":"2024-09-13T18:39:53.660115+0000","last_fullsized":"2024-09-13T18:39:53.660115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"23'183","reported_seq":192,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731266+0000","last_change":"2024-09-13T18:39:54.668883+0000","last_active":"2024-09-13T18:43:38.731266+0000","last_peered":"2024-09-13T18:43:38.731266+0000","last_clean":"2024-09-13T18:43:38.731266+0000","last_became_active":"2024-09-13T18:39:54.668613+0000","last_became_peered":"2024-09-13T18:39:54.668613+0000","last_unstale":"2024-09-13T18:43:38.731266+0000","last_undegraded":"2024-09-13T18:43:38.731266+0000","last_fullsized":"2024-09-13T18:43:38.731266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:31.076844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661254+0000","last_change":"2024-09-13T18:39:13.575435+0000","last_active":"2024-09-13T18:39:53.661254+0000","last_peered":"2024-09-13T18:39:53.661254+0000","last_clean":"2024-09-13T18:39:53.661254+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:39:53.661254+0000","last_undegraded":"2024-09-13T18:39:53.661254+0000","last_fullsized":"2024-09-13T18:39:53.661254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"23'141","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727330+0000","last_change":"2024-09-13T18:39:14.580846+0000","last_active":"2024-09-13T18:43:38.727330+0000","last_peered":"2024-09-13T18:43:38.727330+0000","last_clean":"2024-09-13T18:43:38.727330+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:43:38.727330+0000","last_undegraded":"2024-09-13T18:43:38.727330+0000","last_fullsized":"2024-09-13T18:43:38.727330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.010053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666752+0000","last_change":"2024-09-13T18:39:13.571042+0000","last_active":"2024-09-13T18:39:53.666752+0000","last_peered":"2024-09-13T18:39:53.666752+0000","last_clean":"2024-09-13T18:39:53.666752+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:39:53.666752+0000","last_undegraded":"2024-09-13T18:39:53.666752+0000","last_fullsized":"2024-09-13T18:39:53.666752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.288993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"23'137","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738740+0000","last_change":"2024-09-13T18:39:14.593258+0000","last_active":"2024-09-13T18:43:38.738740+0000","last_peered":"2024-09-13T18:43:38.738740+0000","last_clean":"2024-09-13T18:43:38.738740+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:43:38.738740+0000","last_undegraded":"2024-09-13T18:43:38.738740+0000","last_fullsized":"2024-09-13T18:43:38.738740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:21.972039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660913+0000","last_change":"2024-09-13T18:39:13.584903+0000","last_active":"2024-09-13T18:39:53.660913+0000","last_peered":"2024-09-13T18:39:53.660913+0000","last_clean":"2024-09-13T18:39:53.660913+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:39:53.660913+0000","last_undegraded":"2024-09-13T18:39:53.660913+0000","last_fullsized":"2024-09-13T18:39:53.660913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:46.551317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"23'130","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.714269+0000","last_change":"2024-09-13T18:39:54.667465+0000","last_active":"2024-09-13T18:43:38.714269+0000","last_peered":"2024-09-13T18:43:38.714269+0000","last_clean":"2024-09-13T18:43:38.714269+0000","last_became_active":"2024-09-13T18:39:54.667188+0000","last_became_peered":"2024-09-13T18:39:54.667188+0000","last_unstale":"2024-09-13T18:43:38.714269+0000","last_undegraded":"2024-09-13T18:43:38.714269+0000","last_fullsized":"2024-09-13T18:43:38.714269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:40.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664322+0000","last_change":"2024-09-13T18:39:13.574044+0000","last_active":"2024-09-13T18:39:54.664322+0000","last_peered":"2024-09-13T18:39:54.664322+0000","last_clean":"2024-09-13T18:39:54.664322+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:39:54.664322+0000","last_undegraded":"2024-09-13T18:39:54.664322+0000","last_fullsized":"2024-09-13T18:39:54.664322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:12.168801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'157","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739642+0000","last_change":"2024-09-13T18:39:14.591381+0000","last_active":"2024-09-13T18:43:38.739642+0000","last_peered":"2024-09-13T18:43:38.739642+0000","last_clean":"2024-09-13T18:43:38.739642+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:43:38.739642+0000","last_undegraded":"2024-09-13T18:43:38.739642+0000","last_fullsized":"2024-09-13T18:43:38.739642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:17.239023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661826+0000","last_change":"2024-09-13T18:39:13.575357+0000","last_active":"2024-09-13T18:39:53.661826+0000","last_peered":"2024-09-13T18:39:53.661826+0000","last_clean":"2024-09-13T18:39:53.661826+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:39:53.661826+0000","last_undegraded":"2024-09-13T18:39:53.661826+0000","last_fullsized":"2024-09-13T18:39:53.661826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:20.965325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"23'170","reported_seq":182,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.722266+0000","last_change":"2024-09-13T18:39:14.580750+0000","last_active":"2024-09-13T18:43:38.722266+0000","last_peered":"2024-09-13T18:43:38.722266+0000","last_clean":"2024-09-13T18:43:38.722266+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:43:38.722266+0000","last_undegraded":"2024-09-13T18:43:38.722266+0000","last_fullsized":"2024-09-13T18:43:38.722266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:08.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666153+0000","last_change":"2024-09-13T18:39:13.583221+0000","last_active":"2024-09-13T18:39:53.666153+0000","last_peered":"2024-09-13T18:39:53.666153+0000","last_clean":"2024-09-13T18:39:53.666153+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:39:53.666153+0000","last_undegraded":"2024-09-13T18:39:53.666153+0000","last_fullsized":"2024-09-13T18:39:53.666153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":199492,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":160,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":398984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705724,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306084,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065756,"statfs":{"total":96636764160,"available":96323334144,"internally_reserved":0,"allocated":421888,"data_stored":266388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.33900000000000002,"15min":0.32100000000000001},"min":{"1min":0.184,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":4.5049999999999999,"5min":4.5049999999999999,"15min":4.5049999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.20399999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.316}]},{"osd":1,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"min":{"1min":0.191,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":3.8980000000000001,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.35699999999999998,"15min":0.33800000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.376}]},{"osd":2,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.23499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":3,"5min":3,"15min":3},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":4.5590000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":0.32900000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705725,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306068,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065772,"statfs":{"total":96636764160,"available":96323350528,"internally_reserved":0,"allocated":405504,"data_stored":265554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.151,"5min":0.151,"15min":0.151},"max":{"1min":0.39400000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.193,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.308},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.376},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.36299999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306460,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065380,"statfs":{"total":96636764160,"available":96322949120,"internally_reserved":0,"allocated":806912,"data_stored":659023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,4,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.315},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.33300000000000002,"15min":0.32900000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52500000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.39600000000000002,"15min":0.35199999999999998},"min":{"1min":0.217,"5min":0.184,"15min":0.184},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.35899999999999999,"15min":0.34599999999999997},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.42099999999999999,"15min":0.378},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.218},"max":{"1min":6.468,"5min":6.468,"15min":6.468},"last":0.371}]}]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306464,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065376,"statfs":{"total":96636764160,"available":96322945024,"internally_reserved":0,"allocated":811008,"data_stored":659563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.29699999999999999,"15min":0.30399999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.43099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.33200000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.499}]},{"osd":2,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.313,"15min":0.32100000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.371,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.315,"5min":0.33200000000000002,"15min":0.33700000000000002},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47799999999999998,"5min":0.5,"15min":0.5},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34699999999999998,"15min":0.35499999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.45600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":198706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":198395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:43:45.627 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:43:45.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.753+0000 7fdda8c80640 1 Processor -- start 2024-09-13T18:43:45.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.753+0000 7fdda8c80640 1 -- start start 2024-09-13T18:43:45.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda8c80640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdda40a32b0 0x7fdda412f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:45.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda8c80640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdda4069080 0x7fdda4137770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:45.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda8c80640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda4096b70 con 0x7fdda412fed0 2024-09-13T18:43:45.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda8c80640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda41302f0 con 0x7fdda40a32b0 2024-09-13T18:43:45.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda8c80640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40a3680 con 0x7fdda4069080 2024-09-13T18:43:45.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdda40a32b0 0x7fdda412f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:45.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda2d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdda4069080 0x7fdda4137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:45.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda1d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdda412fed0 0x7fdda4068970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42692/0 (socket says 172.21.15.97:42692) 2024-09-13T18:43:45.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda2d9d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdda4069080 0x7fdda4137770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:49294/0 (socket says 172.21.15.97:49294) 2024-09-13T18:43:45.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdda40a32b0 0x7fdda412f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53928/0 (socket says 172.21.15.97:53928) 2024-09-13T18:43:45.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda1d9b640 1 -- 172.21.15.97:0/3884293641 learned_addr learned my addr 172.21.15.97:0/3884293641 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:43:45.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda259c640 1 -- 172.21.15.97:0/3884293641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdda4069080 msgr2=0x7fdda4137770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda259c640 1 --2- 172.21.15.97:0/3884293641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdda4069080 0x7fdda4137770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda259c640 1 -- 172.21.15.97:0/3884293641 >> v1:172.21.15.97:6789/0 conn(0x7fdda412fed0 legacy=0x7fdda4068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda259c640 1 -- 172.21.15.97:0/3884293641 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda4097460 con 0x7fdda40a32b0 2024-09-13T18:43:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda159a640 1 -- 172.21.15.97:0/3884293641 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711486268 0 0) 0x7fdda4096b70 con 0x7fdda412fed0 2024-09-13T18:43:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.754+0000 7fdda2d9d640 1 --2- 172.21.15.97:0/3884293641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdda4069080 0x7fdda4137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.755+0000 7fdda259c640 1 --2- 172.21.15.97:0/3884293641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdda40a32b0 0x7fdda412f990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009850 tx=0x7fdd8c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbfd9db91f1a03f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.755+0000 7fdda159a640 1 -- 172.21.15.97:0/3884293641 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c02ad00 con 0x7fdda40a32b0 2024-09-13T18:43:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.755+0000 7fdda159a640 1 -- 172.21.15.97:0/3884293641 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c02ae60 con 0x7fdda40a32b0 2024-09-13T18:43:45.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.755+0000 7fdda159a640 1 -- 172.21.15.97:0/3884293641 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c032670 con 0x7fdda40a32b0 2024-09-13T18:43:45.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.756+0000 7fdda8c80640 1 -- 172.21.15.97:0/3884293641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdda40a32b0 msgr2=0x7fdda412f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:45.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.756+0000 7fdda8c80640 1 --2- 172.21.15.97:0/3884293641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdda40a32b0 0x7fdda412f990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009850 tx=0x7fdd8c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.756+0000 7fdda8c80640 1 -- 172.21.15.97:0/3884293641 shutdown_connections 2024-09-13T18:43:45.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.756+0000 7fdda8c80640 1 --2- 172.21.15.97:0/3884293641 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdda4069080 0x7fdda4137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.756+0000 7fdda8c80640 1 --2- 172.21.15.97:0/3884293641 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdda40a32b0 0x7fdda412f990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.756+0000 7fdda8c80640 1 -- 172.21.15.97:0/3884293641 >> 172.21.15.97:0/3884293641 conn(0x7fdda406eef0 msgr2=0x7fdda40a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:45.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.756+0000 7fdda8c80640 1 -- 172.21.15.97:0/3884293641 shutdown_connections 2024-09-13T18:43:45.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.756+0000 7fdda8c80640 1 -- 172.21.15.97:0/3884293641 wait complete. 2024-09-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda8c80640 1 Processor -- start 2024-09-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda8c80640 1 -- start start 2024-09-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda8c80640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdda4069080 0x7fdda413eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda8c80640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdda40a32b0 0x7fdda413eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda8c80640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdda412fed0 0x7fdda41190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda8c80640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda411abe0 con 0x7fdda40a32b0 2024-09-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda8c80640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40a2640 con 0x7fdda412fed0 2024-09-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda8c80640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdda409e710 con 0x7fdda4069080 2024-09-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda1d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdda40a32b0 0x7fdda413eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda259c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdda4069080 0x7fdda413eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda1d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdda40a32b0 0x7fdda413eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53940/0 (socket says 172.21.15.97:53940) 2024-09-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda1d9b640 1 -- 172.21.15.97:0/3380765896 learned_addr learned my addr 172.21.15.97:0/3380765896 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda259c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdda4069080 0x7fdda413eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:35940/0 (socket says 172.21.15.97:35940) 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda2d9d640 1 --2- 172.21.15.97:0/3380765896 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdda412fed0 0x7fdda41190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda2d9d640 1 -- 172.21.15.97:0/3380765896 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdda4069080 msgr2=0x7fdda413eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda2d9d640 1 --2- 172.21.15.97:0/3380765896 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdda4069080 0x7fdda413eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.757+0000 7fdda2d9d640 1 -- 172.21.15.97:0/3380765896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdda40a32b0 msgr2=0x7fdda413eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.758+0000 7fdda2d9d640 1 --2- 172.21.15.97:0/3380765896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdda40a32b0 0x7fdda413eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.758+0000 7fdda2d9d640 1 -- 172.21.15.97:0/3380765896 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c009a20 con 0x7fdda412fed0 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.758+0000 7fdda1d9b640 1 --2- 172.21.15.97:0/3380765896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdda40a32b0 0x7fdda413eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.758+0000 7fdda259c640 1 --2- 172.21.15.97:0/3380765896 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdda4069080 0x7fdda413eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.758+0000 7fdda2d9d640 1 --2- 172.21.15.97:0/3380765896 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdda412fed0 0x7fdda41190b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009f40 tx=0x7fdd9c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.758+0000 7fdd9a7fc640 1 -- 172.21.15.97:0/3380765896 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00ce10 con 0x7fdda412fed0 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.758+0000 7fdd9a7fc640 1 -- 172.21.15.97:0/3380765896 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c00f040 con 0x7fdda412fed0 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.758+0000 7fdda8c80640 1 -- 172.21.15.97:0/3380765896 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c009390 con 0x7fdda412fed0 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.758+0000 7fdd9a7fc640 1 -- 172.21.15.97:0/3380765896 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0146d0 con 0x7fdda412fed0 2024-09-13T18:43:45.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.758+0000 7fdda8c80640 1 -- 172.21.15.97:0/3380765896 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda409bf90 con 0x7fdda412fed0 2024-09-13T18:43:45.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.759+0000 7fdd9a7fc640 1 -- 172.21.15.97:0/3380765896 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fdd9c003020 con 0x7fdda412fed0 2024-09-13T18:43:45.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.759+0000 7fdda8c80640 1 -- 172.21.15.97:0/3380765896 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda411bbc0 con 0x7fdda412fed0 2024-09-13T18:43:45.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.759+0000 7fdd9a7fc640 1 -- 172.21.15.97:0/3380765896 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fdd9c042ad0 con 0x7fdda412fed0 2024-09-13T18:43:45.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.763+0000 7fdd9a7fc640 1 -- 172.21.15.97:0/3380765896 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fdd9c018020 con 0x7fdda412fed0 2024-09-13T18:43:45.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.914+0000 7fdda8c80640 1 -- 172.21.15.97:0/3380765896 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdda4064000 con 0x7fdd84031160 2024-09-13T18:43:45.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.920+0000 7fdd9a7fc640 1 -- 172.21.15.97:0/3380765896 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277541 (unknown 2965378022 0 1225159791) 0x7fdda4064000 con 0x7fdd84031160 2024-09-13T18:43:45.925 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:43:45.926 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:43:45.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.923+0000 7fdda8c80640 1 -- 172.21.15.97:0/3380765896 >> v1:172.21.15.97:6816/34603 conn(0x7fdd84031160 legacy=0x7fdd84033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:45.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.923+0000 7fdda8c80640 1 -- 172.21.15.97:0/3380765896 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdda412fed0 msgr2=0x7fdda41190b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:45.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.923+0000 7fdda8c80640 1 --2- 172.21.15.97:0/3380765896 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdda412fed0 0x7fdda41190b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009f40 tx=0x7fdd9c00b040 comp rx=0 tx=0).stop 2024-09-13T18:43:45.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.923+0000 7fdda8c80640 1 -- 172.21.15.97:0/3380765896 shutdown_connections 2024-09-13T18:43:45.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.923+0000 7fdda8c80640 1 --2- 172.21.15.97:0/3380765896 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fdda412fed0 0x7fdda41190b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.923+0000 7fdda8c80640 1 --2- 172.21.15.97:0/3380765896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdda40a32b0 0x7fdda413eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.923+0000 7fdda8c80640 1 --2- 172.21.15.97:0/3380765896 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fdda4069080 0x7fdda413eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:45.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.923+0000 7fdda8c80640 1 -- 172.21.15.97:0/3380765896 >> 172.21.15.97:0/3380765896 conn(0x7fdda406eef0 msgr2=0x7fdda4132530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:45.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.923+0000 7fdda8c80640 1 -- 172.21.15.97:0/3380765896 shutdown_connections 2024-09-13T18:43:45.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:45.923+0000 7fdda8c80640 1 -- 172.21.15.97:0/3380765896 wait complete. 2024-09-13T18:43:45.936 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-13T18:43:45.412612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":789879,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":60,"num_read_kb":50,"num_write":9457,"num_write_kb":25167188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9924,"ondisk_log_size":9924,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1225076,"kb_used_data":2388,"kb_used_omap":6,"kb_used_meta":1222649,"kb_avail":376262284,"statfs":{"total":386547056640,"available":385292578816,"internally_reserved":0,"allocated":2445312,"data_stored":1850528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1251992928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,4,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737399423,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2577,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002908"},"pg_stats":[{"pgid":"4.3f","version":"23'146","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719578+0000","last_change":"2024-09-13T18:39:14.592723+0000","last_active":"2024-09-13T18:43:38.719578+0000","last_peered":"2024-09-13T18:43:38.719578+0000","last_clean":"2024-09-13T18:43:38.719578+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:43:38.719578+0000","last_undegraded":"2024-09-13T18:43:38.719578+0000","last_fullsized":"2024-09-13T18:43:38.719578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:09.304808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'130","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727590+0000","last_change":"2024-09-13T18:39:14.581266+0000","last_active":"2024-09-13T18:43:38.727590+0000","last_peered":"2024-09-13T18:43:38.727590+0000","last_clean":"2024-09-13T18:43:38.727590+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:43:38.727590+0000","last_undegraded":"2024-09-13T18:43:38.727590+0000","last_fullsized":"2024-09-13T18:43:38.727590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.732104+0000","last_change":"2024-09-13T18:39:14.586254+0000","last_active":"2024-09-13T18:43:38.732104+0000","last_peered":"2024-09-13T18:43:38.732104+0000","last_clean":"2024-09-13T18:43:38.732104+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:43:38.732104+0000","last_undegraded":"2024-09-13T18:43:38.732104+0000","last_fullsized":"2024-09-13T18:43:38.732104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"23'173","reported_seq":185,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.733542+0000","last_change":"2024-09-13T18:39:14.583960+0000","last_active":"2024-09-13T18:43:38.733542+0000","last_peered":"2024-09-13T18:43:38.733542+0000","last_clean":"2024-09-13T18:43:38.733542+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:43:38.733542+0000","last_undegraded":"2024-09-13T18:43:38.733542+0000","last_fullsized":"2024-09-13T18:43:38.733542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"23'148","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727037+0000","last_change":"2024-09-13T18:39:14.577865+0000","last_active":"2024-09-13T18:43:38.727037+0000","last_peered":"2024-09-13T18:43:38.727037+0000","last_clean":"2024-09-13T18:43:38.727037+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:43:38.727037+0000","last_undegraded":"2024-09-13T18:43:38.727037+0000","last_fullsized":"2024-09-13T18:43:38.727037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'135","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.729288+0000","last_change":"2024-09-13T18:39:14.590785+0000","last_active":"2024-09-13T18:43:38.729288+0000","last_peered":"2024-09-13T18:43:38.729288+0000","last_clean":"2024-09-13T18:43:38.729288+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:43:38.729288+0000","last_undegraded":"2024-09-13T18:43:38.729288+0000","last_fullsized":"2024-09-13T18:43:38.729288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:24.453184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'164","reported_seq":176,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734491+0000","last_change":"2024-09-13T18:39:14.590893+0000","last_active":"2024-09-13T18:43:38.734491+0000","last_peered":"2024-09-13T18:43:38.734491+0000","last_clean":"2024-09-13T18:43:38.734491+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:43:38.734491+0000","last_undegraded":"2024-09-13T18:43:38.734491+0000","last_fullsized":"2024-09-13T18:43:38.734491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:57.986187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'186","reported_seq":198,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717710+0000","last_change":"2024-09-13T18:39:14.595160+0000","last_active":"2024-09-13T18:43:38.717710+0000","last_peered":"2024-09-13T18:43:38.717710+0000","last_clean":"2024-09-13T18:43:38.717710+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:43:38.717710+0000","last_undegraded":"2024-09-13T18:43:38.717710+0000","last_fullsized":"2024-09-13T18:43:38.717710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"23'152","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.722317+0000","last_change":"2024-09-13T18:39:14.586790+0000","last_active":"2024-09-13T18:43:38.722317+0000","last_peered":"2024-09-13T18:43:38.722317+0000","last_clean":"2024-09-13T18:43:38.722317+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:43:38.722317+0000","last_undegraded":"2024-09-13T18:43:38.722317+0000","last_fullsized":"2024-09-13T18:43:38.722317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:49.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'156","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736032+0000","last_change":"2024-09-13T18:39:14.591231+0000","last_active":"2024-09-13T18:43:38.736032+0000","last_peered":"2024-09-13T18:43:38.736032+0000","last_clean":"2024-09-13T18:43:38.736032+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:43:38.736032+0000","last_undegraded":"2024-09-13T18:43:38.736032+0000","last_fullsized":"2024-09-13T18:43:38.736032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"23'189","reported_seq":201,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730161+0000","last_change":"2024-09-13T18:39:14.589017+0000","last_active":"2024-09-13T18:43:38.730161+0000","last_peered":"2024-09-13T18:43:38.730161+0000","last_clean":"2024-09-13T18:43:38.730161+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:43:38.730161+0000","last_undegraded":"2024-09-13T18:43:38.730161+0000","last_fullsized":"2024-09-13T18:43:38.730161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"23'142","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.715282+0000","last_change":"2024-09-13T18:39:14.592629+0000","last_active":"2024-09-13T18:43:38.715282+0000","last_peered":"2024-09-13T18:43:38.715282+0000","last_clean":"2024-09-13T18:43:38.715282+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:43:38.715282+0000","last_undegraded":"2024-09-13T18:43:38.715282+0000","last_fullsized":"2024-09-13T18:43:38.715282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738828+0000","last_change":"2024-09-13T18:39:14.597709+0000","last_active":"2024-09-13T18:43:38.738828+0000","last_peered":"2024-09-13T18:43:38.738828+0000","last_clean":"2024-09-13T18:43:38.738828+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:43:38.738828+0000","last_undegraded":"2024-09-13T18:43:38.738828+0000","last_fullsized":"2024-09-13T18:43:38.738828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.367739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'149","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731243+0000","last_change":"2024-09-13T18:39:14.572267+0000","last_active":"2024-09-13T18:43:38.731243+0000","last_peered":"2024-09-13T18:43:38.731243+0000","last_clean":"2024-09-13T18:43:38.731243+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:43:38.731243+0000","last_undegraded":"2024-09-13T18:43:38.731243+0000","last_fullsized":"2024-09-13T18:43:38.731243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.728216+0000","last_change":"2024-09-13T18:39:14.583318+0000","last_active":"2024-09-13T18:43:38.728216+0000","last_peered":"2024-09-13T18:43:38.728216+0000","last_clean":"2024-09-13T18:43:38.728216+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:43:38.728216+0000","last_undegraded":"2024-09-13T18:43:38.728216+0000","last_fullsized":"2024-09-13T18:43:38.728216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"23'147","reported_seq":159,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741185+0000","last_change":"2024-09-13T18:39:14.592378+0000","last_active":"2024-09-13T18:43:38.741185+0000","last_peered":"2024-09-13T18:43:38.741185+0000","last_clean":"2024-09-13T18:43:38.741185+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:43:38.741185+0000","last_undegraded":"2024-09-13T18:43:38.741185+0000","last_fullsized":"2024-09-13T18:43:38.741185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:02.414361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'146","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.721992+0000","last_change":"2024-09-13T18:39:14.586945+0000","last_active":"2024-09-13T18:43:38.721992+0000","last_peered":"2024-09-13T18:43:38.721992+0000","last_clean":"2024-09-13T18:43:38.721992+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:43:38.721992+0000","last_undegraded":"2024-09-13T18:43:38.721992+0000","last_fullsized":"2024-09-13T18:43:38.721992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:57.889039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'157","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734859+0000","last_change":"2024-09-13T18:39:14.587172+0000","last_active":"2024-09-13T18:43:38.734859+0000","last_peered":"2024-09-13T18:43:38.734859+0000","last_clean":"2024-09-13T18:43:38.734859+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:43:38.734859+0000","last_undegraded":"2024-09-13T18:43:38.734859+0000","last_fullsized":"2024-09-13T18:43:38.734859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"23'172","reported_seq":184,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719162+0000","last_change":"2024-09-13T18:39:14.594291+0000","last_active":"2024-09-13T18:43:38.719162+0000","last_peered":"2024-09-13T18:43:38.719162+0000","last_clean":"2024-09-13T18:43:38.719162+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:43:38.719162+0000","last_undegraded":"2024-09-13T18:43:38.719162+0000","last_fullsized":"2024-09-13T18:43:38.719162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:29.208875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'161","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737482+0000","last_change":"2024-09-13T18:39:14.585973+0000","last_active":"2024-09-13T18:43:38.737482+0000","last_peered":"2024-09-13T18:43:38.737482+0000","last_clean":"2024-09-13T18:43:38.737482+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:43:38.737482+0000","last_undegraded":"2024-09-13T18:43:38.737482+0000","last_fullsized":"2024-09-13T18:43:38.737482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:48.875040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"23'137","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727488+0000","last_change":"2024-09-13T18:39:14.595451+0000","last_active":"2024-09-13T18:43:38.727488+0000","last_peered":"2024-09-13T18:43:38.727488+0000","last_clean":"2024-09-13T18:43:38.727488+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:43:38.727488+0000","last_undegraded":"2024-09-13T18:43:38.727488+0000","last_fullsized":"2024-09-13T18:43:38.727488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:45.368802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"23'166","reported_seq":178,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727552+0000","last_change":"2024-09-13T18:39:14.583590+0000","last_active":"2024-09-13T18:43:38.727552+0000","last_peered":"2024-09-13T18:43:38.727552+0000","last_clean":"2024-09-13T18:43:38.727552+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:43:38.727552+0000","last_undegraded":"2024-09-13T18:43:38.727552+0000","last_fullsized":"2024-09-13T18:43:38.727552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'134","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737455+0000","last_change":"2024-09-13T18:39:14.590724+0000","last_active":"2024-09-13T18:43:38.737455+0000","last_peered":"2024-09-13T18:43:38.737455+0000","last_clean":"2024-09-13T18:43:38.737455+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:43:38.737455+0000","last_undegraded":"2024-09-13T18:43:38.737455+0000","last_fullsized":"2024-09-13T18:43:38.737455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:09.353955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"23'180","reported_seq":192,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731840+0000","last_change":"2024-09-13T18:39:14.577642+0000","last_active":"2024-09-13T18:43:38.731840+0000","last_peered":"2024-09-13T18:43:38.731840+0000","last_clean":"2024-09-13T18:43:38.731840+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:43:38.731840+0000","last_undegraded":"2024-09-13T18:43:38.731840+0000","last_fullsized":"2024-09-13T18:43:38.731840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"23'134","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736869+0000","last_change":"2024-09-13T18:39:14.592432+0000","last_active":"2024-09-13T18:43:38.736869+0000","last_peered":"2024-09-13T18:43:38.736869+0000","last_clean":"2024-09-13T18:43:38.736869+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:43:38.736869+0000","last_undegraded":"2024-09-13T18:43:38.736869+0000","last_fullsized":"2024-09-13T18:43:38.736869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:43.945214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'198","reported_seq":210,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.728569+0000","last_change":"2024-09-13T18:39:14.571893+0000","last_active":"2024-09-13T18:43:38.728569+0000","last_peered":"2024-09-13T18:43:38.728569+0000","last_clean":"2024-09-13T18:43:38.728569+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:43:38.728569+0000","last_undegraded":"2024-09-13T18:43:38.728569+0000","last_fullsized":"2024-09-13T18:43:38.728569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'144","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719698+0000","last_change":"2024-09-13T18:39:14.594222+0000","last_active":"2024-09-13T18:43:38.719698+0000","last_peered":"2024-09-13T18:43:38.719698+0000","last_clean":"2024-09-13T18:43:38.719698+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:43:38.719698+0000","last_undegraded":"2024-09-13T18:43:38.719698+0000","last_fullsized":"2024-09-13T18:43:38.719698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:20.265556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'133","reported_seq":145,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739499+0000","last_change":"2024-09-13T18:39:14.576203+0000","last_active":"2024-09-13T18:43:38.739499+0000","last_peered":"2024-09-13T18:43:38.739499+0000","last_clean":"2024-09-13T18:43:38.739499+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:43:38.739499+0000","last_undegraded":"2024-09-13T18:43:38.739499+0000","last_fullsized":"2024-09-13T18:43:38.739499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"23'118","reported_seq":130,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740575+0000","last_change":"2024-09-13T18:39:14.586374+0000","last_active":"2024-09-13T18:43:38.740575+0000","last_peered":"2024-09-13T18:43:38.740575+0000","last_clean":"2024-09-13T18:43:38.740575+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:43:38.740575+0000","last_undegraded":"2024-09-13T18:43:38.740575+0000","last_fullsized":"2024-09-13T18:43:38.740575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:03.191196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'131","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.714196+0000","last_change":"2024-09-13T18:39:14.577392+0000","last_active":"2024-09-13T18:43:38.714196+0000","last_peered":"2024-09-13T18:43:38.714196+0000","last_clean":"2024-09-13T18:43:38.714196+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:43:38.714196+0000","last_undegraded":"2024-09-13T18:43:38.714196+0000","last_fullsized":"2024-09-13T18:43:38.714196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:26.709807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"23'135","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740453+0000","last_change":"2024-09-13T18:39:14.580898+0000","last_active":"2024-09-13T18:43:38.740453+0000","last_peered":"2024-09-13T18:43:38.740453+0000","last_clean":"2024-09-13T18:43:38.740453+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:43:38.740453+0000","last_undegraded":"2024-09-13T18:43:38.740453+0000","last_fullsized":"2024-09-13T18:43:38.740453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:23.630337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"23'150","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.716995+0000","last_change":"2024-09-13T18:39:14.574811+0000","last_active":"2024-09-13T18:43:38.716995+0000","last_peered":"2024-09-13T18:43:38.716995+0000","last_clean":"2024-09-13T18:43:38.716995+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:43:38.716995+0000","last_undegraded":"2024-09-13T18:43:38.716995+0000","last_fullsized":"2024-09-13T18:43:38.716995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"23'149","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730224+0000","last_change":"2024-09-13T18:39:14.579494+0000","last_active":"2024-09-13T18:43:38.730224+0000","last_peered":"2024-09-13T18:43:38.730224+0000","last_clean":"2024-09-13T18:43:38.730224+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:43:38.730224+0000","last_undegraded":"2024-09-13T18:43:38.730224+0000","last_fullsized":"2024-09-13T18:43:38.730224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:19.432936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660311+0000","last_change":"2024-09-13T18:39:13.575179+0000","last_active":"2024-09-13T18:39:53.660311+0000","last_peered":"2024-09-13T18:39:53.660311+0000","last_clean":"2024-09-13T18:39:53.660311+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:39:53.660311+0000","last_undegraded":"2024-09-13T18:39:53.660311+0000","last_fullsized":"2024-09-13T18:39:53.660311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:25.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"23'150","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717407+0000","last_change":"2024-09-13T18:39:14.594066+0000","last_active":"2024-09-13T18:43:38.717407+0000","last_peered":"2024-09-13T18:43:38.717407+0000","last_clean":"2024-09-13T18:43:38.717407+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:43:38.717407+0000","last_undegraded":"2024-09-13T18:43:38.717407+0000","last_fullsized":"2024-09-13T18:43:38.717407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:14.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665780+0000","last_change":"2024-09-13T18:39:13.570778+0000","last_active":"2024-09-13T18:39:53.665780+0000","last_peered":"2024-09-13T18:39:53.665780+0000","last_clean":"2024-09-13T18:39:53.665780+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:39:53.665780+0000","last_undegraded":"2024-09-13T18:39:53.665780+0000","last_fullsized":"2024-09-13T18:39:53.665780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"23'229","reported_seq":250,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739934+0000","last_change":"2024-09-13T18:39:54.668508+0000","last_active":"2024-09-13T18:43:38.739934+0000","last_peered":"2024-09-13T18:43:38.739934+0000","last_clean":"2024-09-13T18:43:38.739934+0000","last_became_active":"2024-09-13T18:39:54.668035+0000","last_became_peered":"2024-09-13T18:39:54.668035+0000","last_unstale":"2024-09-13T18:43:38.739934+0000","last_undegraded":"2024-09-13T18:43:38.739934+0000","last_fullsized":"2024-09-13T18:43:38.739934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:40.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663232+0000","last_change":"2024-09-13T18:39:13.575436+0000","last_active":"2024-09-13T18:39:53.663232+0000","last_peered":"2024-09-13T18:39:53.663232+0000","last_clean":"2024-09-13T18:39:53.663232+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:39:53.663232+0000","last_undegraded":"2024-09-13T18:39:53.663232+0000","last_fullsized":"2024-09-13T18:39:53.663232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:34.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'141","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737866+0000","last_change":"2024-09-13T18:39:14.584791+0000","last_active":"2024-09-13T18:43:38.737866+0000","last_peered":"2024-09-13T18:43:38.737866+0000","last_clean":"2024-09-13T18:43:38.737866+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:43:38.737866+0000","last_undegraded":"2024-09-13T18:43:38.737866+0000","last_fullsized":"2024-09-13T18:43:38.737866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:08.799126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'9","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.663475+0000","last_change":"2024-09-13T18:39:13.578940+0000","last_active":"2024-09-13T18:39:54.663475+0000","last_peered":"2024-09-13T18:39:54.663475+0000","last_clean":"2024-09-13T18:39:54.663475+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:39:54.663475+0000","last_undegraded":"2024-09-13T18:39:54.663475+0000","last_fullsized":"2024-09-13T18:39:54.663475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:34.109209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666409+0000","last_change":"2024-09-13T18:39:13.583184+0000","last_active":"2024-09-13T18:39:53.666409+0000","last_peered":"2024-09-13T18:39:53.666409+0000","last_clean":"2024-09-13T18:39:53.666409+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:39:53.666409+0000","last_undegraded":"2024-09-13T18:39:53.666409+0000","last_fullsized":"2024-09-13T18:39:53.666409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"23'153","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741409+0000","last_change":"2024-09-13T18:39:54.668672+0000","last_active":"2024-09-13T18:43:38.741409+0000","last_peered":"2024-09-13T18:43:38.741409+0000","last_clean":"2024-09-13T18:43:38.741409+0000","last_became_active":"2024-09-13T18:39:54.668322+0000","last_became_peered":"2024-09-13T18:39:54.668322+0000","last_unstale":"2024-09-13T18:43:38.741409+0000","last_undegraded":"2024-09-13T18:43:38.741409+0000","last_fullsized":"2024-09-13T18:43:38.741409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:43.914025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662667+0000","last_change":"2024-09-13T18:39:13.571043+0000","last_active":"2024-09-13T18:39:53.662667+0000","last_peered":"2024-09-13T18:39:53.662667+0000","last_clean":"2024-09-13T18:39:53.662667+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:39:53.662667+0000","last_undegraded":"2024-09-13T18:39:53.662667+0000","last_fullsized":"2024-09-13T18:39:53.662667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.757855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'134","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.709074+0000","last_change":"2024-09-13T18:39:14.577177+0000","last_active":"2024-09-13T18:43:38.709074+0000","last_peered":"2024-09-13T18:43:38.709074+0000","last_clean":"2024-09-13T18:43:38.709074+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:43:38.709074+0000","last_undegraded":"2024-09-13T18:43:38.709074+0000","last_fullsized":"2024-09-13T18:43:38.709074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667326+0000","last_change":"2024-09-13T18:39:13.581627+0000","last_active":"2024-09-13T18:39:53.667326+0000","last_peered":"2024-09-13T18:39:53.667326+0000","last_clean":"2024-09-13T18:39:53.667326+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:39:53.667326+0000","last_undegraded":"2024-09-13T18:39:53.667326+0000","last_fullsized":"2024-09-13T18:39:53.667326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:48.023626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'128","reported_seq":140,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.724030+0000","last_change":"2024-09-13T18:39:14.596602+0000","last_active":"2024-09-13T18:43:38.724030+0000","last_peered":"2024-09-13T18:43:38.724030+0000","last_clean":"2024-09-13T18:43:38.724030+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:43:38.724030+0000","last_undegraded":"2024-09-13T18:43:38.724030+0000","last_fullsized":"2024-09-13T18:43:38.724030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:35.414913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666092+0000","last_change":"2024-09-13T18:39:13.570169+0000","last_active":"2024-09-13T18:39:53.666092+0000","last_peered":"2024-09-13T18:39:53.666092+0000","last_clean":"2024-09-13T18:39:53.666092+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:39:53.666092+0000","last_undegraded":"2024-09-13T18:39:53.666092+0000","last_fullsized":"2024-09-13T18:39:53.666092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"23'143","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727371+0000","last_change":"2024-09-13T18:39:14.584580+0000","last_active":"2024-09-13T18:43:38.727371+0000","last_peered":"2024-09-13T18:43:38.727371+0000","last_clean":"2024-09-13T18:43:38.727371+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:43:38.727371+0000","last_undegraded":"2024-09-13T18:43:38.727371+0000","last_fullsized":"2024-09-13T18:43:38.727371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664054+0000","last_change":"2024-09-13T18:39:13.575713+0000","last_active":"2024-09-13T18:39:54.664054+0000","last_peered":"2024-09-13T18:39:54.664054+0000","last_clean":"2024-09-13T18:39:54.664054+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:39:54.664054+0000","last_undegraded":"2024-09-13T18:39:54.664054+0000","last_fullsized":"2024-09-13T18:39:54.664054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:59.985917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'144","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.711181+0000","last_change":"2024-09-13T18:39:14.577151+0000","last_active":"2024-09-13T18:43:38.711181+0000","last_peered":"2024-09-13T18:43:38.711181+0000","last_clean":"2024-09-13T18:43:38.711181+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:43:38.711181+0000","last_undegraded":"2024-09-13T18:43:38.711181+0000","last_fullsized":"2024-09-13T18:43:38.711181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663898+0000","last_change":"2024-09-13T18:39:13.581445+0000","last_active":"2024-09-13T18:39:53.663898+0000","last_peered":"2024-09-13T18:39:53.663898+0000","last_clean":"2024-09-13T18:39:53.663898+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:39:53.663898+0000","last_undegraded":"2024-09-13T18:39:53.663898+0000","last_fullsized":"2024-09-13T18:39:53.663898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:39.003339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734368+0000","last_change":"2024-09-13T18:39:14.584122+0000","last_active":"2024-09-13T18:43:38.734368+0000","last_peered":"2024-09-13T18:43:38.734368+0000","last_clean":"2024-09-13T18:43:38.734368+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:43:38.734368+0000","last_undegraded":"2024-09-13T18:43:38.734368+0000","last_fullsized":"2024-09-13T18:43:38.734368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:30.405734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663324+0000","last_change":"2024-09-13T18:39:13.575316+0000","last_active":"2024-09-13T18:39:53.663324+0000","last_peered":"2024-09-13T18:39:53.663324+0000","last_clean":"2024-09-13T18:39:53.663324+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:39:53.663324+0000","last_undegraded":"2024-09-13T18:39:53.663324+0000","last_fullsized":"2024-09-13T18:39:53.663324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:06.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'146","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719389+0000","last_change":"2024-09-13T18:39:14.593058+0000","last_active":"2024-09-13T18:43:38.719389+0000","last_peered":"2024-09-13T18:43:38.719389+0000","last_clean":"2024-09-13T18:43:38.719389+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:43:38.719389+0000","last_undegraded":"2024-09-13T18:43:38.719389+0000","last_fullsized":"2024-09-13T18:43:38.719389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:24.454698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661099+0000","last_change":"2024-09-13T18:39:13.581217+0000","last_active":"2024-09-13T18:39:53.661099+0000","last_peered":"2024-09-13T18:39:53.661099+0000","last_clean":"2024-09-13T18:39:53.661099+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:39:53.661099+0000","last_undegraded":"2024-09-13T18:39:53.661099+0000","last_fullsized":"2024-09-13T18:39:53.661099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:27.361025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'138","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739846+0000","last_change":"2024-09-13T18:39:14.596597+0000","last_active":"2024-09-13T18:43:38.739846+0000","last_peered":"2024-09-13T18:43:38.739846+0000","last_clean":"2024-09-13T18:43:38.739846+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:43:38.739846+0000","last_undegraded":"2024-09-13T18:43:38.739846+0000","last_fullsized":"2024-09-13T18:43:38.739846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:47.680908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":87,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661174+0000","last_change":"2024-09-13T18:39:03.413753+0000","last_active":"2024-09-13T18:39:53.661174+0000","last_peered":"2024-09-13T18:39:53.661174+0000","last_clean":"2024-09-13T18:39:53.661174+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:39:53.661174+0000","last_undegraded":"2024-09-13T18:39:53.661174+0000","last_fullsized":"2024-09-13T18:39:53.661174+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.425159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:05.703287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660538+0000","last_change":"2024-09-13T18:39:09.531787+0000","last_active":"2024-09-13T18:39:53.660538+0000","last_peered":"2024-09-13T18:39:53.660538+0000","last_clean":"2024-09-13T18:39:53.660538+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:39:53.660538+0000","last_undegraded":"2024-09-13T18:39:53.660538+0000","last_fullsized":"2024-09-13T18:39:53.660538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:21.652872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664040+0000","last_change":"2024-09-13T18:39:13.575940+0000","last_active":"2024-09-13T18:39:53.664040+0000","last_peered":"2024-09-13T18:39:53.664040+0000","last_clean":"2024-09-13T18:39:53.664040+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:39:53.664040+0000","last_undegraded":"2024-09-13T18:39:53.664040+0000","last_fullsized":"2024-09-13T18:39:53.664040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:23.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'143","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730832+0000","last_change":"2024-09-13T18:39:54.668486+0000","last_active":"2024-09-13T18:43:38.730832+0000","last_peered":"2024-09-13T18:43:38.730832+0000","last_clean":"2024-09-13T18:43:38.730832+0000","last_became_active":"2024-09-13T18:39:54.668177+0000","last_became_peered":"2024-09-13T18:39:54.668177+0000","last_unstale":"2024-09-13T18:43:38.730832+0000","last_undegraded":"2024-09-13T18:43:38.730832+0000","last_fullsized":"2024-09-13T18:43:38.730832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:01.415577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661120+0000","last_change":"2024-09-13T18:39:09.531377+0000","last_active":"2024-09-13T18:39:53.661120+0000","last_peered":"2024-09-13T18:39:53.661120+0000","last_clean":"2024-09-13T18:39:53.661120+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:39:53.661120+0000","last_undegraded":"2024-09-13T18:39:53.661120+0000","last_fullsized":"2024-09-13T18:39:53.661120+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.437998+0000","last_change":"2024-09-13T18:39:13.563570+0000","last_active":"2024-09-13T18:43:37.437998+0000","last_peered":"2024-09-13T18:43:37.437998+0000","last_clean":"2024-09-13T18:43:37.437998+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:43:37.437998+0000","last_undegraded":"2024-09-13T18:43:37.437998+0000","last_fullsized":"2024-09-13T18:43:37.437998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'163","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736074+0000","last_change":"2024-09-13T18:39:14.587017+0000","last_active":"2024-09-13T18:43:38.736074+0000","last_peered":"2024-09-13T18:43:38.736074+0000","last_clean":"2024-09-13T18:43:38.736074+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:43:38.736074+0000","last_undegraded":"2024-09-13T18:43:38.736074+0000","last_fullsized":"2024-09-13T18:43:38.736074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661881+0000","last_change":"2024-09-13T18:39:09.533004+0000","last_active":"2024-09-13T18:39:53.661881+0000","last_peered":"2024-09-13T18:39:53.661881+0000","last_clean":"2024-09-13T18:39:53.661881+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:39:53.661881+0000","last_undegraded":"2024-09-13T18:39:53.661881+0000","last_fullsized":"2024-09-13T18:39:53.661881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:41.079838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660963+0000","last_change":"2024-09-13T18:39:13.579066+0000","last_active":"2024-09-13T18:39:53.660963+0000","last_peered":"2024-09-13T18:39:53.660963+0000","last_clean":"2024-09-13T18:39:53.660963+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:39:53.660963+0000","last_undegraded":"2024-09-13T18:39:53.660963+0000","last_fullsized":"2024-09-13T18:39:53.660963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'143","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730317+0000","last_change":"2024-09-13T18:39:14.589734+0000","last_active":"2024-09-13T18:43:38.730317+0000","last_peered":"2024-09-13T18:43:38.730317+0000","last_clean":"2024-09-13T18:43:38.730317+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:43:38.730317+0000","last_undegraded":"2024-09-13T18:43:38.730317+0000","last_fullsized":"2024-09-13T18:43:38.730317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664123+0000","last_change":"2024-09-13T18:39:09.532311+0000","last_active":"2024-09-13T18:39:53.664123+0000","last_peered":"2024-09-13T18:39:53.664123+0000","last_clean":"2024-09-13T18:39:53.664123+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:39:53.664123+0000","last_undegraded":"2024-09-13T18:39:53.664123+0000","last_fullsized":"2024-09-13T18:39:53.664123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:53.060128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666753+0000","last_change":"2024-09-13T18:39:13.571488+0000","last_active":"2024-09-13T18:39:53.666753+0000","last_peered":"2024-09-13T18:39:53.666753+0000","last_clean":"2024-09-13T18:39:53.666753+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:39:53.666753+0000","last_undegraded":"2024-09-13T18:39:53.666753+0000","last_fullsized":"2024-09-13T18:39:53.666753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:44.121699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"23'144","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730418+0000","last_change":"2024-09-13T18:39:14.579779+0000","last_active":"2024-09-13T18:43:38.730418+0000","last_peered":"2024-09-13T18:43:38.730418+0000","last_clean":"2024-09-13T18:43:38.730418+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:43:38.730418+0000","last_undegraded":"2024-09-13T18:43:38.730418+0000","last_fullsized":"2024-09-13T18:43:38.730418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660742+0000","last_change":"2024-09-13T18:39:13.577844+0000","last_active":"2024-09-13T18:39:53.660742+0000","last_peered":"2024-09-13T18:39:53.660742+0000","last_clean":"2024-09-13T18:39:53.660742+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:39:53.660742+0000","last_undegraded":"2024-09-13T18:39:53.660742+0000","last_fullsized":"2024-09-13T18:39:53.660742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661619+0000","last_change":"2024-09-13T18:39:09.533091+0000","last_active":"2024-09-13T18:39:53.661619+0000","last_peered":"2024-09-13T18:39:53.661619+0000","last_clean":"2024-09-13T18:39:53.661619+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:39:53.661619+0000","last_undegraded":"2024-09-13T18:39:53.661619+0000","last_fullsized":"2024-09-13T18:39:53.661619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"23'158","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.728247+0000","last_change":"2024-09-13T18:39:14.597238+0000","last_active":"2024-09-13T18:43:38.728247+0000","last_peered":"2024-09-13T18:43:38.728247+0000","last_clean":"2024-09-13T18:43:38.728247+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:43:38.728247+0000","last_undegraded":"2024-09-13T18:43:38.728247+0000","last_fullsized":"2024-09-13T18:43:38.728247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.849783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660988+0000","last_change":"2024-09-13T18:39:13.583071+0000","last_active":"2024-09-13T18:39:53.660988+0000","last_peered":"2024-09-13T18:39:53.660988+0000","last_clean":"2024-09-13T18:39:53.660988+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:39:53.660988+0000","last_undegraded":"2024-09-13T18:39:53.660988+0000","last_fullsized":"2024-09-13T18:39:53.660988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667429+0000","last_change":"2024-09-13T18:39:09.532042+0000","last_active":"2024-09-13T18:39:53.667429+0000","last_peered":"2024-09-13T18:39:53.667429+0000","last_clean":"2024-09-13T18:39:53.667429+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:39:53.667429+0000","last_undegraded":"2024-09-13T18:39:53.667429+0000","last_fullsized":"2024-09-13T18:39:53.667429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:24.541036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"23'145","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717323+0000","last_change":"2024-09-13T18:39:14.584428+0000","last_active":"2024-09-13T18:43:38.717323+0000","last_peered":"2024-09-13T18:43:38.717323+0000","last_clean":"2024-09-13T18:43:38.717323+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:43:38.717323+0000","last_undegraded":"2024-09-13T18:43:38.717323+0000","last_fullsized":"2024-09-13T18:43:38.717323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.662382+0000","last_change":"2024-09-13T18:39:13.583868+0000","last_active":"2024-09-13T18:39:54.662382+0000","last_peered":"2024-09-13T18:39:54.662382+0000","last_clean":"2024-09-13T18:39:54.662382+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:39:54.662382+0000","last_undegraded":"2024-09-13T18:39:54.662382+0000","last_fullsized":"2024-09-13T18:39:54.662382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:52.540883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662865+0000","last_change":"2024-09-13T18:39:09.532757+0000","last_active":"2024-09-13T18:39:53.662865+0000","last_peered":"2024-09-13T18:39:53.662865+0000","last_clean":"2024-09-13T18:39:53.662865+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:39:53.662865+0000","last_undegraded":"2024-09-13T18:39:53.662865+0000","last_fullsized":"2024-09-13T18:39:53.662865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:32.617744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"23'131","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741518+0000","last_change":"2024-09-13T18:39:14.582490+0000","last_active":"2024-09-13T18:43:38.741518+0000","last_peered":"2024-09-13T18:43:38.741518+0000","last_clean":"2024-09-13T18:43:38.741518+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:43:38.741518+0000","last_undegraded":"2024-09-13T18:43:38.741518+0000","last_fullsized":"2024-09-13T18:43:38.741518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:44.239715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'10","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:34.630546+0000","last_change":"2024-09-13T18:39:13.583929+0000","last_active":"2024-09-13T18:43:34.630546+0000","last_peered":"2024-09-13T18:43:34.630546+0000","last_clean":"2024-09-13T18:43:34.630546+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:43:34.630546+0000","last_undegraded":"2024-09-13T18:43:34.630546+0000","last_fullsized":"2024-09-13T18:43:34.630546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:57.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663547+0000","last_change":"2024-09-13T18:39:09.531717+0000","last_active":"2024-09-13T18:39:53.663547+0000","last_peered":"2024-09-13T18:39:53.663547+0000","last_clean":"2024-09-13T18:39:53.663547+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:39:53.663547+0000","last_undegraded":"2024-09-13T18:39:53.663547+0000","last_fullsized":"2024-09-13T18:39:53.663547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:33.878130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"23'131","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.715217+0000","last_change":"2024-09-13T18:39:54.667668+0000","last_active":"2024-09-13T18:43:38.715217+0000","last_peered":"2024-09-13T18:43:38.715217+0000","last_clean":"2024-09-13T18:43:38.715217+0000","last_became_active":"2024-09-13T18:39:54.667244+0000","last_became_peered":"2024-09-13T18:39:54.667244+0000","last_unstale":"2024-09-13T18:43:38.715217+0000","last_undegraded":"2024-09-13T18:43:38.715217+0000","last_fullsized":"2024-09-13T18:43:38.715217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:56.127916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"23'171","reported_seq":183,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739130+0000","last_change":"2024-09-13T18:39:14.593754+0000","last_active":"2024-09-13T18:43:38.739130+0000","last_peered":"2024-09-13T18:43:38.739130+0000","last_clean":"2024-09-13T18:43:38.739130+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:43:38.739130+0000","last_undegraded":"2024-09-13T18:43:38.739130+0000","last_fullsized":"2024-09-13T18:43:38.739130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:07.651837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"23'95","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.742654+0000","last_change":"2024-09-13T18:39:13.575507+0000","last_active":"2024-09-13T18:43:38.742654+0000","last_peered":"2024-09-13T18:43:38.742654+0000","last_clean":"2024-09-13T18:43:38.742654+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:43:38.742654+0000","last_undegraded":"2024-09-13T18:43:38.742654+0000","last_fullsized":"2024-09-13T18:43:38.742654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:42.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198201,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"23'157","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.735249+0000","last_change":"2024-09-13T18:39:14.598160+0000","last_active":"2024-09-13T18:43:38.735249+0000","last_peered":"2024-09-13T18:43:38.735249+0000","last_clean":"2024-09-13T18:43:38.735249+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:43:38.735249+0000","last_undegraded":"2024-09-13T18:43:38.735249+0000","last_fullsized":"2024-09-13T18:43:38.735249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.437719+0000","last_change":"2024-09-13T18:39:13.572017+0000","last_active":"2024-09-13T18:43:37.437719+0000","last_peered":"2024-09-13T18:43:37.437719+0000","last_clean":"2024-09-13T18:43:37.437719+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:43:37.437719+0000","last_undegraded":"2024-09-13T18:43:37.437719+0000","last_fullsized":"2024-09-13T18:43:37.437719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:25.536255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662584+0000","last_change":"2024-09-13T18:39:13.571792+0000","last_active":"2024-09-13T18:39:53.662584+0000","last_peered":"2024-09-13T18:39:53.662584+0000","last_clean":"2024-09-13T18:39:53.662584+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:39:53.662584+0000","last_undegraded":"2024-09-13T18:39:53.662584+0000","last_fullsized":"2024-09-13T18:39:53.662584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'189","reported_seq":201,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737335+0000","last_change":"2024-09-13T18:39:14.590748+0000","last_active":"2024-09-13T18:43:38.737335+0000","last_peered":"2024-09-13T18:43:38.737335+0000","last_clean":"2024-09-13T18:43:38.737335+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:43:38.737335+0000","last_undegraded":"2024-09-13T18:43:38.737335+0000","last_fullsized":"2024-09-13T18:43:38.737335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:49.557245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.666030+0000","last_change":"2024-09-13T18:39:13.569863+0000","last_active":"2024-09-13T18:39:54.666030+0000","last_peered":"2024-09-13T18:39:54.666030+0000","last_clean":"2024-09-13T18:39:54.666030+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:39:54.666030+0000","last_undegraded":"2024-09-13T18:39:54.666030+0000","last_fullsized":"2024-09-13T18:39:54.666030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'165","reported_seq":177,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740654+0000","last_change":"2024-09-13T18:39:14.582205+0000","last_active":"2024-09-13T18:43:38.740654+0000","last_peered":"2024-09-13T18:43:38.740654+0000","last_clean":"2024-09-13T18:43:38.740654+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:43:38.740654+0000","last_undegraded":"2024-09-13T18:43:38.740654+0000","last_fullsized":"2024-09-13T18:43:38.740654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.186210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'135","reported_seq":144,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730768+0000","last_change":"2024-09-13T18:39:54.668351+0000","last_active":"2024-09-13T18:43:38.730768+0000","last_peered":"2024-09-13T18:43:38.730768+0000","last_clean":"2024-09-13T18:43:38.730768+0000","last_became_active":"2024-09-13T18:39:54.667809+0000","last_became_peered":"2024-09-13T18:39:54.667809+0000","last_unstale":"2024-09-13T18:43:38.730768+0000","last_undegraded":"2024-09-13T18:43:38.730768+0000","last_fullsized":"2024-09-13T18:43:38.730768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:40.114429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661053+0000","last_change":"2024-09-13T18:39:13.573803+0000","last_active":"2024-09-13T18:39:53.661053+0000","last_peered":"2024-09-13T18:39:53.661053+0000","last_clean":"2024-09-13T18:39:53.661053+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:39:53.661053+0000","last_undegraded":"2024-09-13T18:39:53.661053+0000","last_fullsized":"2024-09-13T18:39:53.661053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:08.298094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"23'152","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734010+0000","last_change":"2024-09-13T18:39:14.586848+0000","last_active":"2024-09-13T18:43:38.734010+0000","last_peered":"2024-09-13T18:43:38.734010+0000","last_clean":"2024-09-13T18:43:38.734010+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:43:38.734010+0000","last_undegraded":"2024-09-13T18:43:38.734010+0000","last_fullsized":"2024-09-13T18:43:38.734010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660115+0000","last_change":"2024-09-13T18:39:13.586123+0000","last_active":"2024-09-13T18:39:53.660115+0000","last_peered":"2024-09-13T18:39:53.660115+0000","last_clean":"2024-09-13T18:39:53.660115+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:39:53.660115+0000","last_undegraded":"2024-09-13T18:39:53.660115+0000","last_fullsized":"2024-09-13T18:39:53.660115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"23'183","reported_seq":192,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731266+0000","last_change":"2024-09-13T18:39:54.668883+0000","last_active":"2024-09-13T18:43:38.731266+0000","last_peered":"2024-09-13T18:43:38.731266+0000","last_clean":"2024-09-13T18:43:38.731266+0000","last_became_active":"2024-09-13T18:39:54.668613+0000","last_became_peered":"2024-09-13T18:39:54.668613+0000","last_unstale":"2024-09-13T18:43:38.731266+0000","last_undegraded":"2024-09-13T18:43:38.731266+0000","last_fullsized":"2024-09-13T18:43:38.731266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:31.076844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661254+0000","last_change":"2024-09-13T18:39:13.575435+0000","last_active":"2024-09-13T18:39:53.661254+0000","last_peered":"2024-09-13T18:39:53.661254+0000","last_clean":"2024-09-13T18:39:53.661254+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:39:53.661254+0000","last_undegraded":"2024-09-13T18:39:53.661254+0000","last_fullsized":"2024-09-13T18:39:53.661254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"23'141","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727330+0000","last_change":"2024-09-13T18:39:14.580846+0000","last_active":"2024-09-13T18:43:38.727330+0000","last_peered":"2024-09-13T18:43:38.727330+0000","last_clean":"2024-09-13T18:43:38.727330+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:43:38.727330+0000","last_undegraded":"2024-09-13T18:43:38.727330+0000","last_fullsized":"2024-09-13T18:43:38.727330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.010053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666752+0000","last_change":"2024-09-13T18:39:13.571042+0000","last_active":"2024-09-13T18:39:53.666752+0000","last_peered":"2024-09-13T18:39:53.666752+0000","last_clean":"2024-09-13T18:39:53.666752+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:39:53.666752+0000","last_undegraded":"2024-09-13T18:39:53.666752+0000","last_fullsized":"2024-09-13T18:39:53.666752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.288993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"23'137","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738740+0000","last_change":"2024-09-13T18:39:14.593258+0000","last_active":"2024-09-13T18:43:38.738740+0000","last_peered":"2024-09-13T18:43:38.738740+0000","last_clean":"2024-09-13T18:43:38.738740+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:43:38.738740+0000","last_undegraded":"2024-09-13T18:43:38.738740+0000","last_fullsized":"2024-09-13T18:43:38.738740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:21.972039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660913+0000","last_change":"2024-09-13T18:39:13.584903+0000","last_active":"2024-09-13T18:39:53.660913+0000","last_peered":"2024-09-13T18:39:53.660913+0000","last_clean":"2024-09-13T18:39:53.660913+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:39:53.660913+0000","last_undegraded":"2024-09-13T18:39:53.660913+0000","last_fullsized":"2024-09-13T18:39:53.660913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:46.551317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"23'130","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.714269+0000","last_change":"2024-09-13T18:39:54.667465+0000","last_active":"2024-09-13T18:43:38.714269+0000","last_peered":"2024-09-13T18:43:38.714269+0000","last_clean":"2024-09-13T18:43:38.714269+0000","last_became_active":"2024-09-13T18:39:54.667188+0000","last_became_peered":"2024-09-13T18:39:54.667188+0000","last_unstale":"2024-09-13T18:43:38.714269+0000","last_undegraded":"2024-09-13T18:43:38.714269+0000","last_fullsized":"2024-09-13T18:43:38.714269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:40.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664322+0000","last_change":"2024-09-13T18:39:13.574044+0000","last_active":"2024-09-13T18:39:54.664322+0000","last_peered":"2024-09-13T18:39:54.664322+0000","last_clean":"2024-09-13T18:39:54.664322+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:39:54.664322+0000","last_undegraded":"2024-09-13T18:39:54.664322+0000","last_fullsized":"2024-09-13T18:39:54.664322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:12.168801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'157","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739642+0000","last_change":"2024-09-13T18:39:14.591381+0000","last_active":"2024-09-13T18:43:38.739642+0000","last_peered":"2024-09-13T18:43:38.739642+0000","last_clean":"2024-09-13T18:43:38.739642+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:43:38.739642+0000","last_undegraded":"2024-09-13T18:43:38.739642+0000","last_fullsized":"2024-09-13T18:43:38.739642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:17.239023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661826+0000","last_change":"2024-09-13T18:39:13.575357+0000","last_active":"2024-09-13T18:39:53.661826+0000","last_peered":"2024-09-13T18:39:53.661826+0000","last_clean":"2024-09-13T18:39:53.661826+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:39:53.661826+0000","last_undegraded":"2024-09-13T18:39:53.661826+0000","last_fullsized":"2024-09-13T18:39:53.661826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:20.965325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"23'170","reported_seq":182,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.722266+0000","last_change":"2024-09-13T18:39:14.580750+0000","last_active":"2024-09-13T18:43:38.722266+0000","last_peered":"2024-09-13T18:43:38.722266+0000","last_clean":"2024-09-13T18:43:38.722266+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:43:38.722266+0000","last_undegraded":"2024-09-13T18:43:38.722266+0000","last_fullsized":"2024-09-13T18:43:38.722266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:08.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666153+0000","last_change":"2024-09-13T18:39:13.583221+0000","last_active":"2024-09-13T18:39:53.666153+0000","last_peered":"2024-09-13T18:39:53.666153+0000","last_clean":"2024-09-13T18:39:53.666153+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:39:53.666153+0000","last_undegraded":"2024-09-13T18:39:53.666153+0000","last_fullsized":"2024-09-13T18:39:53.666153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":199492,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":160,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":398984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705724,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306084,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065756,"statfs":{"total":96636764160,"available":96323334144,"internally_reserved":0,"allocated":421888,"data_stored":266388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.33900000000000002,"15min":0.32100000000000001},"min":{"1min":0.184,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":4.5049999999999999,"5min":4.5049999999999999,"15min":4.5049999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.20399999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.316}]},{"osd":1,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"min":{"1min":0.191,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":3.8980000000000001,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.35699999999999998,"15min":0.33800000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.376}]},{"osd":2,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.23499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":3,"5min":3,"15min":3},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":4.5590000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":0.32900000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705725,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306068,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065772,"statfs":{"total":96636764160,"available":96323350528,"internally_reserved":0,"allocated":405504,"data_stored":265554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.151,"5min":0.151,"15min":0.151},"max":{"1min":0.39400000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.193,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.308},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.376},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.36299999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306460,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065380,"statfs":{"total":96636764160,"available":96322949120,"internally_reserved":0,"allocated":806912,"data_stored":659023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,4,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.315},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.33300000000000002,"15min":0.32900000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52500000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.39600000000000002,"15min":0.35199999999999998},"min":{"1min":0.217,"5min":0.184,"15min":0.184},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.35899999999999999,"15min":0.34599999999999997},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.42099999999999999,"15min":0.378},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.218},"max":{"1min":6.468,"5min":6.468,"15min":6.468},"last":0.371}]}]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306464,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065376,"statfs":{"total":96636764160,"available":96322945024,"internally_reserved":0,"allocated":811008,"data_stored":659563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.29699999999999999,"15min":0.30399999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.43099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.33200000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.499}]},{"osd":2,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.313,"15min":0.32100000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.371,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.315,"5min":0.33200000000000002,"15min":0.33700000000000002},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47799999999999998,"5min":0.5,"15min":0.5},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34699999999999998,"15min":0.35499999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.45600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":198706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":198395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:43:45.941 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:43:45.941 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:43:46.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.068+0000 7fe3bf11d640 1 Processor -- start 2024-09-13T18:43:46.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.068+0000 7fe3bf11d640 1 -- start start 2024-09-13T18:43:46.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3bf11d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe3b812f840 0x7fe3b812fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:46.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3bf11d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b809e840 0x7fe3b809ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:46.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3bf11d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe3b809f190 0x7fe3b81366f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:46.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3bf11d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b8068220 con 0x7fe3b812f840 2024-09-13T18:43:46.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3bf11d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b8069f70 con 0x7fe3b809e840 2024-09-13T18:43:46.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3bf11d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b8069c80 con 0x7fe3b809f190 2024-09-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3b7fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b809e840 0x7fe3b809ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3bd6ba640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe3b809f190 0x7fe3b81366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3bceb9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe3b812f840 0x7fe3b812fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3bd6ba640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe3b809f190 0x7fe3b81366f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:35944/0 (socket says 172.21.15.97:35944) 2024-09-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3b7fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b809e840 0x7fe3b809ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:49314/0 (socket says 172.21.15.97:49314) 2024-09-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3bceb9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe3b812f840 0x7fe3b812fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53948/0 (socket says 172.21.15.97:53948) 2024-09-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3bd6ba640 1 -- 172.21.15.97:0/2824532813 learned_addr learned my addr 172.21.15.97:0/2824532813 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3b7fff640 1 -- 172.21.15.97:0/2824532813 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe3b809f190 msgr2=0x7fe3b81366f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3b7fff640 1 --2- 172.21.15.97:0/2824532813 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe3b809f190 0x7fe3b81366f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3b7fff640 1 -- 172.21.15.97:0/2824532813 >> v2:172.21.15.97:3300/0 conn(0x7fe3b812f840 msgr2=0x7fe3b812fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3b7fff640 1 --2- 172.21.15.97:0/2824532813 >> v2:172.21.15.97:3300/0 conn(0x7fe3b812f840 0x7fe3b812fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3b7fff640 1 -- 172.21.15.97:0/2824532813 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b8069020 con 0x7fe3b809e840 2024-09-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3bceb9640 1 --2- 172.21.15.97:0/2824532813 >> v2:172.21.15.97:3300/0 conn(0x7fe3b812f840 0x7fe3b812fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:46.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.069+0000 7fe3bd6ba640 1 --2- 172.21.15.97:0/2824532813 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe3b809f190 0x7fe3b81366f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:46.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.070+0000 7fe3b7fff640 1 --2- 172.21.15.97:0/2824532813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b809e840 0x7fe3b809ec50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009880 tx=0x7fe3ac0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6870f036fb934846 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:46.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.070+0000 7fe3b77fe640 1 -- 172.21.15.97:0/2824532813 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac02ac50 con 0x7fe3b809e840 2024-09-13T18:43:46.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.070+0000 7fe3b77fe640 1 -- 172.21.15.97:0/2824532813 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac02adb0 con 0x7fe3b809e840 2024-09-13T18:43:46.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.070+0000 7fe3b77fe640 1 -- 172.21.15.97:0/2824532813 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac032670 con 0x7fe3b809e840 2024-09-13T18:43:46.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.070+0000 7fe3bf11d640 1 -- 172.21.15.97:0/2824532813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b809e840 msgr2=0x7fe3b809ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:46.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.070+0000 7fe3bf11d640 1 --2- 172.21.15.97:0/2824532813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b809e840 0x7fe3b809ec50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009880 tx=0x7fe3ac0090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.071+0000 7fe3bf11d640 1 -- 172.21.15.97:0/2824532813 shutdown_connections 2024-09-13T18:43:46.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.071+0000 7fe3bf11d640 1 --2- 172.21.15.97:0/2824532813 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe3b809f190 0x7fe3b81366f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.071+0000 7fe3bf11d640 1 --2- 172.21.15.97:0/2824532813 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b809e840 0x7fe3b809ec50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.071+0000 7fe3bf11d640 1 --2- 172.21.15.97:0/2824532813 >> v2:172.21.15.97:3300/0 conn(0x7fe3b812f840 0x7fe3b812fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.071+0000 7fe3bf11d640 1 -- 172.21.15.97:0/2824532813 >> 172.21.15.97:0/2824532813 conn(0x7fe3b80676f0 msgr2=0x7fe3b80a0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.071+0000 7fe3bf11d640 1 -- 172.21.15.97:0/2824532813 shutdown_connections 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.071+0000 7fe3bf11d640 1 -- 172.21.15.97:0/2824532813 wait complete. 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.071+0000 7fe3bf11d640 1 Processor -- start 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.072+0000 7fe3bf11d640 1 -- start start 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.072+0000 7fe3bf11d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3b809e840 0x7fe3b812eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.072+0000 7fe3bf11d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe3b809f190 0x7fe3b811d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.072+0000 7fe3bf11d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b812f840 0x7fe3b811de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.072+0000 7fe3bf11d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b8121060 con 0x7fe3b809e840 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.072+0000 7fe3bf11d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b8068660 con 0x7fe3b812f840 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.072+0000 7fe3bf11d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b811fc90 con 0x7fe3b809f190 2024-09-13T18:43:46.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.072+0000 7fe3bceb9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3b809e840 0x7fe3b812eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:46.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.072+0000 7fe3bceb9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3b809e840 0x7fe3b812eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53962/0 (socket says 172.21.15.97:53962) 2024-09-13T18:43:46.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.072+0000 7fe3bceb9640 1 -- 172.21.15.97:0/3615667978 learned_addr learned my addr 172.21.15.97:0/3615667978 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:46.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.072+0000 7fe3b7fff640 1 --2- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe3b809f190 0x7fe3b811d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:46.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.072+0000 7fe3bd6ba640 1 --2- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b812f840 0x7fe3b811de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:46.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.073+0000 7fe3bd6ba640 1 -- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe3b809f190 msgr2=0x7fe3b811d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:46.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.073+0000 7fe3bd6ba640 1 --2- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe3b809f190 0x7fe3b811d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.073+0000 7fe3bd6ba640 1 -- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3b809e840 msgr2=0x7fe3b812eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:46.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.073+0000 7fe3bd6ba640 1 --2- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3b809e840 0x7fe3b812eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.073+0000 7fe3bd6ba640 1 -- 172.21.15.97:0/3615667978 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b0009ae0 con 0x7fe3b812f840 2024-09-13T18:43:46.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.073+0000 7fe3b7fff640 1 --2- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe3b809f190 0x7fe3b811d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:46.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.073+0000 7fe3bceb9640 1 --2- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3b809e840 0x7fe3b812eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:46.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.073+0000 7fe3bd6ba640 1 --2- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b812f840 0x7fe3b811de10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009f40 tx=0x7fe3b000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:46.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.074+0000 7fe3b4ff9640 1 -- 172.21.15.97:0/3615667978 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0018070 con 0x7fe3b812f840 2024-09-13T18:43:46.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.074+0000 7fe3b4ff9640 1 -- 172.21.15.97:0/3615667978 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b000f040 con 0x7fe3b812f840 2024-09-13T18:43:46.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.074+0000 7fe3bf11d640 1 -- 172.21.15.97:0/3615667978 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a8009390 con 0x7fe3b812f840 2024-09-13T18:43:46.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.074+0000 7fe3b4ff9640 1 -- 172.21.15.97:0/3615667978 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b000ce70 con 0x7fe3b812f840 2024-09-13T18:43:46.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.074+0000 7fe3bf11d640 1 -- 172.21.15.97:0/3615667978 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ac009390 con 0x7fe3b812f840 2024-09-13T18:43:46.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.075+0000 7fe3b4ff9640 1 -- 172.21.15.97:0/3615667978 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fe3b0003020 con 0x7fe3b812f840 2024-09-13T18:43:46.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.075+0000 7fe3b4ff9640 1 -- 172.21.15.97:0/3615667978 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fe3b0042280 con 0x7fe3b812f840 2024-09-13T18:43:46.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.075+0000 7fe3bf11d640 1 -- 172.21.15.97:0/3615667978 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b8064000 con 0x7fe3b812f840 2024-09-13T18:43:46.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.079+0000 7fe3b4ff9640 1 -- 172.21.15.97:0/3615667978 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fe3b0012b20 con 0x7fe3b812f840 2024-09-13T18:43:46.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.228+0000 7fe3bf11d640 1 -- 172.21.15.97:0/3615667978 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3b8121b50 con 0x7fe3a4031160 2024-09-13T18:43:46.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.234+0000 7fe3b4ff9640 1 -- 172.21.15.97:0/3615667978 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277541 (unknown 2965378022 0 1225159791) 0x7fe3b8121b50 con 0x7fe3a4031160 2024-09-13T18:43:46.239 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:43:46.241 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:43:46.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.237+0000 7fe3bf11d640 1 -- 172.21.15.97:0/3615667978 >> v1:172.21.15.97:6816/34603 conn(0x7fe3a4031160 legacy=0x7fe3a4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:46.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.237+0000 7fe3bf11d640 1 -- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b812f840 msgr2=0x7fe3b811de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:46.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.237+0000 7fe3bf11d640 1 --2- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b812f840 0x7fe3b811de10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009f40 tx=0x7fe3b000b040 comp rx=0 tx=0).stop 2024-09-13T18:43:46.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.237+0000 7fe3bf11d640 1 -- 172.21.15.97:0/3615667978 shutdown_connections 2024-09-13T18:43:46.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.237+0000 7fe3bf11d640 1 --2- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fe3b812f840 0x7fe3b811de10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.237+0000 7fe3bf11d640 1 --2- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fe3b809f190 0x7fe3b811d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.237+0000 7fe3bf11d640 1 --2- 172.21.15.97:0/3615667978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe3b809e840 0x7fe3b812eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.237+0000 7fe3bf11d640 1 -- 172.21.15.97:0/3615667978 >> 172.21.15.97:0/3615667978 conn(0x7fe3b80676f0 msgr2=0x7fe3b806e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:46.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.237+0000 7fe3bf11d640 1 -- 172.21.15.97:0/3615667978 shutdown_connections 2024-09-13T18:43:46.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.237+0000 7fe3bf11d640 1 -- 172.21.15.97:0/3615667978 wait complete. 2024-09-13T18:43:46.250 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-13T18:43:45.412612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":789879,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":60,"num_read_kb":50,"num_write":9457,"num_write_kb":25167188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9924,"ondisk_log_size":9924,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1225076,"kb_used_data":2388,"kb_used_omap":6,"kb_used_meta":1222649,"kb_avail":376262284,"statfs":{"total":386547056640,"available":385292578816,"internally_reserved":0,"allocated":2445312,"data_stored":1850528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1251992928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,4,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737399423,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2577,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002908"},"pg_stats":[{"pgid":"4.3f","version":"23'146","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719578+0000","last_change":"2024-09-13T18:39:14.592723+0000","last_active":"2024-09-13T18:43:38.719578+0000","last_peered":"2024-09-13T18:43:38.719578+0000","last_clean":"2024-09-13T18:43:38.719578+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:43:38.719578+0000","last_undegraded":"2024-09-13T18:43:38.719578+0000","last_fullsized":"2024-09-13T18:43:38.719578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:09.304808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'130","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727590+0000","last_change":"2024-09-13T18:39:14.581266+0000","last_active":"2024-09-13T18:43:38.727590+0000","last_peered":"2024-09-13T18:43:38.727590+0000","last_clean":"2024-09-13T18:43:38.727590+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:43:38.727590+0000","last_undegraded":"2024-09-13T18:43:38.727590+0000","last_fullsized":"2024-09-13T18:43:38.727590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.732104+0000","last_change":"2024-09-13T18:39:14.586254+0000","last_active":"2024-09-13T18:43:38.732104+0000","last_peered":"2024-09-13T18:43:38.732104+0000","last_clean":"2024-09-13T18:43:38.732104+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:43:38.732104+0000","last_undegraded":"2024-09-13T18:43:38.732104+0000","last_fullsized":"2024-09-13T18:43:38.732104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"23'173","reported_seq":185,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.733542+0000","last_change":"2024-09-13T18:39:14.583960+0000","last_active":"2024-09-13T18:43:38.733542+0000","last_peered":"2024-09-13T18:43:38.733542+0000","last_clean":"2024-09-13T18:43:38.733542+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:43:38.733542+0000","last_undegraded":"2024-09-13T18:43:38.733542+0000","last_fullsized":"2024-09-13T18:43:38.733542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"23'148","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727037+0000","last_change":"2024-09-13T18:39:14.577865+0000","last_active":"2024-09-13T18:43:38.727037+0000","last_peered":"2024-09-13T18:43:38.727037+0000","last_clean":"2024-09-13T18:43:38.727037+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:43:38.727037+0000","last_undegraded":"2024-09-13T18:43:38.727037+0000","last_fullsized":"2024-09-13T18:43:38.727037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'135","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.729288+0000","last_change":"2024-09-13T18:39:14.590785+0000","last_active":"2024-09-13T18:43:38.729288+0000","last_peered":"2024-09-13T18:43:38.729288+0000","last_clean":"2024-09-13T18:43:38.729288+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:43:38.729288+0000","last_undegraded":"2024-09-13T18:43:38.729288+0000","last_fullsized":"2024-09-13T18:43:38.729288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:24.453184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'164","reported_seq":176,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734491+0000","last_change":"2024-09-13T18:39:14.590893+0000","last_active":"2024-09-13T18:43:38.734491+0000","last_peered":"2024-09-13T18:43:38.734491+0000","last_clean":"2024-09-13T18:43:38.734491+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:43:38.734491+0000","last_undegraded":"2024-09-13T18:43:38.734491+0000","last_fullsized":"2024-09-13T18:43:38.734491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:57.986187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'186","reported_seq":198,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717710+0000","last_change":"2024-09-13T18:39:14.595160+0000","last_active":"2024-09-13T18:43:38.717710+0000","last_peered":"2024-09-13T18:43:38.717710+0000","last_clean":"2024-09-13T18:43:38.717710+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:43:38.717710+0000","last_undegraded":"2024-09-13T18:43:38.717710+0000","last_fullsized":"2024-09-13T18:43:38.717710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"23'152","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.722317+0000","last_change":"2024-09-13T18:39:14.586790+0000","last_active":"2024-09-13T18:43:38.722317+0000","last_peered":"2024-09-13T18:43:38.722317+0000","last_clean":"2024-09-13T18:43:38.722317+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:43:38.722317+0000","last_undegraded":"2024-09-13T18:43:38.722317+0000","last_fullsized":"2024-09-13T18:43:38.722317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:49.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'156","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736032+0000","last_change":"2024-09-13T18:39:14.591231+0000","last_active":"2024-09-13T18:43:38.736032+0000","last_peered":"2024-09-13T18:43:38.736032+0000","last_clean":"2024-09-13T18:43:38.736032+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:43:38.736032+0000","last_undegraded":"2024-09-13T18:43:38.736032+0000","last_fullsized":"2024-09-13T18:43:38.736032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"23'189","reported_seq":201,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730161+0000","last_change":"2024-09-13T18:39:14.589017+0000","last_active":"2024-09-13T18:43:38.730161+0000","last_peered":"2024-09-13T18:43:38.730161+0000","last_clean":"2024-09-13T18:43:38.730161+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:43:38.730161+0000","last_undegraded":"2024-09-13T18:43:38.730161+0000","last_fullsized":"2024-09-13T18:43:38.730161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"23'142","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.715282+0000","last_change":"2024-09-13T18:39:14.592629+0000","last_active":"2024-09-13T18:43:38.715282+0000","last_peered":"2024-09-13T18:43:38.715282+0000","last_clean":"2024-09-13T18:43:38.715282+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:43:38.715282+0000","last_undegraded":"2024-09-13T18:43:38.715282+0000","last_fullsized":"2024-09-13T18:43:38.715282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738828+0000","last_change":"2024-09-13T18:39:14.597709+0000","last_active":"2024-09-13T18:43:38.738828+0000","last_peered":"2024-09-13T18:43:38.738828+0000","last_clean":"2024-09-13T18:43:38.738828+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:43:38.738828+0000","last_undegraded":"2024-09-13T18:43:38.738828+0000","last_fullsized":"2024-09-13T18:43:38.738828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.367739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'149","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731243+0000","last_change":"2024-09-13T18:39:14.572267+0000","last_active":"2024-09-13T18:43:38.731243+0000","last_peered":"2024-09-13T18:43:38.731243+0000","last_clean":"2024-09-13T18:43:38.731243+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:43:38.731243+0000","last_undegraded":"2024-09-13T18:43:38.731243+0000","last_fullsized":"2024-09-13T18:43:38.731243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.728216+0000","last_change":"2024-09-13T18:39:14.583318+0000","last_active":"2024-09-13T18:43:38.728216+0000","last_peered":"2024-09-13T18:43:38.728216+0000","last_clean":"2024-09-13T18:43:38.728216+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:43:38.728216+0000","last_undegraded":"2024-09-13T18:43:38.728216+0000","last_fullsized":"2024-09-13T18:43:38.728216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"23'147","reported_seq":159,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741185+0000","last_change":"2024-09-13T18:39:14.592378+0000","last_active":"2024-09-13T18:43:38.741185+0000","last_peered":"2024-09-13T18:43:38.741185+0000","last_clean":"2024-09-13T18:43:38.741185+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:43:38.741185+0000","last_undegraded":"2024-09-13T18:43:38.741185+0000","last_fullsized":"2024-09-13T18:43:38.741185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:02.414361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'146","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.721992+0000","last_change":"2024-09-13T18:39:14.586945+0000","last_active":"2024-09-13T18:43:38.721992+0000","last_peered":"2024-09-13T18:43:38.721992+0000","last_clean":"2024-09-13T18:43:38.721992+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:43:38.721992+0000","last_undegraded":"2024-09-13T18:43:38.721992+0000","last_fullsized":"2024-09-13T18:43:38.721992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:57.889039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'157","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734859+0000","last_change":"2024-09-13T18:39:14.587172+0000","last_active":"2024-09-13T18:43:38.734859+0000","last_peered":"2024-09-13T18:43:38.734859+0000","last_clean":"2024-09-13T18:43:38.734859+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:43:38.734859+0000","last_undegraded":"2024-09-13T18:43:38.734859+0000","last_fullsized":"2024-09-13T18:43:38.734859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"23'172","reported_seq":184,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719162+0000","last_change":"2024-09-13T18:39:14.594291+0000","last_active":"2024-09-13T18:43:38.719162+0000","last_peered":"2024-09-13T18:43:38.719162+0000","last_clean":"2024-09-13T18:43:38.719162+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:43:38.719162+0000","last_undegraded":"2024-09-13T18:43:38.719162+0000","last_fullsized":"2024-09-13T18:43:38.719162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:29.208875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'161","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737482+0000","last_change":"2024-09-13T18:39:14.585973+0000","last_active":"2024-09-13T18:43:38.737482+0000","last_peered":"2024-09-13T18:43:38.737482+0000","last_clean":"2024-09-13T18:43:38.737482+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:43:38.737482+0000","last_undegraded":"2024-09-13T18:43:38.737482+0000","last_fullsized":"2024-09-13T18:43:38.737482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:48.875040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"23'137","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727488+0000","last_change":"2024-09-13T18:39:14.595451+0000","last_active":"2024-09-13T18:43:38.727488+0000","last_peered":"2024-09-13T18:43:38.727488+0000","last_clean":"2024-09-13T18:43:38.727488+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:43:38.727488+0000","last_undegraded":"2024-09-13T18:43:38.727488+0000","last_fullsized":"2024-09-13T18:43:38.727488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:45.368802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"23'166","reported_seq":178,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727552+0000","last_change":"2024-09-13T18:39:14.583590+0000","last_active":"2024-09-13T18:43:38.727552+0000","last_peered":"2024-09-13T18:43:38.727552+0000","last_clean":"2024-09-13T18:43:38.727552+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:43:38.727552+0000","last_undegraded":"2024-09-13T18:43:38.727552+0000","last_fullsized":"2024-09-13T18:43:38.727552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'134","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737455+0000","last_change":"2024-09-13T18:39:14.590724+0000","last_active":"2024-09-13T18:43:38.737455+0000","last_peered":"2024-09-13T18:43:38.737455+0000","last_clean":"2024-09-13T18:43:38.737455+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:43:38.737455+0000","last_undegraded":"2024-09-13T18:43:38.737455+0000","last_fullsized":"2024-09-13T18:43:38.737455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:09.353955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"23'180","reported_seq":192,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731840+0000","last_change":"2024-09-13T18:39:14.577642+0000","last_active":"2024-09-13T18:43:38.731840+0000","last_peered":"2024-09-13T18:43:38.731840+0000","last_clean":"2024-09-13T18:43:38.731840+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:43:38.731840+0000","last_undegraded":"2024-09-13T18:43:38.731840+0000","last_fullsized":"2024-09-13T18:43:38.731840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"23'134","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736869+0000","last_change":"2024-09-13T18:39:14.592432+0000","last_active":"2024-09-13T18:43:38.736869+0000","last_peered":"2024-09-13T18:43:38.736869+0000","last_clean":"2024-09-13T18:43:38.736869+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:43:38.736869+0000","last_undegraded":"2024-09-13T18:43:38.736869+0000","last_fullsized":"2024-09-13T18:43:38.736869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:43.945214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'198","reported_seq":210,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.728569+0000","last_change":"2024-09-13T18:39:14.571893+0000","last_active":"2024-09-13T18:43:38.728569+0000","last_peered":"2024-09-13T18:43:38.728569+0000","last_clean":"2024-09-13T18:43:38.728569+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:43:38.728569+0000","last_undegraded":"2024-09-13T18:43:38.728569+0000","last_fullsized":"2024-09-13T18:43:38.728569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'144","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719698+0000","last_change":"2024-09-13T18:39:14.594222+0000","last_active":"2024-09-13T18:43:38.719698+0000","last_peered":"2024-09-13T18:43:38.719698+0000","last_clean":"2024-09-13T18:43:38.719698+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:43:38.719698+0000","last_undegraded":"2024-09-13T18:43:38.719698+0000","last_fullsized":"2024-09-13T18:43:38.719698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:20.265556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'133","reported_seq":145,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739499+0000","last_change":"2024-09-13T18:39:14.576203+0000","last_active":"2024-09-13T18:43:38.739499+0000","last_peered":"2024-09-13T18:43:38.739499+0000","last_clean":"2024-09-13T18:43:38.739499+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:43:38.739499+0000","last_undegraded":"2024-09-13T18:43:38.739499+0000","last_fullsized":"2024-09-13T18:43:38.739499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"23'118","reported_seq":130,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740575+0000","last_change":"2024-09-13T18:39:14.586374+0000","last_active":"2024-09-13T18:43:38.740575+0000","last_peered":"2024-09-13T18:43:38.740575+0000","last_clean":"2024-09-13T18:43:38.740575+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:43:38.740575+0000","last_undegraded":"2024-09-13T18:43:38.740575+0000","last_fullsized":"2024-09-13T18:43:38.740575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:03.191196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'131","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.714196+0000","last_change":"2024-09-13T18:39:14.577392+0000","last_active":"2024-09-13T18:43:38.714196+0000","last_peered":"2024-09-13T18:43:38.714196+0000","last_clean":"2024-09-13T18:43:38.714196+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:43:38.714196+0000","last_undegraded":"2024-09-13T18:43:38.714196+0000","last_fullsized":"2024-09-13T18:43:38.714196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:26.709807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"23'135","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740453+0000","last_change":"2024-09-13T18:39:14.580898+0000","last_active":"2024-09-13T18:43:38.740453+0000","last_peered":"2024-09-13T18:43:38.740453+0000","last_clean":"2024-09-13T18:43:38.740453+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:43:38.740453+0000","last_undegraded":"2024-09-13T18:43:38.740453+0000","last_fullsized":"2024-09-13T18:43:38.740453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:23.630337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"23'150","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.716995+0000","last_change":"2024-09-13T18:39:14.574811+0000","last_active":"2024-09-13T18:43:38.716995+0000","last_peered":"2024-09-13T18:43:38.716995+0000","last_clean":"2024-09-13T18:43:38.716995+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:43:38.716995+0000","last_undegraded":"2024-09-13T18:43:38.716995+0000","last_fullsized":"2024-09-13T18:43:38.716995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"23'149","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730224+0000","last_change":"2024-09-13T18:39:14.579494+0000","last_active":"2024-09-13T18:43:38.730224+0000","last_peered":"2024-09-13T18:43:38.730224+0000","last_clean":"2024-09-13T18:43:38.730224+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:43:38.730224+0000","last_undegraded":"2024-09-13T18:43:38.730224+0000","last_fullsized":"2024-09-13T18:43:38.730224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:19.432936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660311+0000","last_change":"2024-09-13T18:39:13.575179+0000","last_active":"2024-09-13T18:39:53.660311+0000","last_peered":"2024-09-13T18:39:53.660311+0000","last_clean":"2024-09-13T18:39:53.660311+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:39:53.660311+0000","last_undegraded":"2024-09-13T18:39:53.660311+0000","last_fullsized":"2024-09-13T18:39:53.660311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:25.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"23'150","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717407+0000","last_change":"2024-09-13T18:39:14.594066+0000","last_active":"2024-09-13T18:43:38.717407+0000","last_peered":"2024-09-13T18:43:38.717407+0000","last_clean":"2024-09-13T18:43:38.717407+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:43:38.717407+0000","last_undegraded":"2024-09-13T18:43:38.717407+0000","last_fullsized":"2024-09-13T18:43:38.717407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:14.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665780+0000","last_change":"2024-09-13T18:39:13.570778+0000","last_active":"2024-09-13T18:39:53.665780+0000","last_peered":"2024-09-13T18:39:53.665780+0000","last_clean":"2024-09-13T18:39:53.665780+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:39:53.665780+0000","last_undegraded":"2024-09-13T18:39:53.665780+0000","last_fullsized":"2024-09-13T18:39:53.665780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"23'229","reported_seq":250,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739934+0000","last_change":"2024-09-13T18:39:54.668508+0000","last_active":"2024-09-13T18:43:38.739934+0000","last_peered":"2024-09-13T18:43:38.739934+0000","last_clean":"2024-09-13T18:43:38.739934+0000","last_became_active":"2024-09-13T18:39:54.668035+0000","last_became_peered":"2024-09-13T18:39:54.668035+0000","last_unstale":"2024-09-13T18:43:38.739934+0000","last_undegraded":"2024-09-13T18:43:38.739934+0000","last_fullsized":"2024-09-13T18:43:38.739934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:40.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663232+0000","last_change":"2024-09-13T18:39:13.575436+0000","last_active":"2024-09-13T18:39:53.663232+0000","last_peered":"2024-09-13T18:39:53.663232+0000","last_clean":"2024-09-13T18:39:53.663232+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:39:53.663232+0000","last_undegraded":"2024-09-13T18:39:53.663232+0000","last_fullsized":"2024-09-13T18:39:53.663232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:34.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'141","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737866+0000","last_change":"2024-09-13T18:39:14.584791+0000","last_active":"2024-09-13T18:43:38.737866+0000","last_peered":"2024-09-13T18:43:38.737866+0000","last_clean":"2024-09-13T18:43:38.737866+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:43:38.737866+0000","last_undegraded":"2024-09-13T18:43:38.737866+0000","last_fullsized":"2024-09-13T18:43:38.737866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:08.799126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'9","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.663475+0000","last_change":"2024-09-13T18:39:13.578940+0000","last_active":"2024-09-13T18:39:54.663475+0000","last_peered":"2024-09-13T18:39:54.663475+0000","last_clean":"2024-09-13T18:39:54.663475+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:39:54.663475+0000","last_undegraded":"2024-09-13T18:39:54.663475+0000","last_fullsized":"2024-09-13T18:39:54.663475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:34.109209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666409+0000","last_change":"2024-09-13T18:39:13.583184+0000","last_active":"2024-09-13T18:39:53.666409+0000","last_peered":"2024-09-13T18:39:53.666409+0000","last_clean":"2024-09-13T18:39:53.666409+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:39:53.666409+0000","last_undegraded":"2024-09-13T18:39:53.666409+0000","last_fullsized":"2024-09-13T18:39:53.666409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"23'153","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741409+0000","last_change":"2024-09-13T18:39:54.668672+0000","last_active":"2024-09-13T18:43:38.741409+0000","last_peered":"2024-09-13T18:43:38.741409+0000","last_clean":"2024-09-13T18:43:38.741409+0000","last_became_active":"2024-09-13T18:39:54.668322+0000","last_became_peered":"2024-09-13T18:39:54.668322+0000","last_unstale":"2024-09-13T18:43:38.741409+0000","last_undegraded":"2024-09-13T18:43:38.741409+0000","last_fullsized":"2024-09-13T18:43:38.741409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:43.914025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662667+0000","last_change":"2024-09-13T18:39:13.571043+0000","last_active":"2024-09-13T18:39:53.662667+0000","last_peered":"2024-09-13T18:39:53.662667+0000","last_clean":"2024-09-13T18:39:53.662667+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:39:53.662667+0000","last_undegraded":"2024-09-13T18:39:53.662667+0000","last_fullsized":"2024-09-13T18:39:53.662667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.757855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'134","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.709074+0000","last_change":"2024-09-13T18:39:14.577177+0000","last_active":"2024-09-13T18:43:38.709074+0000","last_peered":"2024-09-13T18:43:38.709074+0000","last_clean":"2024-09-13T18:43:38.709074+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:43:38.709074+0000","last_undegraded":"2024-09-13T18:43:38.709074+0000","last_fullsized":"2024-09-13T18:43:38.709074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667326+0000","last_change":"2024-09-13T18:39:13.581627+0000","last_active":"2024-09-13T18:39:53.667326+0000","last_peered":"2024-09-13T18:39:53.667326+0000","last_clean":"2024-09-13T18:39:53.667326+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:39:53.667326+0000","last_undegraded":"2024-09-13T18:39:53.667326+0000","last_fullsized":"2024-09-13T18:39:53.667326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:48.023626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'128","reported_seq":140,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.724030+0000","last_change":"2024-09-13T18:39:14.596602+0000","last_active":"2024-09-13T18:43:38.724030+0000","last_peered":"2024-09-13T18:43:38.724030+0000","last_clean":"2024-09-13T18:43:38.724030+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:43:38.724030+0000","last_undegraded":"2024-09-13T18:43:38.724030+0000","last_fullsized":"2024-09-13T18:43:38.724030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:35.414913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666092+0000","last_change":"2024-09-13T18:39:13.570169+0000","last_active":"2024-09-13T18:39:53.666092+0000","last_peered":"2024-09-13T18:39:53.666092+0000","last_clean":"2024-09-13T18:39:53.666092+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:39:53.666092+0000","last_undegraded":"2024-09-13T18:39:53.666092+0000","last_fullsized":"2024-09-13T18:39:53.666092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"23'143","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727371+0000","last_change":"2024-09-13T18:39:14.584580+0000","last_active":"2024-09-13T18:43:38.727371+0000","last_peered":"2024-09-13T18:43:38.727371+0000","last_clean":"2024-09-13T18:43:38.727371+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:43:38.727371+0000","last_undegraded":"2024-09-13T18:43:38.727371+0000","last_fullsized":"2024-09-13T18:43:38.727371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664054+0000","last_change":"2024-09-13T18:39:13.575713+0000","last_active":"2024-09-13T18:39:54.664054+0000","last_peered":"2024-09-13T18:39:54.664054+0000","last_clean":"2024-09-13T18:39:54.664054+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:39:54.664054+0000","last_undegraded":"2024-09-13T18:39:54.664054+0000","last_fullsized":"2024-09-13T18:39:54.664054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:59.985917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'144","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.711181+0000","last_change":"2024-09-13T18:39:14.577151+0000","last_active":"2024-09-13T18:43:38.711181+0000","last_peered":"2024-09-13T18:43:38.711181+0000","last_clean":"2024-09-13T18:43:38.711181+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:43:38.711181+0000","last_undegraded":"2024-09-13T18:43:38.711181+0000","last_fullsized":"2024-09-13T18:43:38.711181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663898+0000","last_change":"2024-09-13T18:39:13.581445+0000","last_active":"2024-09-13T18:39:53.663898+0000","last_peered":"2024-09-13T18:39:53.663898+0000","last_clean":"2024-09-13T18:39:53.663898+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:39:53.663898+0000","last_undegraded":"2024-09-13T18:39:53.663898+0000","last_fullsized":"2024-09-13T18:39:53.663898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:39.003339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734368+0000","last_change":"2024-09-13T18:39:14.584122+0000","last_active":"2024-09-13T18:43:38.734368+0000","last_peered":"2024-09-13T18:43:38.734368+0000","last_clean":"2024-09-13T18:43:38.734368+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:43:38.734368+0000","last_undegraded":"2024-09-13T18:43:38.734368+0000","last_fullsized":"2024-09-13T18:43:38.734368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:30.405734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663324+0000","last_change":"2024-09-13T18:39:13.575316+0000","last_active":"2024-09-13T18:39:53.663324+0000","last_peered":"2024-09-13T18:39:53.663324+0000","last_clean":"2024-09-13T18:39:53.663324+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:39:53.663324+0000","last_undegraded":"2024-09-13T18:39:53.663324+0000","last_fullsized":"2024-09-13T18:39:53.663324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:06.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'146","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719389+0000","last_change":"2024-09-13T18:39:14.593058+0000","last_active":"2024-09-13T18:43:38.719389+0000","last_peered":"2024-09-13T18:43:38.719389+0000","last_clean":"2024-09-13T18:43:38.719389+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:43:38.719389+0000","last_undegraded":"2024-09-13T18:43:38.719389+0000","last_fullsized":"2024-09-13T18:43:38.719389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:24.454698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661099+0000","last_change":"2024-09-13T18:39:13.581217+0000","last_active":"2024-09-13T18:39:53.661099+0000","last_peered":"2024-09-13T18:39:53.661099+0000","last_clean":"2024-09-13T18:39:53.661099+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:39:53.661099+0000","last_undegraded":"2024-09-13T18:39:53.661099+0000","last_fullsized":"2024-09-13T18:39:53.661099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:27.361025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'138","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739846+0000","last_change":"2024-09-13T18:39:14.596597+0000","last_active":"2024-09-13T18:43:38.739846+0000","last_peered":"2024-09-13T18:43:38.739846+0000","last_clean":"2024-09-13T18:43:38.739846+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:43:38.739846+0000","last_undegraded":"2024-09-13T18:43:38.739846+0000","last_fullsized":"2024-09-13T18:43:38.739846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:47.680908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":87,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661174+0000","last_change":"2024-09-13T18:39:03.413753+0000","last_active":"2024-09-13T18:39:53.661174+0000","last_peered":"2024-09-13T18:39:53.661174+0000","last_clean":"2024-09-13T18:39:53.661174+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:39:53.661174+0000","last_undegraded":"2024-09-13T18:39:53.661174+0000","last_fullsized":"2024-09-13T18:39:53.661174+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.425159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:05.703287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660538+0000","last_change":"2024-09-13T18:39:09.531787+0000","last_active":"2024-09-13T18:39:53.660538+0000","last_peered":"2024-09-13T18:39:53.660538+0000","last_clean":"2024-09-13T18:39:53.660538+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:39:53.660538+0000","last_undegraded":"2024-09-13T18:39:53.660538+0000","last_fullsized":"2024-09-13T18:39:53.660538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:21.652872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664040+0000","last_change":"2024-09-13T18:39:13.575940+0000","last_active":"2024-09-13T18:39:53.664040+0000","last_peered":"2024-09-13T18:39:53.664040+0000","last_clean":"2024-09-13T18:39:53.664040+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:39:53.664040+0000","last_undegraded":"2024-09-13T18:39:53.664040+0000","last_fullsized":"2024-09-13T18:39:53.664040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:23.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'143","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730832+0000","last_change":"2024-09-13T18:39:54.668486+0000","last_active":"2024-09-13T18:43:38.730832+0000","last_peered":"2024-09-13T18:43:38.730832+0000","last_clean":"2024-09-13T18:43:38.730832+0000","last_became_active":"2024-09-13T18:39:54.668177+0000","last_became_peered":"2024-09-13T18:39:54.668177+0000","last_unstale":"2024-09-13T18:43:38.730832+0000","last_undegraded":"2024-09-13T18:43:38.730832+0000","last_fullsized":"2024-09-13T18:43:38.730832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:01.415577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661120+0000","last_change":"2024-09-13T18:39:09.531377+0000","last_active":"2024-09-13T18:39:53.661120+0000","last_peered":"2024-09-13T18:39:53.661120+0000","last_clean":"2024-09-13T18:39:53.661120+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:39:53.661120+0000","last_undegraded":"2024-09-13T18:39:53.661120+0000","last_fullsized":"2024-09-13T18:39:53.661120+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.437998+0000","last_change":"2024-09-13T18:39:13.563570+0000","last_active":"2024-09-13T18:43:37.437998+0000","last_peered":"2024-09-13T18:43:37.437998+0000","last_clean":"2024-09-13T18:43:37.437998+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:43:37.437998+0000","last_undegraded":"2024-09-13T18:43:37.437998+0000","last_fullsized":"2024-09-13T18:43:37.437998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'163","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736074+0000","last_change":"2024-09-13T18:39:14.587017+0000","last_active":"2024-09-13T18:43:38.736074+0000","last_peered":"2024-09-13T18:43:38.736074+0000","last_clean":"2024-09-13T18:43:38.736074+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:43:38.736074+0000","last_undegraded":"2024-09-13T18:43:38.736074+0000","last_fullsized":"2024-09-13T18:43:38.736074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661881+0000","last_change":"2024-09-13T18:39:09.533004+0000","last_active":"2024-09-13T18:39:53.661881+0000","last_peered":"2024-09-13T18:39:53.661881+0000","last_clean":"2024-09-13T18:39:53.661881+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:39:53.661881+0000","last_undegraded":"2024-09-13T18:39:53.661881+0000","last_fullsized":"2024-09-13T18:39:53.661881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:41.079838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660963+0000","last_change":"2024-09-13T18:39:13.579066+0000","last_active":"2024-09-13T18:39:53.660963+0000","last_peered":"2024-09-13T18:39:53.660963+0000","last_clean":"2024-09-13T18:39:53.660963+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:39:53.660963+0000","last_undegraded":"2024-09-13T18:39:53.660963+0000","last_fullsized":"2024-09-13T18:39:53.660963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'143","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730317+0000","last_change":"2024-09-13T18:39:14.589734+0000","last_active":"2024-09-13T18:43:38.730317+0000","last_peered":"2024-09-13T18:43:38.730317+0000","last_clean":"2024-09-13T18:43:38.730317+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:43:38.730317+0000","last_undegraded":"2024-09-13T18:43:38.730317+0000","last_fullsized":"2024-09-13T18:43:38.730317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664123+0000","last_change":"2024-09-13T18:39:09.532311+0000","last_active":"2024-09-13T18:39:53.664123+0000","last_peered":"2024-09-13T18:39:53.664123+0000","last_clean":"2024-09-13T18:39:53.664123+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:39:53.664123+0000","last_undegraded":"2024-09-13T18:39:53.664123+0000","last_fullsized":"2024-09-13T18:39:53.664123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:53.060128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666753+0000","last_change":"2024-09-13T18:39:13.571488+0000","last_active":"2024-09-13T18:39:53.666753+0000","last_peered":"2024-09-13T18:39:53.666753+0000","last_clean":"2024-09-13T18:39:53.666753+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:39:53.666753+0000","last_undegraded":"2024-09-13T18:39:53.666753+0000","last_fullsized":"2024-09-13T18:39:53.666753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:44.121699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"23'144","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730418+0000","last_change":"2024-09-13T18:39:14.579779+0000","last_active":"2024-09-13T18:43:38.730418+0000","last_peered":"2024-09-13T18:43:38.730418+0000","last_clean":"2024-09-13T18:43:38.730418+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:43:38.730418+0000","last_undegraded":"2024-09-13T18:43:38.730418+0000","last_fullsized":"2024-09-13T18:43:38.730418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660742+0000","last_change":"2024-09-13T18:39:13.577844+0000","last_active":"2024-09-13T18:39:53.660742+0000","last_peered":"2024-09-13T18:39:53.660742+0000","last_clean":"2024-09-13T18:39:53.660742+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:39:53.660742+0000","last_undegraded":"2024-09-13T18:39:53.660742+0000","last_fullsized":"2024-09-13T18:39:53.660742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661619+0000","last_change":"2024-09-13T18:39:09.533091+0000","last_active":"2024-09-13T18:39:53.661619+0000","last_peered":"2024-09-13T18:39:53.661619+0000","last_clean":"2024-09-13T18:39:53.661619+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:39:53.661619+0000","last_undegraded":"2024-09-13T18:39:53.661619+0000","last_fullsized":"2024-09-13T18:39:53.661619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"23'158","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.728247+0000","last_change":"2024-09-13T18:39:14.597238+0000","last_active":"2024-09-13T18:43:38.728247+0000","last_peered":"2024-09-13T18:43:38.728247+0000","last_clean":"2024-09-13T18:43:38.728247+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:43:38.728247+0000","last_undegraded":"2024-09-13T18:43:38.728247+0000","last_fullsized":"2024-09-13T18:43:38.728247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.849783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660988+0000","last_change":"2024-09-13T18:39:13.583071+0000","last_active":"2024-09-13T18:39:53.660988+0000","last_peered":"2024-09-13T18:39:53.660988+0000","last_clean":"2024-09-13T18:39:53.660988+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:39:53.660988+0000","last_undegraded":"2024-09-13T18:39:53.660988+0000","last_fullsized":"2024-09-13T18:39:53.660988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667429+0000","last_change":"2024-09-13T18:39:09.532042+0000","last_active":"2024-09-13T18:39:53.667429+0000","last_peered":"2024-09-13T18:39:53.667429+0000","last_clean":"2024-09-13T18:39:53.667429+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:39:53.667429+0000","last_undegraded":"2024-09-13T18:39:53.667429+0000","last_fullsized":"2024-09-13T18:39:53.667429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:24.541036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"23'145","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717323+0000","last_change":"2024-09-13T18:39:14.584428+0000","last_active":"2024-09-13T18:43:38.717323+0000","last_peered":"2024-09-13T18:43:38.717323+0000","last_clean":"2024-09-13T18:43:38.717323+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:43:38.717323+0000","last_undegraded":"2024-09-13T18:43:38.717323+0000","last_fullsized":"2024-09-13T18:43:38.717323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.662382+0000","last_change":"2024-09-13T18:39:13.583868+0000","last_active":"2024-09-13T18:39:54.662382+0000","last_peered":"2024-09-13T18:39:54.662382+0000","last_clean":"2024-09-13T18:39:54.662382+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:39:54.662382+0000","last_undegraded":"2024-09-13T18:39:54.662382+0000","last_fullsized":"2024-09-13T18:39:54.662382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:52.540883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662865+0000","last_change":"2024-09-13T18:39:09.532757+0000","last_active":"2024-09-13T18:39:53.662865+0000","last_peered":"2024-09-13T18:39:53.662865+0000","last_clean":"2024-09-13T18:39:53.662865+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:39:53.662865+0000","last_undegraded":"2024-09-13T18:39:53.662865+0000","last_fullsized":"2024-09-13T18:39:53.662865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:32.617744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"23'131","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741518+0000","last_change":"2024-09-13T18:39:14.582490+0000","last_active":"2024-09-13T18:43:38.741518+0000","last_peered":"2024-09-13T18:43:38.741518+0000","last_clean":"2024-09-13T18:43:38.741518+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:43:38.741518+0000","last_undegraded":"2024-09-13T18:43:38.741518+0000","last_fullsized":"2024-09-13T18:43:38.741518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:44.239715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'10","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:34.630546+0000","last_change":"2024-09-13T18:39:13.583929+0000","last_active":"2024-09-13T18:43:34.630546+0000","last_peered":"2024-09-13T18:43:34.630546+0000","last_clean":"2024-09-13T18:43:34.630546+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:43:34.630546+0000","last_undegraded":"2024-09-13T18:43:34.630546+0000","last_fullsized":"2024-09-13T18:43:34.630546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:57.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663547+0000","last_change":"2024-09-13T18:39:09.531717+0000","last_active":"2024-09-13T18:39:53.663547+0000","last_peered":"2024-09-13T18:39:53.663547+0000","last_clean":"2024-09-13T18:39:53.663547+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:39:53.663547+0000","last_undegraded":"2024-09-13T18:39:53.663547+0000","last_fullsized":"2024-09-13T18:39:53.663547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:33.878130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"23'131","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.715217+0000","last_change":"2024-09-13T18:39:54.667668+0000","last_active":"2024-09-13T18:43:38.715217+0000","last_peered":"2024-09-13T18:43:38.715217+0000","last_clean":"2024-09-13T18:43:38.715217+0000","last_became_active":"2024-09-13T18:39:54.667244+0000","last_became_peered":"2024-09-13T18:39:54.667244+0000","last_unstale":"2024-09-13T18:43:38.715217+0000","last_undegraded":"2024-09-13T18:43:38.715217+0000","last_fullsized":"2024-09-13T18:43:38.715217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:56.127916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"23'171","reported_seq":183,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739130+0000","last_change":"2024-09-13T18:39:14.593754+0000","last_active":"2024-09-13T18:43:38.739130+0000","last_peered":"2024-09-13T18:43:38.739130+0000","last_clean":"2024-09-13T18:43:38.739130+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:43:38.739130+0000","last_undegraded":"2024-09-13T18:43:38.739130+0000","last_fullsized":"2024-09-13T18:43:38.739130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:07.651837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"23'95","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.742654+0000","last_change":"2024-09-13T18:39:13.575507+0000","last_active":"2024-09-13T18:43:38.742654+0000","last_peered":"2024-09-13T18:43:38.742654+0000","last_clean":"2024-09-13T18:43:38.742654+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:43:38.742654+0000","last_undegraded":"2024-09-13T18:43:38.742654+0000","last_fullsized":"2024-09-13T18:43:38.742654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:42.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198201,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"23'157","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.735249+0000","last_change":"2024-09-13T18:39:14.598160+0000","last_active":"2024-09-13T18:43:38.735249+0000","last_peered":"2024-09-13T18:43:38.735249+0000","last_clean":"2024-09-13T18:43:38.735249+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:43:38.735249+0000","last_undegraded":"2024-09-13T18:43:38.735249+0000","last_fullsized":"2024-09-13T18:43:38.735249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.437719+0000","last_change":"2024-09-13T18:39:13.572017+0000","last_active":"2024-09-13T18:43:37.437719+0000","last_peered":"2024-09-13T18:43:37.437719+0000","last_clean":"2024-09-13T18:43:37.437719+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:43:37.437719+0000","last_undegraded":"2024-09-13T18:43:37.437719+0000","last_fullsized":"2024-09-13T18:43:37.437719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:25.536255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662584+0000","last_change":"2024-09-13T18:39:13.571792+0000","last_active":"2024-09-13T18:39:53.662584+0000","last_peered":"2024-09-13T18:39:53.662584+0000","last_clean":"2024-09-13T18:39:53.662584+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:39:53.662584+0000","last_undegraded":"2024-09-13T18:39:53.662584+0000","last_fullsized":"2024-09-13T18:39:53.662584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'189","reported_seq":201,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737335+0000","last_change":"2024-09-13T18:39:14.590748+0000","last_active":"2024-09-13T18:43:38.737335+0000","last_peered":"2024-09-13T18:43:38.737335+0000","last_clean":"2024-09-13T18:43:38.737335+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:43:38.737335+0000","last_undegraded":"2024-09-13T18:43:38.737335+0000","last_fullsized":"2024-09-13T18:43:38.737335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:49.557245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.666030+0000","last_change":"2024-09-13T18:39:13.569863+0000","last_active":"2024-09-13T18:39:54.666030+0000","last_peered":"2024-09-13T18:39:54.666030+0000","last_clean":"2024-09-13T18:39:54.666030+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:39:54.666030+0000","last_undegraded":"2024-09-13T18:39:54.666030+0000","last_fullsized":"2024-09-13T18:39:54.666030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'165","reported_seq":177,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740654+0000","last_change":"2024-09-13T18:39:14.582205+0000","last_active":"2024-09-13T18:43:38.740654+0000","last_peered":"2024-09-13T18:43:38.740654+0000","last_clean":"2024-09-13T18:43:38.740654+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:43:38.740654+0000","last_undegraded":"2024-09-13T18:43:38.740654+0000","last_fullsized":"2024-09-13T18:43:38.740654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.186210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'135","reported_seq":144,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730768+0000","last_change":"2024-09-13T18:39:54.668351+0000","last_active":"2024-09-13T18:43:38.730768+0000","last_peered":"2024-09-13T18:43:38.730768+0000","last_clean":"2024-09-13T18:43:38.730768+0000","last_became_active":"2024-09-13T18:39:54.667809+0000","last_became_peered":"2024-09-13T18:39:54.667809+0000","last_unstale":"2024-09-13T18:43:38.730768+0000","last_undegraded":"2024-09-13T18:43:38.730768+0000","last_fullsized":"2024-09-13T18:43:38.730768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:40.114429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661053+0000","last_change":"2024-09-13T18:39:13.573803+0000","last_active":"2024-09-13T18:39:53.661053+0000","last_peered":"2024-09-13T18:39:53.661053+0000","last_clean":"2024-09-13T18:39:53.661053+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:39:53.661053+0000","last_undegraded":"2024-09-13T18:39:53.661053+0000","last_fullsized":"2024-09-13T18:39:53.661053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:08.298094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"23'152","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734010+0000","last_change":"2024-09-13T18:39:14.586848+0000","last_active":"2024-09-13T18:43:38.734010+0000","last_peered":"2024-09-13T18:43:38.734010+0000","last_clean":"2024-09-13T18:43:38.734010+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:43:38.734010+0000","last_undegraded":"2024-09-13T18:43:38.734010+0000","last_fullsized":"2024-09-13T18:43:38.734010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660115+0000","last_change":"2024-09-13T18:39:13.586123+0000","last_active":"2024-09-13T18:39:53.660115+0000","last_peered":"2024-09-13T18:39:53.660115+0000","last_clean":"2024-09-13T18:39:53.660115+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:39:53.660115+0000","last_undegraded":"2024-09-13T18:39:53.660115+0000","last_fullsized":"2024-09-13T18:39:53.660115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"23'183","reported_seq":192,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731266+0000","last_change":"2024-09-13T18:39:54.668883+0000","last_active":"2024-09-13T18:43:38.731266+0000","last_peered":"2024-09-13T18:43:38.731266+0000","last_clean":"2024-09-13T18:43:38.731266+0000","last_became_active":"2024-09-13T18:39:54.668613+0000","last_became_peered":"2024-09-13T18:39:54.668613+0000","last_unstale":"2024-09-13T18:43:38.731266+0000","last_undegraded":"2024-09-13T18:43:38.731266+0000","last_fullsized":"2024-09-13T18:43:38.731266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:31.076844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661254+0000","last_change":"2024-09-13T18:39:13.575435+0000","last_active":"2024-09-13T18:39:53.661254+0000","last_peered":"2024-09-13T18:39:53.661254+0000","last_clean":"2024-09-13T18:39:53.661254+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:39:53.661254+0000","last_undegraded":"2024-09-13T18:39:53.661254+0000","last_fullsized":"2024-09-13T18:39:53.661254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"23'141","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727330+0000","last_change":"2024-09-13T18:39:14.580846+0000","last_active":"2024-09-13T18:43:38.727330+0000","last_peered":"2024-09-13T18:43:38.727330+0000","last_clean":"2024-09-13T18:43:38.727330+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:43:38.727330+0000","last_undegraded":"2024-09-13T18:43:38.727330+0000","last_fullsized":"2024-09-13T18:43:38.727330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.010053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666752+0000","last_change":"2024-09-13T18:39:13.571042+0000","last_active":"2024-09-13T18:39:53.666752+0000","last_peered":"2024-09-13T18:39:53.666752+0000","last_clean":"2024-09-13T18:39:53.666752+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:39:53.666752+0000","last_undegraded":"2024-09-13T18:39:53.666752+0000","last_fullsized":"2024-09-13T18:39:53.666752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.288993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"23'137","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738740+0000","last_change":"2024-09-13T18:39:14.593258+0000","last_active":"2024-09-13T18:43:38.738740+0000","last_peered":"2024-09-13T18:43:38.738740+0000","last_clean":"2024-09-13T18:43:38.738740+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:43:38.738740+0000","last_undegraded":"2024-09-13T18:43:38.738740+0000","last_fullsized":"2024-09-13T18:43:38.738740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:21.972039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660913+0000","last_change":"2024-09-13T18:39:13.584903+0000","last_active":"2024-09-13T18:39:53.660913+0000","last_peered":"2024-09-13T18:39:53.660913+0000","last_clean":"2024-09-13T18:39:53.660913+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:39:53.660913+0000","last_undegraded":"2024-09-13T18:39:53.660913+0000","last_fullsized":"2024-09-13T18:39:53.660913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:46.551317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"23'130","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.714269+0000","last_change":"2024-09-13T18:39:54.667465+0000","last_active":"2024-09-13T18:43:38.714269+0000","last_peered":"2024-09-13T18:43:38.714269+0000","last_clean":"2024-09-13T18:43:38.714269+0000","last_became_active":"2024-09-13T18:39:54.667188+0000","last_became_peered":"2024-09-13T18:39:54.667188+0000","last_unstale":"2024-09-13T18:43:38.714269+0000","last_undegraded":"2024-09-13T18:43:38.714269+0000","last_fullsized":"2024-09-13T18:43:38.714269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:40.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664322+0000","last_change":"2024-09-13T18:39:13.574044+0000","last_active":"2024-09-13T18:39:54.664322+0000","last_peered":"2024-09-13T18:39:54.664322+0000","last_clean":"2024-09-13T18:39:54.664322+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:39:54.664322+0000","last_undegraded":"2024-09-13T18:39:54.664322+0000","last_fullsized":"2024-09-13T18:39:54.664322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:12.168801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'157","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739642+0000","last_change":"2024-09-13T18:39:14.591381+0000","last_active":"2024-09-13T18:43:38.739642+0000","last_peered":"2024-09-13T18:43:38.739642+0000","last_clean":"2024-09-13T18:43:38.739642+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:43:38.739642+0000","last_undegraded":"2024-09-13T18:43:38.739642+0000","last_fullsized":"2024-09-13T18:43:38.739642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:17.239023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661826+0000","last_change":"2024-09-13T18:39:13.575357+0000","last_active":"2024-09-13T18:39:53.661826+0000","last_peered":"2024-09-13T18:39:53.661826+0000","last_clean":"2024-09-13T18:39:53.661826+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:39:53.661826+0000","last_undegraded":"2024-09-13T18:39:53.661826+0000","last_fullsized":"2024-09-13T18:39:53.661826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:20.965325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"23'170","reported_seq":182,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.722266+0000","last_change":"2024-09-13T18:39:14.580750+0000","last_active":"2024-09-13T18:43:38.722266+0000","last_peered":"2024-09-13T18:43:38.722266+0000","last_clean":"2024-09-13T18:43:38.722266+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:43:38.722266+0000","last_undegraded":"2024-09-13T18:43:38.722266+0000","last_fullsized":"2024-09-13T18:43:38.722266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:08.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666153+0000","last_change":"2024-09-13T18:39:13.583221+0000","last_active":"2024-09-13T18:39:53.666153+0000","last_peered":"2024-09-13T18:39:53.666153+0000","last_clean":"2024-09-13T18:39:53.666153+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:39:53.666153+0000","last_undegraded":"2024-09-13T18:39:53.666153+0000","last_fullsized":"2024-09-13T18:39:53.666153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":199492,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":160,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":398984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705724,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306084,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065756,"statfs":{"total":96636764160,"available":96323334144,"internally_reserved":0,"allocated":421888,"data_stored":266388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.33900000000000002,"15min":0.32100000000000001},"min":{"1min":0.184,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":4.5049999999999999,"5min":4.5049999999999999,"15min":4.5049999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.20399999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.316}]},{"osd":1,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"min":{"1min":0.191,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":3.8980000000000001,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.35699999999999998,"15min":0.33800000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.376}]},{"osd":2,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.23499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":3,"5min":3,"15min":3},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":4.5590000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":0.32900000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705725,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306068,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065772,"statfs":{"total":96636764160,"available":96323350528,"internally_reserved":0,"allocated":405504,"data_stored":265554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.151,"5min":0.151,"15min":0.151},"max":{"1min":0.39400000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.193,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.308},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.376},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.36299999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306460,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065380,"statfs":{"total":96636764160,"available":96322949120,"internally_reserved":0,"allocated":806912,"data_stored":659023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,4,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.315},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.33300000000000002,"15min":0.32900000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52500000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.39600000000000002,"15min":0.35199999999999998},"min":{"1min":0.217,"5min":0.184,"15min":0.184},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.35899999999999999,"15min":0.34599999999999997},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.42099999999999999,"15min":0.378},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.218},"max":{"1min":6.468,"5min":6.468,"15min":6.468},"last":0.371}]}]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306464,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065376,"statfs":{"total":96636764160,"available":96322945024,"internally_reserved":0,"allocated":811008,"data_stored":659563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.29699999999999999,"15min":0.30399999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.43099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.33200000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.499}]},{"osd":2,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.313,"15min":0.32100000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.371,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.315,"5min":0.33200000000000002,"15min":0.33700000000000002},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47799999999999998,"5min":0.5,"15min":0.5},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34699999999999998,"15min":0.35499999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.45600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":198706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":198395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:43:46.254 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:43:46.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.381+0000 7fd3f411d640 1 Processor -- start 2024-09-13T18:43:46.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f411d640 1 -- start start 2024-09-13T18:43:46.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f411d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 0x7fd3ec096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:46.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f411d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd3ec0969d0 0x7fd3ec0974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:46.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f411d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd3ec12bf70 0x7fd3ec12c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:46.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f411d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ec09e380 con 0x7fd3ec0969d0 2024-09-13T18:43:46.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f411d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec06a190 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f411d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec098870 con 0x7fd3ec12bf70 2024-09-13T18:43:46.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f1eb9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 0x7fd3ec096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:46.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f26ba640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd3ec12bf70 0x7fd3ec12c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:46.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f16b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd3ec0969d0 0x7fd3ec0974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:46.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f1eb9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 0x7fd3ec096f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:49334/0 (socket says 172.21.15.97:49334) 2024-09-13T18:43:46.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f26ba640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd3ec12bf70 0x7fd3ec12c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:35964/0 (socket says 172.21.15.97:35964) 2024-09-13T18:43:46.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f16b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd3ec0969d0 0x7fd3ec0974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53974/0 (socket says 172.21.15.97:53974) 2024-09-13T18:43:46.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f1eb9640 1 -- 172.21.15.97:0/4020648157 learned_addr learned my addr 172.21.15.97:0/4020648157 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:46.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f16b8640 1 -- 172.21.15.97:0/4020648157 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd3ec12bf70 msgr2=0x7fd3ec12c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:46.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.382+0000 7fd3f16b8640 1 --2- 172.21.15.97:0/4020648157 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd3ec12bf70 0x7fd3ec12c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.383+0000 7fd3f16b8640 1 -- 172.21.15.97:0/4020648157 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 msgr2=0x7fd3ec096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:46.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.383+0000 7fd3f16b8640 1 --2- 172.21.15.97:0/4020648157 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 0x7fd3ec096f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.383+0000 7fd3f16b8640 1 -- 172.21.15.97:0/4020648157 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec098e10 con 0x7fd3ec0969d0 2024-09-13T18:43:46.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.383+0000 7fd3f1eb9640 1 --2- 172.21.15.97:0/4020648157 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 0x7fd3ec096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:46.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.383+0000 7fd3f16b8640 1 --2- 172.21.15.97:0/4020648157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec0969d0 0x7fd3ec0974c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009850 tx=0x7fd3dc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffa10b3b4d5527c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:46.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.383+0000 7fd3f0eb7640 1 -- 172.21.15.97:0/4020648157 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc02ac50 con 0x7fd3ec0969d0 2024-09-13T18:43:46.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.383+0000 7fd3f0eb7640 1 -- 172.21.15.97:0/4020648157 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc02adb0 con 0x7fd3ec0969d0 2024-09-13T18:43:46.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.383+0000 7fd3f0eb7640 1 -- 172.21.15.97:0/4020648157 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc032670 con 0x7fd3ec0969d0 2024-09-13T18:43:46.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.384+0000 7fd3f411d640 1 -- 172.21.15.97:0/4020648157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec0969d0 msgr2=0x7fd3ec0974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.384+0000 7fd3f411d640 1 --2- 172.21.15.97:0/4020648157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec0969d0 0x7fd3ec0974c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009850 tx=0x7fd3dc0090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.384+0000 7fd3f411d640 1 -- 172.21.15.97:0/4020648157 shutdown_connections 2024-09-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.384+0000 7fd3f411d640 1 --2- 172.21.15.97:0/4020648157 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd3ec12bf70 0x7fd3ec12c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.384+0000 7fd3f411d640 1 --2- 172.21.15.97:0/4020648157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec0969d0 0x7fd3ec0974c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.384+0000 7fd3f411d640 1 --2- 172.21.15.97:0/4020648157 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 0x7fd3ec096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.384+0000 7fd3f411d640 1 -- 172.21.15.97:0/4020648157 >> 172.21.15.97:0/4020648157 conn(0x7fd3ec09b200 msgr2=0x7fd3ec09b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.384+0000 7fd3f411d640 1 -- 172.21.15.97:0/4020648157 shutdown_connections 2024-09-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.384+0000 7fd3f411d640 1 -- 172.21.15.97:0/4020648157 wait complete. 2024-09-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f411d640 1 Processor -- start 2024-09-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f411d640 1 -- start start 2024-09-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f411d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd3ec0969d0 0x7fd3ec11b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f411d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 0x7fd3ec117aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f411d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec12bf70 0x7fd3ec117fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f411d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec1190c0 con 0x7fd3ec12bf70 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f411d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec099700 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f411d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec097e10 con 0x7fd3ec0969d0 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f16b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 0x7fd3ec117aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f1eb9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd3ec0969d0 0x7fd3ec11b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f26ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec12bf70 0x7fd3ec117fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f16b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 0x7fd3ec117aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:49338/0 (socket says 172.21.15.97:49338) 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f16b8640 1 -- 172.21.15.97:0/2175758257 learned_addr learned my addr 172.21.15.97:0/2175758257 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.385+0000 7fd3f1eb9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd3ec0969d0 0x7fd3ec11b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:35974/0 (socket says 172.21.15.97:35974) 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.386+0000 7fd3f16b8640 1 -- 172.21.15.97:0/2175758257 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd3ec0969d0 msgr2=0x7fd3ec11b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.386+0000 7fd3f16b8640 1 --2- 172.21.15.97:0/2175758257 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd3ec0969d0 0x7fd3ec11b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.386+0000 7fd3f16b8640 1 -- 172.21.15.97:0/2175758257 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec12bf70 msgr2=0x7fd3ec117fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.386+0000 7fd3f16b8640 1 --2- 172.21.15.97:0/2175758257 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec12bf70 0x7fd3ec117fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.386+0000 7fd3f16b8640 1 -- 172.21.15.97:0/2175758257 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e800d8f0 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.386+0000 7fd3f26ba640 1 --2- 172.21.15.97:0/2175758257 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec12bf70 0x7fd3ec117fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:46.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.386+0000 7fd3f1eb9640 1 --2- 172.21.15.97:0/2175758257 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd3ec0969d0 0x7fd3ec11b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:46.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.386+0000 7fd3f16b8640 1 --2- 172.21.15.97:0/2175758257 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 0x7fd3ec117aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc02a580 tx=0x7fd3dc032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:46.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.386+0000 7fd3e1ffb640 1 -- 172.21.15.97:0/2175758257 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc03d720 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.386+0000 7fd3e1ffb640 1 -- 172.21.15.97:0/2175758257 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc03d880 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.386+0000 7fd3f411d640 1 -- 172.21.15.97:0/2175758257 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3dc009390 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.386+0000 7fd3e1ffb640 1 -- 172.21.15.97:0/2175758257 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc03dc20 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.386+0000 7fd3f411d640 1 -- 172.21.15.97:0/2175758257 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec118520 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.387+0000 7fd3e1ffb640 1 -- 172.21.15.97:0/2175758257 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fd3dc039040 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.387+0000 7fd3e1ffb640 1 -- 172.21.15.97:0/2175758257 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fd3dc061900 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.387+0000 7fd3f411d640 1 -- 172.21.15.97:0/2175758257 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec11a7b0 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.391+0000 7fd3e1ffb640 1 -- 172.21.15.97:0/2175758257 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fd3dc037080 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.546+0000 7fd3f411d640 1 -- 172.21.15.97:0/2175758257 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3ec064000 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.546+0000 7fd3e1ffb640 1 -- 172.21.15.97:0/2175758257 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+11626 (secure 0 0 0) 0x7fd3dc0313a0 con 0x7fd3ec09dfb0 2024-09-13T18:43:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:43:46.549 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":23,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:54.652125+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.8","mappings":[{"from":1,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:43:46.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.548+0000 7fd3f411d640 1 -- 172.21.15.97:0/2175758257 >> v1:172.21.15.97:6816/34603 conn(0x7fd3d0031160 legacy=0x7fd3d0033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:46.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.548+0000 7fd3f411d640 1 -- 172.21.15.97:0/2175758257 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 msgr2=0x7fd3ec117aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:46.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.548+0000 7fd3f411d640 1 --2- 172.21.15.97:0/2175758257 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 0x7fd3ec117aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc02a580 tx=0x7fd3dc032000 comp rx=0 tx=0).stop 2024-09-13T18:43:46.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.548+0000 7fd3f411d640 1 -- 172.21.15.97:0/2175758257 shutdown_connections 2024-09-13T18:43:46.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.548+0000 7fd3f411d640 1 --2- 172.21.15.97:0/2175758257 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3ec12bf70 0x7fd3ec117fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.548+0000 7fd3f411d640 1 --2- 172.21.15.97:0/2175758257 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fd3ec09dfb0 0x7fd3ec117aa0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.548+0000 7fd3f411d640 1 --2- 172.21.15.97:0/2175758257 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fd3ec0969d0 0x7fd3ec11b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.548+0000 7fd3f411d640 1 -- 172.21.15.97:0/2175758257 >> 172.21.15.97:0/2175758257 conn(0x7fd3ec09b200 msgr2=0x7fd3ec09cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.548+0000 7fd3f411d640 1 -- 172.21.15.97:0/2175758257 shutdown_connections 2024-09-13T18:43:46.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:46.549+0000 7fd3f411d640 1 -- 172.21.15.97:0/2175758257 wait complete. 2024-09-13T18:43:47.563 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T18:43:47.563 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:43:47.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.668+0000 7f89f9cc9640 1 Processor -- start 2024-09-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.668+0000 7f89f9cc9640 1 -- start start 2024-09-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.668+0000 7f89f9cc9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89f4069a00 0x7f89f409c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.668+0000 7f89f9cc9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f89f412cce0 0x7f89f412fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.668+0000 7f89f9cc9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f412c6e0 con 0x7f89f412c910 2024-09-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.668+0000 7f89f9cc9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f4069dd0 con 0x7f89f412cce0 2024-09-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.668+0000 7f89f9cc9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f409ceb0 con 0x7f89f4069a00 2024-09-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.669+0000 7f89f37fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89f4069a00 0x7f89f409c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.669+0000 7f89f37fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89f4069a00 0x7f89f409c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:34680/0 (socket says 172.21.15.97:34680) 2024-09-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.669+0000 7f89f37fe640 1 -- 172.21.15.97:0/2805419915 learned_addr learned my addr 172.21.15.97:0/2805419915 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.669+0000 7f89f3fff640 1 --2- 172.21.15.97:0/2805419915 >> v2:172.21.15.97:3300/0 conn(0x7f89f412cce0 0x7f89f412fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.669+0000 7f89f37fe640 1 -- 172.21.15.97:0/2805419915 >> v2:172.21.15.97:3300/0 conn(0x7f89f412cce0 msgr2=0x7f89f412fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.669+0000 7f89f37fe640 1 --2- 172.21.15.97:0/2805419915 >> v2:172.21.15.97:3300/0 conn(0x7f89f412cce0 0x7f89f412fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.669+0000 7f89f37fe640 1 -- 172.21.15.97:0/2805419915 >> v1:172.21.15.97:6789/0 conn(0x7f89f412c910 legacy=0x7f89f412f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:47.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.669+0000 7f89f37fe640 1 -- 172.21.15.97:0/2805419915 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f4068f40 con 0x7f89f4069a00 2024-09-13T18:43:47.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.670+0000 7f89f37fe640 1 --2- 172.21.15.97:0/2805419915 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89f4069a00 0x7f89f409c2b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009f50 tx=0x7f89e4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a93c6fad58a089ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:47.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.670+0000 7f89f27fc640 1 -- 172.21.15.97:0/2805419915 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e4031400 con 0x7f89f4069a00 2024-09-13T18:43:47.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.670+0000 7f89f27fc640 1 -- 172.21.15.97:0/2805419915 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e402d050 con 0x7f89f4069a00 2024-09-13T18:43:47.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.670+0000 7f89f27fc640 1 -- 172.21.15.97:0/2805419915 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40317d0 con 0x7f89f4069a00 2024-09-13T18:43:47.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.670+0000 7f89f9cc9640 1 -- 172.21.15.97:0/2805419915 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89f4069a00 msgr2=0x7f89f409c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:47.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.670+0000 7f89f9cc9640 1 --2- 172.21.15.97:0/2805419915 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89f4069a00 0x7f89f409c2b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009f50 tx=0x7f89e4009840 comp rx=0 tx=0).stop 2024-09-13T18:43:47.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.670+0000 7f89f9cc9640 1 -- 172.21.15.97:0/2805419915 shutdown_connections 2024-09-13T18:43:47.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.670+0000 7f89f9cc9640 1 --2- 172.21.15.97:0/2805419915 >> v2:172.21.15.97:3300/0 conn(0x7f89f412cce0 0x7f89f412fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.670+0000 7f89f9cc9640 1 --2- 172.21.15.97:0/2805419915 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89f4069a00 0x7f89f409c2b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.670+0000 7f89f9cc9640 1 -- 172.21.15.97:0/2805419915 >> 172.21.15.97:0/2805419915 conn(0x7f89f40a1470 msgr2=0x7f89f409d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:47.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.671+0000 7f89f9cc9640 1 -- 172.21.15.97:0/2805419915 shutdown_connections 2024-09-13T18:43:47.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.671+0000 7f89f9cc9640 1 -- 172.21.15.97:0/2805419915 wait complete. 2024-09-13T18:43:47.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.671+0000 7f89f9cc9640 1 Processor -- start 2024-09-13T18:43:47.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f9cc9640 1 -- start start 2024-09-13T18:43:47.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f9cc9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89f4069a00 0x7f89f412b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:47.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f9cc9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89f412c910 0x7f89f411abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:47.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f9cc9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f89f412cce0 0x7f89f411b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:47.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f9cc9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f411e4c0 con 0x7f89f4069a00 2024-09-13T18:43:47.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f9cc9640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f411c620 con 0x7f89f412c910 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f9cc9640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89f409fac0 con 0x7f89f412cce0 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89f4069a00 0x7f89f412b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f2ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89f412c910 0x7f89f411abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89f4069a00 0x7f89f412b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:43348/0 (socket says 172.21.15.97:43348) 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f37fe640 1 -- 172.21.15.97:0/1613200732 learned_addr learned my addr 172.21.15.97:0/1613200732 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f3fff640 1 --2- 172.21.15.97:0/1613200732 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f89f412cce0 0x7f89f411b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f37fe640 1 -- 172.21.15.97:0/1613200732 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f89f412cce0 msgr2=0x7f89f411b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f37fe640 1 --2- 172.21.15.97:0/1613200732 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f89f412cce0 0x7f89f411b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f37fe640 1 -- 172.21.15.97:0/1613200732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89f412c910 msgr2=0x7f89f411abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f37fe640 1 --2- 172.21.15.97:0/1613200732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89f412c910 0x7f89f411abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f37fe640 1 -- 172.21.15.97:0/1613200732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e4009ae0 con 0x7f89f4069a00 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.672+0000 7f89f2ffd640 1 --2- 172.21.15.97:0/1613200732 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f89f412c910 0x7f89f411abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.673+0000 7f89f37fe640 1 --2- 172.21.15.97:0/1613200732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89f4069a00 0x7f89f412b9f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009f50 tx=0x7f89e4036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:47.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.673+0000 7f89db7fe640 1 -- 172.21.15.97:0/1613200732 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e403b620 con 0x7f89f4069a00 2024-09-13T18:43:47.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.673+0000 7f89db7fe640 1 -- 172.21.15.97:0/1613200732 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e403b780 con 0x7f89f4069a00 2024-09-13T18:43:47.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.673+0000 7f89db7fe640 1 -- 172.21.15.97:0/1613200732 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e403bb40 con 0x7f89f4069a00 2024-09-13T18:43:47.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.673+0000 7f89f9cc9640 1 -- 172.21.15.97:0/1613200732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f4068940 con 0x7f89f4069a00 2024-09-13T18:43:47.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.673+0000 7f89f9cc9640 1 -- 172.21.15.97:0/1613200732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f411cda0 con 0x7f89f4069a00 2024-09-13T18:43:47.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.674+0000 7f89db7fe640 1 -- 172.21.15.97:0/1613200732 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f89e4038070 con 0x7f89f4069a00 2024-09-13T18:43:47.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.674+0000 7f89f9cc9640 1 -- 172.21.15.97:0/1613200732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f89f411de80 con 0x7f89f4069a00 2024-09-13T18:43:47.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.674+0000 7f89db7fe640 1 -- 172.21.15.97:0/1613200732 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f89e40627f0 con 0x7f89f4069a00 2024-09-13T18:43:47.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.674+0000 7f89db7fe640 1 -- 172.21.15.97:0/1613200732 --> v1:172.21.15.97:6812/35062 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89e003dd50 con 0x7f89e003a050 2024-09-13T18:43:47.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.674+0000 7f89db7fe640 1 -- 172.21.15.97:0/1613200732 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89e403a370 con 0x7f89f4069a00 2024-09-13T18:43:47.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.675+0000 7f89db7fe640 1 -- 172.21.15.97:0/1613200732 <== osd.0 v1:172.21.15.97:6812/35062 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f89e003dd50 con 0x7f89e003a050 2024-09-13T18:43:47.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.686+0000 7f89f9cc9640 1 -- 172.21.15.97:0/1613200732 --> v1:172.21.15.97:6812/35062 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f89f4064000 con 0x7f89e003a050 2024-09-13T18:43:47.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.686+0000 7f89db7fe640 1 -- 172.21.15.97:0/1613200732 <== osd.0 v1:172.21.15.97:6812/35062 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f89f4064000 con 0x7f89e003a050 2024-09-13T18:43:47.690 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-13T18:43:47.690 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:43:47.690 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-13T18:43:47.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.687+0000 7f89f9cc9640 1 -- 172.21.15.97:0/1613200732 >> v1:172.21.15.97:6812/35062 conn(0x7f89e003a050 legacy=0x7f89e003c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:47.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.687+0000 7f89f9cc9640 1 -- 172.21.15.97:0/1613200732 >> v1:172.21.15.97:6816/34603 conn(0x7f89e0031160 legacy=0x7f89e0033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:47.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.687+0000 7f89f9cc9640 1 -- 172.21.15.97:0/1613200732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89f4069a00 msgr2=0x7f89f412b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:47.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.687+0000 7f89f9cc9640 1 --2- 172.21.15.97:0/1613200732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89f4069a00 0x7f89f412b9f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009f50 tx=0x7f89e4036000 comp rx=0 tx=0).stop 2024-09-13T18:43:47.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.687+0000 7f89f3fff640 1 -- 172.21.15.97:0/1613200732 reap_dead start 2024-09-13T18:43:47.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.687+0000 7f89f9cc9640 1 -- 172.21.15.97:0/1613200732 shutdown_connections 2024-09-13T18:43:47.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.687+0000 7f89f9cc9640 1 -- 172.21.15.97:0/1613200732 >> 172.21.15.97:0/1613200732 conn(0x7f89f40a1470 msgr2=0x7f89f40a0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:47.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.687+0000 7f89f9cc9640 1 -- 172.21.15.97:0/1613200732 shutdown_connections 2024-09-13T18:43:47.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.687+0000 7f89f9cc9640 1 -- 172.21.15.97:0/1613200732 wait complete. 2024-09-13T18:43:47.700 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T18:43:47.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.792+0000 7f2e8aa34640 1 Processor -- start 2024-09-13T18:43:47.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.792+0000 7f2e8aa34640 1 -- start start 2024-09-13T18:43:47.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e8aa34640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e8409c8a0 0x7f2e8412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:47.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e8aa34640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2e8412daf0 0x7f2e8412dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:47.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e8aa34640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8412d380 con 0x7f2e84098be0 2024-09-13T18:43:47.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e8aa34640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8409cc70 con 0x7f2e8412daf0 2024-09-13T18:43:47.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e8aa34640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e84067e30 con 0x7f2e8409c8a0 2024-09-13T18:43:47.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e83fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e8409c8a0 0x7f2e8412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:47.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e837fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2e8412daf0 0x7f2e8412dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:47.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e837fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2e8412daf0 0x7f2e8412dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:43358/0 (socket says 172.21.15.97:43358) 2024-09-13T18:43:47.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e837fe640 1 -- 172.21.15.97:0/2246445462 learned_addr learned my addr 172.21.15.97:0/2246445462 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:47.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e83fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e8409c8a0 0x7f2e8412d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:34702/0 (socket says 172.21.15.97:34702) 2024-09-13T18:43:47.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e88fd1640 1 --1- 172.21.15.97:0/2246445462 >> v1:172.21.15.97:6789/0 conn(0x7f2e84098be0 0x7f2e84099060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56160/0 (socket says 172.21.15.97:56160) 2024-09-13T18:43:47.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e837fe640 1 -- 172.21.15.97:0/2246445462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e8409c8a0 msgr2=0x7f2e8412d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:47.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e837fe640 1 --2- 172.21.15.97:0/2246445462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e8409c8a0 0x7f2e8412d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e837fe640 1 -- 172.21.15.97:0/2246445462 >> v1:172.21.15.97:6789/0 conn(0x7f2e84098be0 legacy=0x7f2e84099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:47.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e837fe640 1 -- 172.21.15.97:0/2246445462 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84067970 con 0x7f2e8412daf0 2024-09-13T18:43:47.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e82ffd640 1 -- 172.21.15.97:0/2246445462 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541380813 0 0) 0x7f2e8412d380 con 0x7f2e84098be0 2024-09-13T18:43:47.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.793+0000 7f2e83fff640 1 --2- 172.21.15.97:0/2246445462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e8409c8a0 0x7f2e8412d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:47.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.794+0000 7f2e837fe640 1 --2- 172.21.15.97:0/2246445462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e8412daf0 0x7f2e8412dec0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009910 tx=0x7f2e780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c333a745dc5b43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:47.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.794+0000 7f2e82ffd640 1 -- 172.21.15.97:0/2246445462 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7802add0 con 0x7f2e8412daf0 2024-09-13T18:43:47.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.794+0000 7f2e82ffd640 1 -- 172.21.15.97:0/2246445462 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e78032440 con 0x7f2e8412daf0 2024-09-13T18:43:47.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.794+0000 7f2e82ffd640 1 -- 172.21.15.97:0/2246445462 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e780327e0 con 0x7f2e8412daf0 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.794+0000 7f2e8aa34640 1 -- 172.21.15.97:0/2246445462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e8412daf0 msgr2=0x7f2e8412dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.794+0000 7f2e8aa34640 1 --2- 172.21.15.97:0/2246445462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e8412daf0 0x7f2e8412dec0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009910 tx=0x7f2e780091d0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.794+0000 7f2e8aa34640 1 -- 172.21.15.97:0/2246445462 shutdown_connections 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.794+0000 7f2e8aa34640 1 --2- 172.21.15.97:0/2246445462 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e8412daf0 0x7f2e8412dec0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.794+0000 7f2e8aa34640 1 --2- 172.21.15.97:0/2246445462 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e8409c8a0 0x7f2e8412d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.794+0000 7f2e8aa34640 1 -- 172.21.15.97:0/2246445462 >> 172.21.15.97:0/2246445462 conn(0x7f2e8405e5d0 msgr2=0x7f2e8409f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.795+0000 7f2e8aa34640 1 -- 172.21.15.97:0/2246445462 shutdown_connections 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.795+0000 7f2e8aa34640 1 -- 172.21.15.97:0/2246445462 wait complete. 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.795+0000 7f2e8aa34640 1 Processor -- start 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e8aa34640 1 -- start start 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e8aa34640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e84098be0 0x7f2e8411a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e8aa34640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e8409c8a0 0x7f2e84116c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e8aa34640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2e8412daf0 0x7f2e841171a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e8aa34640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8409b6c0 con 0x7f2e8409c8a0 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e8aa34640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8409abe0 con 0x7f2e84098be0 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e8aa34640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e841198d0 con 0x7f2e8412daf0 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e83fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e84098be0 0x7f2e8411a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e83fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e84098be0 0x7f2e8411a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:34712/0 (socket says 172.21.15.97:34712) 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e83fff640 1 -- 172.21.15.97:0/135801924 learned_addr learned my addr 172.21.15.97:0/135801924 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e837fe640 1 --2- 172.21.15.97:0/135801924 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e8409c8a0 0x7f2e84116c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e88fd1640 1 --2- 172.21.15.97:0/135801924 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2e8412daf0 0x7f2e841171a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e83fff640 1 -- 172.21.15.97:0/135801924 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2e8412daf0 msgr2=0x7f2e841171a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e83fff640 1 --2- 172.21.15.97:0/135801924 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2e8412daf0 0x7f2e841171a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e83fff640 1 -- 172.21.15.97:0/135801924 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e8409c8a0 msgr2=0x7f2e84116c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e83fff640 1 --2- 172.21.15.97:0/135801924 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e8409c8a0 0x7f2e84116c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.796+0000 7f2e83fff640 1 -- 172.21.15.97:0/135801924 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e74009390 con 0x7f2e84098be0 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.797+0000 7f2e83fff640 1 --2- 172.21.15.97:0/135801924 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e84098be0 0x7f2e8411a370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400ecb0 tx=0x7f2e740090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.797+0000 7f2e6bfff640 1 -- 172.21.15.97:0/135801924 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400cbc0 con 0x7f2e84098be0 2024-09-13T18:43:47.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.797+0000 7f2e6bfff640 1 -- 172.21.15.97:0/135801924 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7400cd20 con 0x7f2e84098be0 2024-09-13T18:43:47.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.797+0000 7f2e8aa34640 1 -- 172.21.15.97:0/135801924 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e78009450 con 0x7f2e84098be0 2024-09-13T18:43:47.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.797+0000 7f2e6bfff640 1 -- 172.21.15.97:0/135801924 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e740136a0 con 0x7f2e84098be0 2024-09-13T18:43:47.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.797+0000 7f2e8aa34640 1 -- 172.21.15.97:0/135801924 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e841176e0 con 0x7f2e84098be0 2024-09-13T18:43:47.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.797+0000 7f2e6bfff640 1 -- 172.21.15.97:0/135801924 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f2e74013a10 con 0x7f2e84098be0 2024-09-13T18:43:47.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.798+0000 7f2e6bfff640 1 -- 172.21.15.97:0/135801924 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f2e74042490 con 0x7f2e84098be0 2024-09-13T18:43:47.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.798+0000 7f2e8aa34640 1 -- 172.21.15.97:0/135801924 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e84064000 con 0x7f2e84098be0 2024-09-13T18:43:47.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.802+0000 7f2e6bfff640 1 -- 172.21.15.97:0/135801924 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f2e74021020 con 0x7f2e84098be0 2024-09-13T18:43:47.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.952+0000 7f2e8aa34640 1 -- 172.21.15.97:0/135801924 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e84117990 con 0x7f2e70031160 2024-09-13T18:43:47.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.953+0000 7f2e6bfff640 1 -- 172.21.15.97:0/135801924 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (unknown 2057319476 0 0) 0x7f2e84117990 con 0x7f2e70031160 2024-09-13T18:43:47.956 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T18:43:47.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.955+0000 7f2e8aa34640 1 -- 172.21.15.97:0/135801924 >> v1:172.21.15.97:6816/34603 conn(0x7f2e70031160 legacy=0x7f2e70033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:47.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.955+0000 7f2e8aa34640 1 -- 172.21.15.97:0/135801924 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e84098be0 msgr2=0x7f2e8411a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:47.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.955+0000 7f2e8aa34640 1 --2- 172.21.15.97:0/135801924 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e84098be0 0x7f2e8411a370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400ecb0 tx=0x7f2e740090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.955+0000 7f2e8aa34640 1 -- 172.21.15.97:0/135801924 shutdown_connections 2024-09-13T18:43:47.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.955+0000 7f2e8aa34640 1 --2- 172.21.15.97:0/135801924 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f2e8412daf0 0x7f2e841171a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.955+0000 7f2e8aa34640 1 --2- 172.21.15.97:0/135801924 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e8409c8a0 0x7f2e84116c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.955+0000 7f2e8aa34640 1 --2- 172.21.15.97:0/135801924 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f2e84098be0 0x7f2e8411a370 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:47.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.955+0000 7f2e8aa34640 1 -- 172.21.15.97:0/135801924 >> 172.21.15.97:0/135801924 conn(0x7f2e8405e5d0 msgr2=0x7f2e8409e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:47.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.955+0000 7f2e8aa34640 1 -- 172.21.15.97:0/135801924 shutdown_connections 2024-09-13T18:43:47.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:47.955+0000 7f2e8aa34640 1 -- 172.21.15.97:0/135801924 wait complete. 2024-09-13T18:43:47.968 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T18:43:47.968 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:43:48.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.063+0000 7f796304f640 1 Processor -- start 2024-09-13T18:43:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.063+0000 7f796304f640 1 -- start start 2024-09-13T18:43:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.063+0000 7f796304f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f795c09e0c0 0x7f795c096c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.063+0000 7f796304f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f795c097540 0x7f795c12c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.063+0000 7f796304f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795c09cae0 con 0x7f795c097170 2024-09-13T18:43:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.063+0000 7f796304f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c0969d0 con 0x7f795c097540 2024-09-13T18:43:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.063+0000 7f796304f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795c0988e0 con 0x7f795c09e0c0 2024-09-13T18:43:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.064+0000 7f7960deb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f795c09e0c0 0x7f795c096c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.064+0000 7f79615ec640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f795c097540 0x7f795c12c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.064+0000 7f79615ec640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f795c097540 0x7f795c12c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:43368/0 (socket says 172.21.15.97:43368) 2024-09-13T18:43:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.064+0000 7f7960deb640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f795c09e0c0 0x7f795c096c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:34718/0 (socket says 172.21.15.97:34718) 2024-09-13T18:43:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.064+0000 7f79615ec640 1 -- 172.21.15.97:0/2681737178 learned_addr learned my addr 172.21.15.97:0/2681737178 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:48.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.064+0000 7f79615ec640 1 -- 172.21.15.97:0/2681737178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f795c09e0c0 msgr2=0x7f795c096c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:48.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.064+0000 7f79615ec640 1 --2- 172.21.15.97:0/2681737178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f795c09e0c0 0x7f795c096c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.064+0000 7f79615ec640 1 -- 172.21.15.97:0/2681737178 >> v1:172.21.15.97:6789/0 conn(0x7f795c097170 legacy=0x7f795c12c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.064+0000 7f79615ec640 1 -- 172.21.15.97:0/2681737178 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c097960 con 0x7f795c097540 2024-09-13T18:43:48.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.064+0000 7f795b7fe640 1 -- 172.21.15.97:0/2681737178 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479286212 0 0) 0x7f795c09cae0 con 0x7f795c097170 2024-09-13T18:43:48.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.064+0000 7f7960deb640 1 --2- 172.21.15.97:0/2681737178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f795c09e0c0 0x7f795c096c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:48.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.065+0000 7f79615ec640 1 --2- 172.21.15.97:0/2681737178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c097540 0x7f795c12c770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7954009f20 tx=0x7f7954009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843a2410f9457317 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:48.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.065+0000 7f795b7fe640 1 -- 172.21.15.97:0/2681737178 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7954031400 con 0x7f795c097540 2024-09-13T18:43:48.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.065+0000 7f795b7fe640 1 -- 172.21.15.97:0/2681737178 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795402d050 con 0x7f795c097540 2024-09-13T18:43:48.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.065+0000 7f795b7fe640 1 -- 172.21.15.97:0/2681737178 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7954031790 con 0x7f795c097540 2024-09-13T18:43:48.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.065+0000 7f796304f640 1 -- 172.21.15.97:0/2681737178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c097540 msgr2=0x7f795c12c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.065+0000 7f796304f640 1 --2- 172.21.15.97:0/2681737178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c097540 0x7f795c12c770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7954009f20 tx=0x7f7954009840 comp rx=0 tx=0).stop 2024-09-13T18:43:48.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.065+0000 7f796304f640 1 -- 172.21.15.97:0/2681737178 shutdown_connections 2024-09-13T18:43:48.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.065+0000 7f796304f640 1 --2- 172.21.15.97:0/2681737178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c097540 0x7f795c12c770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.065+0000 7f796304f640 1 --2- 172.21.15.97:0/2681737178 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f795c09e0c0 0x7f795c096c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.065+0000 7f796304f640 1 -- 172.21.15.97:0/2681737178 >> 172.21.15.97:0/2681737178 conn(0x7f795c05e5d0 msgr2=0x7f795c09e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:48.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.065+0000 7f796304f640 1 -- 172.21.15.97:0/2681737178 shutdown_connections 2024-09-13T18:43:48.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.065+0000 7f796304f640 1 -- 172.21.15.97:0/2681737178 wait complete. 2024-09-13T18:43:48.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.066+0000 7f796304f640 1 Processor -- start 2024-09-13T18:43:48.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.066+0000 7f796304f640 1 -- start start 2024-09-13T18:43:48.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f796304f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c097170 0x7f795c11ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f796304f640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f795c097540 0x7f795c11b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f796304f640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f795c09e0c0 0x7f795c11b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f796304f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c09b3f0 con 0x7f795c097170 2024-09-13T18:43:48.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f796304f640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795c097e80 con 0x7f795c09e0c0 2024-09-13T18:43:48.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f796304f640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f795c11d860 con 0x7f795c097540 2024-09-13T18:43:48.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f7960deb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c097170 0x7f795c11ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f7960deb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c097170 0x7f795c11ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:43370/0 (socket says 172.21.15.97:43370) 2024-09-13T18:43:48.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f7960deb640 1 -- 172.21.15.97:0/1962539208 learned_addr learned my addr 172.21.15.97:0/1962539208 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:48.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f79615ec640 1 --2- 172.21.15.97:0/1962539208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f795c09e0c0 0x7f795c11b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f795bfff640 1 --2- 172.21.15.97:0/1962539208 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f795c097540 0x7f795c11b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f7960deb640 1 -- 172.21.15.97:0/1962539208 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f795c097540 msgr2=0x7f795c11b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f7960deb640 1 --2- 172.21.15.97:0/1962539208 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f795c097540 0x7f795c11b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f7960deb640 1 -- 172.21.15.97:0/1962539208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f795c09e0c0 msgr2=0x7f795c11b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f7960deb640 1 --2- 172.21.15.97:0/1962539208 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f795c09e0c0 0x7f795c11b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f7960deb640 1 -- 172.21.15.97:0/1962539208 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7950009390 con 0x7f795c097170 2024-09-13T18:43:48.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f7960deb640 1 --2- 172.21.15.97:0/1962539208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c097170 0x7f795c11ad70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7950009ec0 tx=0x7f79500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:48.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f7958ff9640 1 -- 172.21.15.97:0/1962539208 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795000cbc0 con 0x7f795c097170 2024-09-13T18:43:48.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f7958ff9640 1 -- 172.21.15.97:0/1962539208 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795000cd20 con 0x7f795c097170 2024-09-13T18:43:48.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f7958ff9640 1 -- 172.21.15.97:0/1962539208 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950011660 con 0x7f795c097170 2024-09-13T18:43:48.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f796304f640 1 -- 172.21.15.97:0/1962539208 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7954009ae0 con 0x7f795c097170 2024-09-13T18:43:48.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.067+0000 7f796304f640 1 -- 172.21.15.97:0/1962539208 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c11c190 con 0x7f795c097170 2024-09-13T18:43:48.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.068+0000 7f7958ff9640 1 -- 172.21.15.97:0/1962539208 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f7950011a10 con 0x7f795c097170 2024-09-13T18:43:48.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.068+0000 7f796304f640 1 -- 172.21.15.97:0/1962539208 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f795c064000 con 0x7f795c097170 2024-09-13T18:43:48.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.068+0000 7f7958ff9640 1 -- 172.21.15.97:0/1962539208 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f7950044190 con 0x7f795c097170 2024-09-13T18:43:48.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.068+0000 7f7958ff9640 1 -- 172.21.15.97:0/1962539208 --> v1:172.21.15.97:6808/35061 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f794003dd50 con 0x7f794003a050 2024-09-13T18:43:48.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.068+0000 7f7958ff9640 1 -- 172.21.15.97:0/1962539208 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7950017db0 con 0x7f795c097170 2024-09-13T18:43:48.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.069+0000 7f7958ff9640 1 -- 172.21.15.97:0/1962539208 <== osd.1 v1:172.21.15.97:6808/35061 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f794003dd50 con 0x7f794003a050 2024-09-13T18:43:48.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.083+0000 7f796304f640 1 -- 172.21.15.97:0/1962539208 --> v1:172.21.15.97:6808/35061 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f795c09aa60 con 0x7f794003a050 2024-09-13T18:43:48.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.083+0000 7f7958ff9640 1 -- 172.21.15.97:0/1962539208 <== osd.1 v1:172.21.15.97:6808/35061 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f795c09aa60 con 0x7f794003a050 2024-09-13T18:43:48.086 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-13T18:43:48.086 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:43:48.086 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-13T18:43:48.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.084+0000 7f796304f640 1 -- 172.21.15.97:0/1962539208 >> v1:172.21.15.97:6808/35061 conn(0x7f794003a050 legacy=0x7f794003c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.084+0000 7f796304f640 1 -- 172.21.15.97:0/1962539208 >> v1:172.21.15.97:6816/34603 conn(0x7f7940031160 legacy=0x7f7940033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.084+0000 7f796304f640 1 -- 172.21.15.97:0/1962539208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c097170 msgr2=0x7f795c11ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.084+0000 7f796304f640 1 --2- 172.21.15.97:0/1962539208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f795c097170 0x7f795c11ad70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7950009ec0 tx=0x7f79500090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.084+0000 7f79615ec640 1 -- 172.21.15.97:0/1962539208 reap_dead start 2024-09-13T18:43:48.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.084+0000 7f796304f640 1 -- 172.21.15.97:0/1962539208 shutdown_connections 2024-09-13T18:43:48.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.084+0000 7f796304f640 1 -- 172.21.15.97:0/1962539208 >> 172.21.15.97:0/1962539208 conn(0x7f795c05e5d0 msgr2=0x7f795c09a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:48.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.084+0000 7f796304f640 1 -- 172.21.15.97:0/1962539208 shutdown_connections 2024-09-13T18:43:48.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.084+0000 7f796304f640 1 -- 172.21.15.97:0/1962539208 wait complete. 2024-09-13T18:43:48.096 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T18:43:48.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.187+0000 7f1dca4af640 1 Processor -- start 2024-09-13T18:43:48.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.187+0000 7f1dca4af640 1 -- start start 2024-09-13T18:43:48.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dca4af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc409dfb0 0x7f1dc4096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dca4af640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1dc40969d0 0x7f1dc40974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dca4af640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc406a190 con 0x7f1dc412bf70 2024-09-13T18:43:48.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dca4af640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc409e380 con 0x7f1dc40969d0 2024-09-13T18:43:48.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dca4af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc4098870 con 0x7f1dc409dfb0 2024-09-13T18:43:48.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dc3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc409dfb0 0x7f1dc4096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dc37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1dc40969d0 0x7f1dc40974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dc8a4c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1dc412bf70 0x7f1dc412c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56188/0 (socket says 172.21.15.97:56188) 2024-09-13T18:43:48.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dc3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc409dfb0 0x7f1dc4096f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:34730/0 (socket says 172.21.15.97:34730) 2024-09-13T18:43:48.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dc8a4c640 1 -- 172.21.15.97:0/2672711202 learned_addr learned my addr 172.21.15.97:0/2672711202 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:43:48.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dc37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1dc40969d0 0x7f1dc40974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:43374/0 (socket says 172.21.15.97:43374) 2024-09-13T18:43:48.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dc3fff640 1 -- 172.21.15.97:0/2672711202 >> v2:172.21.15.97:3300/0 conn(0x7f1dc40969d0 msgr2=0x7f1dc40974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:48.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dc3fff640 1 --2- 172.21.15.97:0/2672711202 >> v2:172.21.15.97:3300/0 conn(0x7f1dc40969d0 0x7f1dc40974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dc3fff640 1 -- 172.21.15.97:0/2672711202 >> v1:172.21.15.97:6789/0 conn(0x7f1dc412bf70 legacy=0x7f1dc412c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dc3fff640 1 -- 172.21.15.97:0/2672711202 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc4098e10 con 0x7f1dc409dfb0 2024-09-13T18:43:48.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.188+0000 7f1dc37fe640 1 --2- 172.21.15.97:0/2672711202 >> v2:172.21.15.97:3300/0 conn(0x7f1dc40969d0 0x7f1dc40974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:48.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.189+0000 7f1dc3fff640 1 --2- 172.21.15.97:0/2672711202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc409dfb0 0x7f1dc4096f80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1db40098b0 tx=0x7f1db40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a04472075a3f64c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.189+0000 7f1dc2ffd640 1 -- 172.21.15.97:0/2672711202 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db402ad20 con 0x7f1dc409dfb0 2024-09-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.189+0000 7f1dc2ffd640 1 -- 172.21.15.97:0/2672711202 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db402ae80 con 0x7f1dc409dfb0 2024-09-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.189+0000 7f1dc2ffd640 1 -- 172.21.15.97:0/2672711202 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4032670 con 0x7f1dc409dfb0 2024-09-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.190+0000 7f1dca4af640 1 -- 172.21.15.97:0/2672711202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc409dfb0 msgr2=0x7f1dc4096f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.190+0000 7f1dca4af640 1 --2- 172.21.15.97:0/2672711202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc409dfb0 0x7f1dc4096f80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1db40098b0 tx=0x7f1db40090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.190+0000 7f1dca4af640 1 -- 172.21.15.97:0/2672711202 shutdown_connections 2024-09-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.190+0000 7f1dca4af640 1 --2- 172.21.15.97:0/2672711202 >> v2:172.21.15.97:3300/0 conn(0x7f1dc40969d0 0x7f1dc40974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.190+0000 7f1dca4af640 1 --2- 172.21.15.97:0/2672711202 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc409dfb0 0x7f1dc4096f80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.190+0000 7f1dca4af640 1 -- 172.21.15.97:0/2672711202 >> 172.21.15.97:0/2672711202 conn(0x7f1dc409b200 msgr2=0x7f1dc409b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.190+0000 7f1dca4af640 1 -- 172.21.15.97:0/2672711202 shutdown_connections 2024-09-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.190+0000 7f1dca4af640 1 -- 172.21.15.97:0/2672711202 wait complete. 2024-09-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.190+0000 7f1dca4af640 1 Processor -- start 2024-09-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dca4af640 1 -- start start 2024-09-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dca4af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc40969d0 0x7f1dc412b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dca4af640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dc409dfb0 0x7f1dc4117460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dca4af640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dc412bf70 0x7f1dc41179a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dca4af640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc411dcf0 con 0x7f1dc409dfb0 2024-09-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dca4af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc411df40 con 0x7f1dc40969d0 2024-09-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dca4af640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc409d970 con 0x7f1dc412bf70 2024-09-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dc3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc40969d0 0x7f1dc412b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dc37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dc409dfb0 0x7f1dc4117460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dc3fff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc40969d0 0x7f1dc412b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:34740/0 (socket says 172.21.15.97:34740) 2024-09-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dc3fff640 1 -- 172.21.15.97:0/2777758821 learned_addr learned my addr 172.21.15.97:0/2777758821 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dc8a4c640 1 --2- 172.21.15.97:0/2777758821 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dc412bf70 0x7f1dc41179a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dc37fe640 1 -- 172.21.15.97:0/2777758821 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dc412bf70 msgr2=0x7f1dc41179a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dc37fe640 1 --2- 172.21.15.97:0/2777758821 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dc412bf70 0x7f1dc41179a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dc37fe640 1 -- 172.21.15.97:0/2777758821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc40969d0 msgr2=0x7f1dc412b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dc37fe640 1 --2- 172.21.15.97:0/2777758821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc40969d0 0x7f1dc412b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.191+0000 7f1dc37fe640 1 -- 172.21.15.97:0/2777758821 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db8009390 con 0x7f1dc409dfb0 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.192+0000 7f1dc3fff640 1 --2- 172.21.15.97:0/2777758821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc40969d0 0x7f1dc412b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.192+0000 7f1dc37fe640 1 --2- 172.21.15.97:0/2777758821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dc409dfb0 0x7f1dc4117460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1db800ea20 tx=0x7f1db80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.192+0000 7f1dabfff640 1 -- 172.21.15.97:0/2777758821 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db800ca10 con 0x7f1dc409dfb0 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.192+0000 7f1dabfff640 1 -- 172.21.15.97:0/2777758821 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db800cb70 con 0x7f1dc409dfb0 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.192+0000 7f1dca4af640 1 -- 172.21.15.97:0/2777758821 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db4009390 con 0x7f1dc409dfb0 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.192+0000 7f1dabfff640 1 -- 172.21.15.97:0/2777758821 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8013470 con 0x7f1dc409dfb0 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.192+0000 7f1dca4af640 1 -- 172.21.15.97:0/2777758821 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc409d0d0 con 0x7f1dc409dfb0 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.193+0000 7f1dabfff640 1 -- 172.21.15.97:0/2777758821 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f1db80137e0 con 0x7f1dc409dfb0 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.193+0000 7f1dabfff640 1 -- 172.21.15.97:0/2777758821 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f1db80424b0 con 0x7f1dc409dfb0 2024-09-13T18:43:48.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.193+0000 7f1dca4af640 1 -- 172.21.15.97:0/2777758821 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc4064000 con 0x7f1dc409dfb0 2024-09-13T18:43:48.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.197+0000 7f1dabfff640 1 -- 172.21.15.97:0/2777758821 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f1db8023ad0 con 0x7f1dc409dfb0 2024-09-13T18:43:48.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.349+0000 7f1dca4af640 1 -- 172.21.15.97:0/2777758821 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1dc4067670 con 0x7f1db0031160 2024-09-13T18:43:48.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.349+0000 7f1dabfff640 1 -- 172.21.15.97:0/2777758821 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (unknown 489605429 0 0) 0x7f1dc4067670 con 0x7f1db0031160 2024-09-13T18:43:48.352 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T18:43:48.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.351+0000 7f1dca4af640 1 -- 172.21.15.97:0/2777758821 >> v1:172.21.15.97:6816/34603 conn(0x7f1db0031160 legacy=0x7f1db0033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.351+0000 7f1dca4af640 1 -- 172.21.15.97:0/2777758821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dc409dfb0 msgr2=0x7f1dc4117460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.351+0000 7f1dca4af640 1 --2- 172.21.15.97:0/2777758821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dc409dfb0 0x7f1dc4117460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1db800ea20 tx=0x7f1db80090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.351+0000 7f1dca4af640 1 -- 172.21.15.97:0/2777758821 shutdown_connections 2024-09-13T18:43:48.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.351+0000 7f1dca4af640 1 --2- 172.21.15.97:0/2777758821 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f1dc412bf70 0x7f1dc41179a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.351+0000 7f1dca4af640 1 --2- 172.21.15.97:0/2777758821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1dc409dfb0 0x7f1dc4117460 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.351+0000 7f1dca4af640 1 --2- 172.21.15.97:0/2777758821 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f1dc40969d0 0x7f1dc412b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.351+0000 7f1dca4af640 1 -- 172.21.15.97:0/2777758821 >> 172.21.15.97:0/2777758821 conn(0x7f1dc409b200 msgr2=0x7f1dc4099070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:48.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.351+0000 7f1dca4af640 1 -- 172.21.15.97:0/2777758821 shutdown_connections 2024-09-13T18:43:48.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.351+0000 7f1dca4af640 1 -- 172.21.15.97:0/2777758821 wait complete. 2024-09-13T18:43:48.364 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T18:43:48.365 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:43:48.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.459+0000 7effa699d640 1 Processor -- start 2024-09-13T18:43:48.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.459+0000 7effa699d640 1 -- start start 2024-09-13T18:43:48.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7effa699d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa009cfb0 0x7effa009d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7effa699d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7effa009d8c0 0x7effa012d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7effa699d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa006a440 con 0x7effa009e3a0 2024-09-13T18:43:48.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7effa699d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa009cdb0 con 0x7effa009cfb0 2024-09-13T18:43:48.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7effa699d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effa006ea20 con 0x7effa009d8c0 2024-09-13T18:43:48.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa009cfb0 0x7effa009d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa009cfb0 0x7effa009d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:34752/0 (socket says 172.21.15.97:34752) 2024-09-13T18:43:48.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7eff9ffff640 1 -- 172.21.15.97:0/147450100 learned_addr learned my addr 172.21.15.97:0/147450100 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:48.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7eff9f7fe640 1 --1- 172.21.15.97:0/147450100 >> v1:172.21.15.97:6789/0 conn(0x7effa009e3a0 0x7effa012d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56204/0 (socket says 172.21.15.97:56204) 2024-09-13T18:43:48.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7effa4f3a640 1 --2- 172.21.15.97:0/147450100 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7effa009d8c0 0x7effa012d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7effa4f3a640 1 -- 172.21.15.97:0/147450100 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa009cfb0 msgr2=0x7effa009d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:48.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7effa4f3a640 1 --2- 172.21.15.97:0/147450100 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa009cfb0 0x7effa009d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7eff9effd640 1 -- 172.21.15.97:0/147450100 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127103135 0 0) 0x7effa006a440 con 0x7effa009e3a0 2024-09-13T18:43:48.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7effa4f3a640 1 -- 172.21.15.97:0/147450100 >> v1:172.21.15.97:6789/0 conn(0x7effa009e3a0 legacy=0x7effa012d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7effa4f3a640 1 -- 172.21.15.97:0/147450100 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa006b130 con 0x7effa009d8c0 2024-09-13T18:43:48.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.460+0000 7eff9ffff640 1 --2- 172.21.15.97:0/147450100 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa009cfb0 0x7effa009d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.461+0000 7effa4f3a640 1 --2- 172.21.15.97:0/147450100 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7effa009d8c0 0x7effa012d880 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7eff98009e90 tx=0x7eff98009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3412c444a7dc8203 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.461+0000 7eff9effd640 1 -- 172.21.15.97:0/147450100 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98007550 con 0x7effa009d8c0 2024-09-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.461+0000 7eff9effd640 1 -- 172.21.15.97:0/147450100 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9802d050 con 0x7effa009d8c0 2024-09-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.461+0000 7eff9effd640 1 -- 172.21.15.97:0/147450100 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff980078e0 con 0x7effa009d8c0 2024-09-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.461+0000 7effa699d640 1 -- 172.21.15.97:0/147450100 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7effa009d8c0 msgr2=0x7effa012d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.461+0000 7effa699d640 1 --2- 172.21.15.97:0/147450100 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7effa009d8c0 0x7effa012d880 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7eff98009e90 tx=0x7eff98009780 comp rx=0 tx=0).stop 2024-09-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.462+0000 7effa699d640 1 -- 172.21.15.97:0/147450100 shutdown_connections 2024-09-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.462+0000 7effa699d640 1 --2- 172.21.15.97:0/147450100 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7effa009d8c0 0x7effa012d880 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.462+0000 7effa699d640 1 --2- 172.21.15.97:0/147450100 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa009cfb0 0x7effa009d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.462+0000 7effa699d640 1 -- 172.21.15.97:0/147450100 >> 172.21.15.97:0/147450100 conn(0x7effa005e5d0 msgr2=0x7effa009e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.462+0000 7effa699d640 1 -- 172.21.15.97:0/147450100 shutdown_connections 2024-09-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.462+0000 7effa699d640 1 -- 172.21.15.97:0/147450100 wait complete. 2024-09-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.462+0000 7effa699d640 1 Processor -- start 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.462+0000 7effa699d640 1 -- start start 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7effa699d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7effa009cfb0 0x7effa011a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7effa699d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa009d8c0 0x7effa0116c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7effa699d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effa009e3a0 0x7effa0117190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7effa699d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa006b950 con 0x7effa009e3a0 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7effa699d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa01198c0 con 0x7effa009d8c0 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7effa699d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effa0117f50 con 0x7effa009cfb0 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7effa009cfb0 0x7effa011a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7eff9f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa009d8c0 0x7effa0116c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7effa4f3a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effa009e3a0 0x7effa0117190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7effa009cfb0 0x7effa011a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59782/0 (socket says 172.21.15.97:59782) 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7eff9f7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa009d8c0 0x7effa0116c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:34764/0 (socket says 172.21.15.97:34764) 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7eff9ffff640 1 -- 172.21.15.97:0/1208141128 learned_addr learned my addr 172.21.15.97:0/1208141128 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:48.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7eff9ffff640 1 -- 172.21.15.97:0/1208141128 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa009d8c0 msgr2=0x7effa0116c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7eff9ffff640 1 --2- 172.21.15.97:0/1208141128 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa009d8c0 0x7effa0116c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7eff9ffff640 1 -- 172.21.15.97:0/1208141128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effa009e3a0 msgr2=0x7effa0117190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7eff9ffff640 1 --2- 172.21.15.97:0/1208141128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effa009e3a0 0x7effa0117190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7eff9ffff640 1 -- 172.21.15.97:0/1208141128 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90009450 con 0x7effa009cfb0 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7eff9f7fe640 1 --2- 172.21.15.97:0/1208141128 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7effa009d8c0 0x7effa0116c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7eff9ffff640 1 --2- 172.21.15.97:0/1208141128 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7effa009cfb0 0x7effa011a360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff9000ec80 tx=0x7eff900091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.463+0000 7eff87fff640 1 -- 172.21.15.97:0/1208141128 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90009730 con 0x7effa009cfb0 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.464+0000 7eff87fff640 1 -- 172.21.15.97:0/1208141128 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9000eec0 con 0x7effa009cfb0 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.464+0000 7eff87fff640 1 -- 172.21.15.97:0/1208141128 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9000cdf0 con 0x7effa009cfb0 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.464+0000 7effa699d640 1 -- 172.21.15.97:0/1208141128 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff98009a20 con 0x7effa009cfb0 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.464+0000 7effa699d640 1 -- 172.21.15.97:0/1208141128 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa01169e0 con 0x7effa009cfb0 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.464+0000 7eff87fff640 1 -- 172.21.15.97:0/1208141128 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7eff90013680 con 0x7effa009cfb0 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.464+0000 7effa699d640 1 -- 172.21.15.97:0/1208141128 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7effa0064000 con 0x7effa009cfb0 2024-09-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.465+0000 7eff87fff640 1 -- 172.21.15.97:0/1208141128 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7eff90042490 con 0x7effa009cfb0 2024-09-13T18:43:48.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.465+0000 7eff87fff640 1 -- 172.21.15.97:0/1208141128 --> v1:172.21.15.97:6804/35063 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff8c03dbe0 con 0x7eff8c039ee0 2024-09-13T18:43:48.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.465+0000 7eff87fff640 1 -- 172.21.15.97:0/1208141128 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff90017070 con 0x7effa009cfb0 2024-09-13T18:43:48.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.465+0000 7eff87fff640 1 -- 172.21.15.97:0/1208141128 <== osd.2 v1:172.21.15.97:6804/35063 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7eff8c03dbe0 con 0x7eff8c039ee0 2024-09-13T18:43:48.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.477+0000 7effa699d640 1 -- 172.21.15.97:0/1208141128 --> v1:172.21.15.97:6804/35063 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7effa006e5f0 con 0x7eff8c039ee0 2024-09-13T18:43:48.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.477+0000 7eff87fff640 1 -- 172.21.15.97:0/1208141128 <== osd.2 v1:172.21.15.97:6804/35063 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7effa006e5f0 con 0x7eff8c039ee0 2024-09-13T18:43:48.480 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-13T18:43:48.480 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:43:48.480 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-13T18:43:48.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.478+0000 7effa699d640 1 -- 172.21.15.97:0/1208141128 >> v1:172.21.15.97:6804/35063 conn(0x7eff8c039ee0 legacy=0x7eff8c03c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.478+0000 7effa699d640 1 -- 172.21.15.97:0/1208141128 >> v1:172.21.15.97:6816/34603 conn(0x7eff8c031160 legacy=0x7eff8c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.478+0000 7effa699d640 1 -- 172.21.15.97:0/1208141128 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7effa009cfb0 msgr2=0x7effa011a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.478+0000 7effa699d640 1 --2- 172.21.15.97:0/1208141128 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7effa009cfb0 0x7effa011a360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff9000ec80 tx=0x7eff900091d0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.478+0000 7effa4f3a640 1 -- 172.21.15.97:0/1208141128 reap_dead start 2024-09-13T18:43:48.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.478+0000 7effa699d640 1 -- 172.21.15.97:0/1208141128 shutdown_connections 2024-09-13T18:43:48.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.478+0000 7effa699d640 1 -- 172.21.15.97:0/1208141128 >> 172.21.15.97:0/1208141128 conn(0x7effa005e5d0 msgr2=0x7effa0130230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:48.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.478+0000 7effa699d640 1 -- 172.21.15.97:0/1208141128 shutdown_connections 2024-09-13T18:43:48.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.478+0000 7effa699d640 1 -- 172.21.15.97:0/1208141128 wait complete. 2024-09-13T18:43:48.490 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T18:43:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.582+0000 7f9ec76af640 1 Processor -- start 2024-09-13T18:43:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.582+0000 7f9ec76af640 1 -- start start 2024-09-13T18:43:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec76af640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9ec0098ab0 0x7f9ec009cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec76af640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0130f10 0x7f9ec01332f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec76af640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec0097ff0 con 0x7f9ec0096e00 2024-09-13T18:43:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec76af640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec0098e80 con 0x7f9ec0098ab0 2024-09-13T18:43:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec76af640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec009e5a0 con 0x7f9ec0130f10 2024-09-13T18:43:48.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec5c4c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0130f10 0x7f9ec01332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec544b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9ec0098ab0 0x7f9ec009cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec5c4c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0130f10 0x7f9ec01332f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59796/0 (socket says 172.21.15.97:59796) 2024-09-13T18:43:48.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec5c4c640 1 -- 172.21.15.97:0/2115648473 learned_addr learned my addr 172.21.15.97:0/2115648473 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:48.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec4c4a640 1 --1- 172.21.15.97:0/2115648473 >> v1:172.21.15.97:6789/0 conn(0x7f9ec0096e00 0x7f9ec009d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56214/0 (socket says 172.21.15.97:56214) 2024-09-13T18:43:48.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec544b640 1 -- 172.21.15.97:0/2115648473 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0130f10 msgr2=0x7f9ec01332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:48.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec544b640 1 --2- 172.21.15.97:0/2115648473 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0130f10 0x7f9ec01332f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec544b640 1 -- 172.21.15.97:0/2115648473 >> v1:172.21.15.97:6789/0 conn(0x7f9ec0096e00 legacy=0x7f9ec009d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec544b640 1 -- 172.21.15.97:0/2115648473 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec006eb80 con 0x7f9ec0098ab0 2024-09-13T18:43:48.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9eb7fff640 1 -- 172.21.15.97:0/2115648473 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146896952 0 0) 0x7f9ec0097ff0 con 0x7f9ec0096e00 2024-09-13T18:43:48.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.583+0000 7f9ec5c4c640 1 --2- 172.21.15.97:0/2115648473 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0130f10 0x7f9ec01332f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:48.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.584+0000 7f9ec544b640 1 --2- 172.21.15.97:0/2115648473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ec0098ab0 0x7f9ec009cea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009880 tx=0x7f9ebc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1c8859e407d44e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:48.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.584+0000 7f9eb7fff640 1 -- 172.21.15.97:0/2115648473 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc02ace0 con 0x7f9ec0098ab0 2024-09-13T18:43:48.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.584+0000 7f9eb7fff640 1 -- 172.21.15.97:0/2115648473 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc02ae40 con 0x7f9ec0098ab0 2024-09-13T18:43:48.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.584+0000 7f9eb7fff640 1 -- 172.21.15.97:0/2115648473 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc032670 con 0x7f9ec0098ab0 2024-09-13T18:43:48.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.584+0000 7f9ec76af640 1 -- 172.21.15.97:0/2115648473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ec0098ab0 msgr2=0x7f9ec009cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.584+0000 7f9ec76af640 1 --2- 172.21.15.97:0/2115648473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ec0098ab0 0x7f9ec009cea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009880 tx=0x7f9ebc0090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.585+0000 7f9ec76af640 1 -- 172.21.15.97:0/2115648473 shutdown_connections 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.585+0000 7f9ec76af640 1 --2- 172.21.15.97:0/2115648473 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0130f10 0x7f9ec01332f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.585+0000 7f9ec76af640 1 --2- 172.21.15.97:0/2115648473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ec0098ab0 0x7f9ec009cea0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.585+0000 7f9ec76af640 1 -- 172.21.15.97:0/2115648473 >> 172.21.15.97:0/2115648473 conn(0x7f9ec009b200 msgr2=0x7f9ec009b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.585+0000 7f9ec76af640 1 -- 172.21.15.97:0/2115648473 shutdown_connections 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.585+0000 7f9ec76af640 1 -- 172.21.15.97:0/2115648473 wait complete. 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.585+0000 7f9ec76af640 1 Processor -- start 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.585+0000 7f9ec76af640 1 -- start start 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec76af640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0096e00 0x7f9ec012e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec76af640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ec0098ab0 0x7f9ec0118760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec76af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ec0130f10 0x7f9ec0118ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec76af640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec011a750 con 0x7f9ec0098ab0 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec76af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec011a240 con 0x7f9ec0130f10 2024-09-13T18:43:48.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec76af640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec011bbb0 con 0x7f9ec0096e00 2024-09-13T18:43:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec544b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0096e00 0x7f9ec012e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec4c4a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ec0098ab0 0x7f9ec0118760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec5c4c640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ec0130f10 0x7f9ec0118ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec544b640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0096e00 0x7f9ec012e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59800/0 (socket says 172.21.15.97:59800) 2024-09-13T18:43:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec4c4a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ec0098ab0 0x7f9ec0118760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:43412/0 (socket says 172.21.15.97:43412) 2024-09-13T18:43:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec544b640 1 -- 172.21.15.97:0/1773347091 learned_addr learned my addr 172.21.15.97:0/1773347091 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec5c4c640 1 -- 172.21.15.97:0/1773347091 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0096e00 msgr2=0x7f9ec012e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec5c4c640 1 --2- 172.21.15.97:0/1773347091 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0096e00 0x7f9ec012e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec5c4c640 1 -- 172.21.15.97:0/1773347091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ec0098ab0 msgr2=0x7f9ec0118760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec5c4c640 1 --2- 172.21.15.97:0/1773347091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ec0098ab0 0x7f9ec0118760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec5c4c640 1 -- 172.21.15.97:0/1773347091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb800bcf0 con 0x7f9ec0130f10 2024-09-13T18:43:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec544b640 1 --2- 172.21.15.97:0/1773347091 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0096e00 0x7f9ec012e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:48.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.586+0000 7f9ec5c4c640 1 --2- 172.21.15.97:0/1773347091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ec0130f10 0x7f9ec0118ca0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80102c0 tx=0x7f9eb800d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:48.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.587+0000 7f9eb57fa640 1 -- 172.21.15.97:0/1773347091 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb801a070 con 0x7f9ec0130f10 2024-09-13T18:43:48.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.587+0000 7f9eb57fa640 1 -- 172.21.15.97:0/1773347091 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb8011040 con 0x7f9ec0130f10 2024-09-13T18:43:48.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.587+0000 7f9ec76af640 1 -- 172.21.15.97:0/1773347091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc009390 con 0x7f9ec0130f10 2024-09-13T18:43:48.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.587+0000 7f9eb57fa640 1 -- 172.21.15.97:0/1773347091 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8009610 con 0x7f9ec0130f10 2024-09-13T18:43:48.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.587+0000 7f9ec76af640 1 -- 172.21.15.97:0/1773347091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec012ec10 con 0x7f9ec0130f10 2024-09-13T18:43:48.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.587+0000 7f9eb57fa640 1 -- 172.21.15.97:0/1773347091 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f9eb8003020 con 0x7f9ec0130f10 2024-09-13T18:43:48.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.588+0000 7f9eb57fa640 1 -- 172.21.15.97:0/1773347091 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f9eb8044430 con 0x7f9ec0130f10 2024-09-13T18:43:48.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.588+0000 7f9ec76af640 1 -- 172.21.15.97:0/1773347091 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec011bf80 con 0x7f9ec0130f10 2024-09-13T18:43:48.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.592+0000 7f9eb57fa640 1 -- 172.21.15.97:0/1773347091 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f9eb8009980 con 0x7f9ec0130f10 2024-09-13T18:43:48.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.742+0000 7f9ec76af640 1 -- 172.21.15.97:0/1773347091 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ec0064000 con 0x7f9ea4031160 2024-09-13T18:43:48.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.742+0000 7f9eb57fa640 1 -- 172.21.15.97:0/1773347091 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (unknown 3049115190 0 0) 0x7f9ec0064000 con 0x7f9ea4031160 2024-09-13T18:43:48.745 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T18:43:48.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.744+0000 7f9ec76af640 1 -- 172.21.15.97:0/1773347091 >> v1:172.21.15.97:6816/34603 conn(0x7f9ea4031160 legacy=0x7f9ea4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.744+0000 7f9ec76af640 1 -- 172.21.15.97:0/1773347091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ec0130f10 msgr2=0x7f9ec0118ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.744+0000 7f9ec76af640 1 --2- 172.21.15.97:0/1773347091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ec0130f10 0x7f9ec0118ca0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80102c0 tx=0x7f9eb800d040 comp rx=0 tx=0).stop 2024-09-13T18:43:48.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.744+0000 7f9ec76af640 1 -- 172.21.15.97:0/1773347091 shutdown_connections 2024-09-13T18:43:48.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.744+0000 7f9ec76af640 1 --2- 172.21.15.97:0/1773347091 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f9ec0130f10 0x7f9ec0118ca0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.744+0000 7f9ec76af640 1 --2- 172.21.15.97:0/1773347091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ec0098ab0 0x7f9ec0118760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.744+0000 7f9ec76af640 1 --2- 172.21.15.97:0/1773347091 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f9ec0096e00 0x7f9ec012e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.744+0000 7f9ec76af640 1 -- 172.21.15.97:0/1773347091 >> 172.21.15.97:0/1773347091 conn(0x7f9ec009b200 msgr2=0x7f9ec0099140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:48.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.744+0000 7f9ec76af640 1 -- 172.21.15.97:0/1773347091 shutdown_connections 2024-09-13T18:43:48.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.744+0000 7f9ec76af640 1 -- 172.21.15.97:0/1773347091 wait complete. 2024-09-13T18:43:48.757 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T18:43:48.757 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:43:48.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.852+0000 7f5397d1d640 1 Processor -- start 2024-09-13T18:43:48.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.852+0000 7f5397d1d640 1 -- start start 2024-09-13T18:43:48.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f5397d1d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5390096f90 0x7f53900690f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f5397d1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53901346b0 0x7f5390136a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f5397d1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5390069d40 con 0x7f539009df50 2024-09-13T18:43:48.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f5397d1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5390097360 con 0x7f53901346b0 2024-09-13T18:43:48.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f5397d1d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f539009cde0 con 0x7f5390096f90 2024-09-13T18:43:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f53962ba640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53901346b0 0x7f5390136a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f53952b8640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f539009df50 0x7f5390069630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56230/0 (socket says 172.21.15.97:56230) 2024-09-13T18:43:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f53952b8640 1 -- 172.21.15.97:0/2422872064 learned_addr learned my addr 172.21.15.97:0/2422872064 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:43:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f5395ab9640 1 --2- 172.21.15.97:0/2422872064 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5390096f90 0x7f53900690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f5395ab9640 1 -- 172.21.15.97:0/2422872064 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53901346b0 msgr2=0x7f5390136a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f5394ab7640 1 -- 172.21.15.97:0/2422872064 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694402328 0 0) 0x7f5380001110 con 0x7f539009df50 2024-09-13T18:43:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f5395ab9640 1 --2- 172.21.15.97:0/2422872064 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53901346b0 0x7f5390136a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f5395ab9640 1 -- 172.21.15.97:0/2422872064 >> v1:172.21.15.97:6789/0 conn(0x7f539009df50 legacy=0x7f5390069630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f5395ab9640 1 -- 172.21.15.97:0/2422872064 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539009e3d0 con 0x7f5390096f90 2024-09-13T18:43:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.853+0000 7f53962ba640 1 --2- 172.21.15.97:0/2422872064 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53901346b0 0x7f5390136a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.854+0000 7f5395ab9640 1 --2- 172.21.15.97:0/2422872064 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5390096f90 0x7f53900690f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f538c009880 tx=0x7f538c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24400bc7408ae501 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.854+0000 7f5394ab7640 1 -- 172.21.15.97:0/2422872064 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c02ace0 con 0x7f5390096f90 2024-09-13T18:43:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.854+0000 7f5394ab7640 1 -- 172.21.15.97:0/2422872064 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c02ae40 con 0x7f5390096f90 2024-09-13T18:43:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.854+0000 7f5394ab7640 1 -- 172.21.15.97:0/2422872064 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c032670 con 0x7f5390096f90 2024-09-13T18:43:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.855+0000 7f5397d1d640 1 -- 172.21.15.97:0/2422872064 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5390096f90 msgr2=0x7f53900690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.855+0000 7f5397d1d640 1 --2- 172.21.15.97:0/2422872064 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5390096f90 0x7f53900690f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f538c009880 tx=0x7f538c0090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.855+0000 7f5397d1d640 1 -- 172.21.15.97:0/2422872064 shutdown_connections 2024-09-13T18:43:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.855+0000 7f5397d1d640 1 --2- 172.21.15.97:0/2422872064 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f53901346b0 0x7f5390136a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.855+0000 7f5397d1d640 1 --2- 172.21.15.97:0/2422872064 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f5390096f90 0x7f53900690f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.855+0000 7f5397d1d640 1 -- 172.21.15.97:0/2422872064 >> 172.21.15.97:0/2422872064 conn(0x7f539006f240 msgr2=0x7f53900a2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.855+0000 7f5397d1d640 1 -- 172.21.15.97:0/2422872064 shutdown_connections 2024-09-13T18:43:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.855+0000 7f5397d1d640 1 -- 172.21.15.97:0/2422872064 wait complete. 2024-09-13T18:43:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f5397d1d640 1 Processor -- start 2024-09-13T18:43:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f5397d1d640 1 -- start start 2024-09-13T18:43:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f5397d1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5390096f90 0x7f539011bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f5397d1d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f539009df50 0x7f5390119190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f5397d1d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f53901346b0 0x7f53901196d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f5397d1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539011b450 con 0x7f5390096f90 2024-09-13T18:43:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f5397d1d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5390136890 con 0x7f539009df50 2024-09-13T18:43:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f5397d1d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f539009c230 con 0x7f53901346b0 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f5395ab9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5390096f90 0x7f539011bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f53952b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f539009df50 0x7f5390119190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f5395ab9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5390096f90 0x7f539011bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:43418/0 (socket says 172.21.15.97:43418) 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f5395ab9640 1 -- 172.21.15.97:0/524859229 learned_addr learned my addr 172.21.15.97:0/524859229 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f53952b8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f539009df50 0x7f5390119190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:34804/0 (socket says 172.21.15.97:34804) 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f53962ba640 1 --2- 172.21.15.97:0/524859229 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f53901346b0 0x7f53901196d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f53962ba640 1 -- 172.21.15.97:0/524859229 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f539009df50 msgr2=0x7f5390119190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f53962ba640 1 --2- 172.21.15.97:0/524859229 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f539009df50 0x7f5390119190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f53962ba640 1 -- 172.21.15.97:0/524859229 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5390096f90 msgr2=0x7f539011bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f53962ba640 1 --2- 172.21.15.97:0/524859229 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5390096f90 0x7f539011bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f53962ba640 1 -- 172.21.15.97:0/524859229 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5388009a20 con 0x7f53901346b0 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f5395ab9640 1 --2- 172.21.15.97:0/524859229 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5390096f90 0x7f539011bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.856+0000 7f53952b8640 1 --2- 172.21.15.97:0/524859229 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f539009df50 0x7f5390119190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.857+0000 7f53962ba640 1 --2- 172.21.15.97:0/524859229 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f53901346b0 0x7f53901196d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5388009ee0 tx=0x7f538800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:48.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.857+0000 7f5385ffb640 1 -- 172.21.15.97:0/524859229 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800ce10 con 0x7f53901346b0 2024-09-13T18:43:48.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.857+0000 7f5385ffb640 1 -- 172.21.15.97:0/524859229 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538800f040 con 0x7f53901346b0 2024-09-13T18:43:48.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.857+0000 7f5397d1d640 1 -- 172.21.15.97:0/524859229 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538c009390 con 0x7f53901346b0 2024-09-13T18:43:48.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.857+0000 7f5385ffb640 1 -- 172.21.15.97:0/524859229 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53880146d0 con 0x7f53901346b0 2024-09-13T18:43:48.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.857+0000 7f5397d1d640 1 -- 172.21.15.97:0/524859229 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539009bcf0 con 0x7f53901346b0 2024-09-13T18:43:48.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.857+0000 7f5385ffb640 1 -- 172.21.15.97:0/524859229 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f5388003020 con 0x7f53901346b0 2024-09-13T18:43:48.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.858+0000 7f5385ffb640 1 -- 172.21.15.97:0/524859229 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f5388042a70 con 0x7f53901346b0 2024-09-13T18:43:48.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.858+0000 7f5397d1d640 1 -- 172.21.15.97:0/524859229 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f539011b5c0 con 0x7f53901346b0 2024-09-13T18:43:48.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.858+0000 7f5385ffb640 1 -- 172.21.15.97:0/524859229 --> v1:172.21.15.97:6800/35060 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f537403dd50 con 0x7f537403a050 2024-09-13T18:43:48.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.858+0000 7f5385ffb640 1 -- 172.21.15.97:0/524859229 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53880133e0 con 0x7f53901346b0 2024-09-13T18:43:48.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.859+0000 7f5385ffb640 1 -- 172.21.15.97:0/524859229 <== osd.3 v1:172.21.15.97:6800/35060 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f537403dd50 con 0x7f537403a050 2024-09-13T18:43:48.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.870+0000 7f5397d1d640 1 -- 172.21.15.97:0/524859229 --> v1:172.21.15.97:6800/35060 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f539011afa0 con 0x7f537403a050 2024-09-13T18:43:48.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.870+0000 7f5385ffb640 1 -- 172.21.15.97:0/524859229 <== osd.3 v1:172.21.15.97:6800/35060 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f539011afa0 con 0x7f537403a050 2024-09-13T18:43:48.873 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-13T18:43:48.873 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:43:48.873 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-13T18:43:48.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.871+0000 7f5397d1d640 1 -- 172.21.15.97:0/524859229 >> v1:172.21.15.97:6800/35060 conn(0x7f537403a050 legacy=0x7f537403c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.871+0000 7f5397d1d640 1 -- 172.21.15.97:0/524859229 >> v1:172.21.15.97:6816/34603 conn(0x7f5374031160 legacy=0x7f5374033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.871+0000 7f5397d1d640 1 -- 172.21.15.97:0/524859229 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f53901346b0 msgr2=0x7f53901196d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.871+0000 7f5397d1d640 1 --2- 172.21.15.97:0/524859229 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f53901346b0 0x7f53901196d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5388009ee0 tx=0x7f538800b040 comp rx=0 tx=0).stop 2024-09-13T18:43:48.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.871+0000 7f53962ba640 1 -- 172.21.15.97:0/524859229 reap_dead start 2024-09-13T18:43:48.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.871+0000 7f5397d1d640 1 -- 172.21.15.97:0/524859229 shutdown_connections 2024-09-13T18:43:48.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.871+0000 7f5397d1d640 1 -- 172.21.15.97:0/524859229 >> 172.21.15.97:0/524859229 conn(0x7f539006f240 msgr2=0x7f5390133a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:48.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.871+0000 7f5397d1d640 1 -- 172.21.15.97:0/524859229 shutdown_connections 2024-09-13T18:43:48.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.871+0000 7f5397d1d640 1 -- 172.21.15.97:0/524859229 wait complete. 2024-09-13T18:43:48.883 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T18:43:48.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.973+0000 7f66008d4640 1 Processor -- start 2024-09-13T18:43:48.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.973+0000 7f66008d4640 1 -- start start 2024-09-13T18:43:48.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f66008d4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65fc1300a0 0x7f65fc134750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f66008d4640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65fc134c90 0x7f65fc137070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f66008d4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65fc096b70 con 0x7f65fc0a32b0 2024-09-13T18:43:48.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f66008d4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65fc0a3680 con 0x7f65fc1300a0 2024-09-13T18:43:48.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f66008d4640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc097460 con 0x7f65fc134c90 2024-09-13T18:43:48.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f65fad9d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65fc134c90 0x7f65fc137070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f65f9d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65fc1300a0 0x7f65fc134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f65fa59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f65fc0a32b0 0x7f65fc12f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56244/0 (socket says 172.21.15.97:56244) 2024-09-13T18:43:48.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f65fa59c640 1 -- 172.21.15.97:0/2027653825 learned_addr learned my addr 172.21.15.97:0/2027653825 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:43:48.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f65f9d9b640 1 -- 172.21.15.97:0/2027653825 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65fc134c90 msgr2=0x7f65fc137070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:48.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f65f9d9b640 1 --2- 172.21.15.97:0/2027653825 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65fc134c90 0x7f65fc137070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f65f9d9b640 1 -- 172.21.15.97:0/2027653825 >> v1:172.21.15.97:6789/0 conn(0x7f65fc0a32b0 legacy=0x7f65fc12f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f65f9d9b640 1 -- 172.21.15.97:0/2027653825 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc12d770 con 0x7f65fc1300a0 2024-09-13T18:43:48.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f65f959a640 1 -- 172.21.15.97:0/2027653825 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279224992 0 0) 0x7f65fc096b70 con 0x7f65fc0a32b0 2024-09-13T18:43:48.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.974+0000 7f65fad9d640 1 --2- 172.21.15.97:0/2027653825 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65fc134c90 0x7f65fc137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:48.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.975+0000 7f65f9d9b640 1 --2- 172.21.15.97:0/2027653825 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65fc1300a0 0x7f65fc134750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009850 tx=0x7f65ec0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cf140951202169 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:48.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.975+0000 7f65f959a640 1 -- 172.21.15.97:0/2027653825 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec02ad00 con 0x7f65fc1300a0 2024-09-13T18:43:48.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.975+0000 7f65f959a640 1 -- 172.21.15.97:0/2027653825 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec02ae60 con 0x7f65fc1300a0 2024-09-13T18:43:48.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.975+0000 7f65f959a640 1 -- 172.21.15.97:0/2027653825 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec032670 con 0x7f65fc1300a0 2024-09-13T18:43:48.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.976+0000 7f66008d4640 1 -- 172.21.15.97:0/2027653825 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65fc1300a0 msgr2=0x7f65fc134750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.976+0000 7f66008d4640 1 --2- 172.21.15.97:0/2027653825 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65fc1300a0 0x7f65fc134750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009850 tx=0x7f65ec0090f0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.976+0000 7f66008d4640 1 -- 172.21.15.97:0/2027653825 shutdown_connections 2024-09-13T18:43:48.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.976+0000 7f66008d4640 1 --2- 172.21.15.97:0/2027653825 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65fc1300a0 0x7f65fc134750 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.976+0000 7f66008d4640 1 --2- 172.21.15.97:0/2027653825 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65fc134c90 0x7f65fc137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.976+0000 7f66008d4640 1 -- 172.21.15.97:0/2027653825 >> 172.21.15.97:0/2027653825 conn(0x7f65fc06eef0 msgr2=0x7f65fc0a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:48.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.976+0000 7f66008d4640 1 -- 172.21.15.97:0/2027653825 shutdown_connections 2024-09-13T18:43:48.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.976+0000 7f66008d4640 1 -- 172.21.15.97:0/2027653825 wait complete. 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f66008d4640 1 Processor -- start 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f66008d4640 1 -- start start 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f66008d4640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65fc0a32b0 0x7f65fc09a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f66008d4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65fc1300a0 0x7f65fc09aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f66008d4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65fc134c90 0x7f65fc09b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f66008d4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc11b330 con 0x7f65fc134c90 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f66008d4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc11a680 con 0x7f65fc1300a0 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f66008d4640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc09b9e0 con 0x7f65fc0a32b0 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f65fa59c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65fc0a32b0 0x7f65fc09a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f65fa59c640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65fc0a32b0 0x7f65fc09a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59840/0 (socket says 172.21.15.97:59840) 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f65fad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65fc134c90 0x7f65fc09b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f65fa59c640 1 -- 172.21.15.97:0/2588758438 learned_addr learned my addr 172.21.15.97:0/2588758438 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f65f9d9b640 1 --2- 172.21.15.97:0/2588758438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65fc1300a0 0x7f65fc09aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:48.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f65fad9d640 1 -- 172.21.15.97:0/2588758438 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65fc0a32b0 msgr2=0x7f65fc09a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f65fad9d640 1 --2- 172.21.15.97:0/2588758438 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65fc0a32b0 0x7f65fc09a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f65fad9d640 1 -- 172.21.15.97:0/2588758438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65fc1300a0 msgr2=0x7f65fc09aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:48.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f65fad9d640 1 --2- 172.21.15.97:0/2588758438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65fc1300a0 0x7f65fc09aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:48.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f65fad9d640 1 -- 172.21.15.97:0/2588758438 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f4009a20 con 0x7f65fc134c90 2024-09-13T18:43:48.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.977+0000 7f65fa59c640 1 --2- 172.21.15.97:0/2588758438 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65fc0a32b0 0x7f65fc09a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:48.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.978+0000 7f65fad9d640 1 --2- 172.21.15.97:0/2588758438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65fc134c90 0x7f65fc09b010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009f10 tx=0x7f65f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:48.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.978+0000 7f65f27fc640 1 -- 172.21.15.97:0/2588758438 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f400cdb0 con 0x7f65fc134c90 2024-09-13T18:43:48.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.978+0000 7f65f27fc640 1 -- 172.21.15.97:0/2588758438 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f400f040 con 0x7f65fc134c90 2024-09-13T18:43:48.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.978+0000 7f66008d4640 1 -- 172.21.15.97:0/2588758438 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ec009390 con 0x7f65fc134c90 2024-09-13T18:43:48.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.978+0000 7f65f27fc640 1 -- 172.21.15.97:0/2588758438 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f40146d0 con 0x7f65fc134c90 2024-09-13T18:43:48.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.978+0000 7f66008d4640 1 -- 172.21.15.97:0/2588758438 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65fc1191d0 con 0x7f65fc134c90 2024-09-13T18:43:48.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.978+0000 7f65f27fc640 1 -- 172.21.15.97:0/2588758438 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f65f4003020 con 0x7f65fc134c90 2024-09-13T18:43:48.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.979+0000 7f65f27fc640 1 -- 172.21.15.97:0/2588758438 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f65f4042ad0 con 0x7f65fc134c90 2024-09-13T18:43:48.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.979+0000 7f66008d4640 1 -- 172.21.15.97:0/2588758438 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65fc11a7c0 con 0x7f65fc134c90 2024-09-13T18:43:48.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:48.983+0000 7f65f27fc640 1 -- 172.21.15.97:0/2588758438 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f65fc11a7c0 con 0x7f65fc134c90 2024-09-13T18:43:49.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.134+0000 7f66008d4640 1 -- 172.21.15.97:0/2588758438 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f65fc11a7c0 con 0x7f65dc031160 2024-09-13T18:43:49.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.134+0000 7f65f27fc640 1 -- 172.21.15.97:0/2588758438 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (unknown 3526570807 0 0) 0x7f65fc11a7c0 con 0x7f65dc031160 2024-09-13T18:43:49.137 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T18:43:49.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.137+0000 7f66008d4640 1 -- 172.21.15.97:0/2588758438 >> v1:172.21.15.97:6816/34603 conn(0x7f65dc031160 legacy=0x7f65dc033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:49.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.137+0000 7f66008d4640 1 -- 172.21.15.97:0/2588758438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65fc134c90 msgr2=0x7f65fc09b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:49.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.137+0000 7f66008d4640 1 --2- 172.21.15.97:0/2588758438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65fc134c90 0x7f65fc09b010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009f10 tx=0x7f65f400b040 comp rx=0 tx=0).stop 2024-09-13T18:43:49.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.137+0000 7f66008d4640 1 -- 172.21.15.97:0/2588758438 shutdown_connections 2024-09-13T18:43:49.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.137+0000 7f66008d4640 1 --2- 172.21.15.97:0/2588758438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65fc134c90 0x7f65fc09b010 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:49.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.137+0000 7f66008d4640 1 --2- 172.21.15.97:0/2588758438 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f65fc1300a0 0x7f65fc09aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:49.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.137+0000 7f66008d4640 1 --2- 172.21.15.97:0/2588758438 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f65fc0a32b0 0x7f65fc09a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:49.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.137+0000 7f66008d4640 1 -- 172.21.15.97:0/2588758438 >> 172.21.15.97:0/2588758438 conn(0x7f65fc06eef0 msgr2=0x7f65fc0a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:49.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.137+0000 7f66008d4640 1 -- 172.21.15.97:0/2588758438 shutdown_connections 2024-09-13T18:43:49.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.137+0000 7f66008d4640 1 -- 172.21.15.97:0/2588758438 wait complete. 2024-09-13T18:43:49.149 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:43:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.239+0000 7fc00339d640 1 Processor -- start 2024-09-13T18:43:49.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.239+0000 7fc00339d640 1 -- start start 2024-09-13T18:43:49.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc00339d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbffc09dfb0 0x7fbffc096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:49.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc00339d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbffc0969d0 0x7fbffc0974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc00339d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbffc12bf70 0x7fbffc12c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc00339d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc09e380 con 0x7fbffc09dfb0 2024-09-13T18:43:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc00339d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc06a190 con 0x7fbffc0969d0 2024-09-13T18:43:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc00339d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc098870 con 0x7fbffc12bf70 2024-09-13T18:43:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc001139640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbffc09dfb0 0x7fbffc096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc000938640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbffc0969d0 0x7fbffc0974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc00193a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbffc12bf70 0x7fbffc12c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc001139640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbffc09dfb0 0x7fbffc096f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:43460/0 (socket says 172.21.15.97:43460) 2024-09-13T18:43:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc001139640 1 -- 172.21.15.97:0/3003368278 learned_addr learned my addr 172.21.15.97:0/3003368278 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc000938640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbffc0969d0 0x7fbffc0974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:34820/0 (socket says 172.21.15.97:34820) 2024-09-13T18:43:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc00193a640 1 -- 172.21.15.97:0/3003368278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbffc0969d0 msgr2=0x7fbffc0974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc00193a640 1 --2- 172.21.15.97:0/3003368278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbffc0969d0 0x7fbffc0974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc00193a640 1 -- 172.21.15.97:0/3003368278 >> v2:172.21.15.97:3300/0 conn(0x7fbffc09dfb0 msgr2=0x7fbffc096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc00193a640 1 --2- 172.21.15.97:0/3003368278 >> v2:172.21.15.97:3300/0 conn(0x7fbffc09dfb0 0x7fbffc096f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc00193a640 1 -- 172.21.15.97:0/3003368278 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc098e10 con 0x7fbffc12bf70 2024-09-13T18:43:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc001139640 1 --2- 172.21.15.97:0/3003368278 >> v2:172.21.15.97:3300/0 conn(0x7fbffc09dfb0 0x7fbffc096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.240+0000 7fc000938640 1 --2- 172.21.15.97:0/3003368278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbffc0969d0 0x7fbffc0974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.241+0000 7fc00193a640 1 --2- 172.21.15.97:0/3003368278 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbffc12bf70 0x7fbffc12c3f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbff4009e90 tx=0x7fbff4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc879e2085564c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.241+0000 7fbff3fff640 1 -- 172.21.15.97:0/3003368278 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4007550 con 0x7fbffc12bf70 2024-09-13T18:43:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.241+0000 7fbff3fff640 1 -- 172.21.15.97:0/3003368278 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff402f050 con 0x7fbffc12bf70 2024-09-13T18:43:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.241+0000 7fbff3fff640 1 -- 172.21.15.97:0/3003368278 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4007920 con 0x7fbffc12bf70 2024-09-13T18:43:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.242+0000 7fc00339d640 1 -- 172.21.15.97:0/3003368278 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbffc12bf70 msgr2=0x7fbffc12c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.242+0000 7fc00339d640 1 --2- 172.21.15.97:0/3003368278 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbffc12bf70 0x7fbffc12c3f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbff4009e90 tx=0x7fbff4009780 comp rx=0 tx=0).stop 2024-09-13T18:43:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.242+0000 7fc00339d640 1 -- 172.21.15.97:0/3003368278 shutdown_connections 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.242+0000 7fc00339d640 1 --2- 172.21.15.97:0/3003368278 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbffc12bf70 0x7fbffc12c3f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.242+0000 7fc00339d640 1 --2- 172.21.15.97:0/3003368278 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbffc0969d0 0x7fbffc0974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.242+0000 7fc00339d640 1 --2- 172.21.15.97:0/3003368278 >> v2:172.21.15.97:3300/0 conn(0x7fbffc09dfb0 0x7fbffc096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.242+0000 7fc00339d640 1 -- 172.21.15.97:0/3003368278 >> 172.21.15.97:0/3003368278 conn(0x7fbffc09b200 msgr2=0x7fbffc09b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.242+0000 7fc00339d640 1 -- 172.21.15.97:0/3003368278 shutdown_connections 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.242+0000 7fc00339d640 1 -- 172.21.15.97:0/3003368278 wait complete. 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.242+0000 7fc00339d640 1 Processor -- start 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.242+0000 7fc00339d640 1 -- start start 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc00339d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbffc0969d0 0x7fbffc13a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc00339d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbffc09dfb0 0x7fbffc13a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc00339d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbffc12bf70 0x7fbffc119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc00339d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc11c970 con 0x7fbffc0969d0 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc00339d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc11b280 con 0x7fbffc09dfb0 2024-09-13T18:43:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc00339d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc099170 con 0x7fbffc12bf70 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc001139640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbffc0969d0 0x7fbffc13a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc00193a640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbffc12bf70 0x7fbffc119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc001139640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbffc0969d0 0x7fbffc13a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:43468/0 (socket says 172.21.15.97:43468) 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc001139640 1 -- 172.21.15.97:0/218433786 learned_addr learned my addr 172.21.15.97:0/218433786 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc00193a640 1 --2- 172.21.15.97:0/218433786 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbffc12bf70 0x7fbffc119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:59860/0 (socket says 172.21.15.97:59860) 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc000938640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbffc09dfb0 0x7fbffc13a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc00193a640 1 -- 172.21.15.97:0/218433786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbffc09dfb0 msgr2=0x7fbffc13a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc00193a640 1 --2- 172.21.15.97:0/218433786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbffc09dfb0 0x7fbffc13a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc00193a640 1 -- 172.21.15.97:0/218433786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbffc0969d0 msgr2=0x7fbffc13a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc00193a640 1 --2- 172.21.15.97:0/218433786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbffc0969d0 0x7fbffc13a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc00193a640 1 -- 172.21.15.97:0/218433786 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec009390 con 0x7fbffc12bf70 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc001139640 1 --2- 172.21.15.97:0/218433786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbffc0969d0 0x7fbffc13a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.243+0000 7fc000938640 1 --2- 172.21.15.97:0/218433786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbffc09dfb0 0x7fbffc13a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.244+0000 7fc00193a640 1 --2- 172.21.15.97:0/218433786 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbffc12bf70 0x7fbffc119210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbff4033000 tx=0x7fbff4039000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:49.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.244+0000 7fbff17fa640 1 -- 172.21.15.97:0/218433786 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4033830 con 0x7fbffc12bf70 2024-09-13T18:43:49.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.244+0000 7fbff17fa640 1 -- 172.21.15.97:0/218433786 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4042070 con 0x7fbffc12bf70 2024-09-13T18:43:49.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.244+0000 7fc00339d640 1 -- 172.21.15.97:0/218433786 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff8009450 con 0x7fbffc12bf70 2024-09-13T18:43:49.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.244+0000 7fbff17fa640 1 -- 172.21.15.97:0/218433786 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4033c20 con 0x7fbffc12bf70 2024-09-13T18:43:49.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.244+0000 7fc00339d640 1 -- 172.21.15.97:0/218433786 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff4009a20 con 0x7fbffc12bf70 2024-09-13T18:43:49.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.244+0000 7fbff17fa640 1 -- 172.21.15.97:0/218433786 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fbff4044030 con 0x7fbffc12bf70 2024-09-13T18:43:49.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.245+0000 7fbff17fa640 1 -- 172.21.15.97:0/218433786 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fbff4065820 con 0x7fbffc12bf70 2024-09-13T18:43:49.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.245+0000 7fc00339d640 1 -- 172.21.15.97:0/218433786 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbffc064000 con 0x7fbffc12bf70 2024-09-13T18:43:49.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.249+0000 7fbff17fa640 1 -- 172.21.15.97:0/218433786 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fbff403d420 con 0x7fbffc12bf70 2024-09-13T18:43:49.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.399+0000 7fc00339d640 1 -- 172.21.15.97:0/218433786 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbffc11cae0 con 0x7fbfe0031160 2024-09-13T18:43:49.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.405+0000 7fbff17fa640 1 -- 172.21.15.97:0/218433786 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277502 (unknown 2965378022 0 2398241418) 0x7fbffc11cae0 con 0x7fbfe0031160 2024-09-13T18:43:49.410 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:43:49.412 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:43:49.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.408+0000 7fc00339d640 1 -- 172.21.15.97:0/218433786 >> v1:172.21.15.97:6816/34603 conn(0x7fbfe0031160 legacy=0x7fbfe0033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:49.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.408+0000 7fc00339d640 1 -- 172.21.15.97:0/218433786 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbffc12bf70 msgr2=0x7fbffc119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:49.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.408+0000 7fc00339d640 1 --2- 172.21.15.97:0/218433786 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbffc12bf70 0x7fbffc119210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbff4033000 tx=0x7fbff4039000 comp rx=0 tx=0).stop 2024-09-13T18:43:49.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.408+0000 7fc00339d640 1 -- 172.21.15.97:0/218433786 shutdown_connections 2024-09-13T18:43:49.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.408+0000 7fc00339d640 1 --2- 172.21.15.97:0/218433786 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fbffc12bf70 0x7fbffc119210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:49.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.408+0000 7fc00339d640 1 --2- 172.21.15.97:0/218433786 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fbffc09dfb0 0x7fbffc13a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:49.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.408+0000 7fc00339d640 1 --2- 172.21.15.97:0/218433786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbffc0969d0 0x7fbffc13a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:49.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.408+0000 7fc00339d640 1 -- 172.21.15.97:0/218433786 >> 172.21.15.97:0/218433786 conn(0x7fbffc09b200 msgr2=0x7fbffc09cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:49.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.408+0000 7fc00339d640 1 -- 172.21.15.97:0/218433786 shutdown_connections 2024-09-13T18:43:49.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:43:49.408+0000 7fc00339d640 1 -- 172.21.15.97:0/218433786 wait complete. 2024-09-13T18:43:49.421 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-09-13T18:43:47.412988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":789879,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":60,"num_read_kb":50,"num_write":9457,"num_write_kb":25167188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9924,"ondisk_log_size":9924,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1225080,"kb_used_data":2392,"kb_used_omap":6,"kb_used_meta":1222649,"kb_avail":376262280,"statfs":{"total":386547056640,"available":385292574720,"internally_reserved":0,"allocated":2449408,"data_stored":1851654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1251992928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737399423,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2577,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002778"},"pg_stats":[{"pgid":"4.3f","version":"23'146","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719578+0000","last_change":"2024-09-13T18:39:14.592723+0000","last_active":"2024-09-13T18:43:38.719578+0000","last_peered":"2024-09-13T18:43:38.719578+0000","last_clean":"2024-09-13T18:43:38.719578+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:43:38.719578+0000","last_undegraded":"2024-09-13T18:43:38.719578+0000","last_fullsized":"2024-09-13T18:43:38.719578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:09.304808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'130","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727590+0000","last_change":"2024-09-13T18:39:14.581266+0000","last_active":"2024-09-13T18:43:38.727590+0000","last_peered":"2024-09-13T18:43:38.727590+0000","last_clean":"2024-09-13T18:43:38.727590+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:43:38.727590+0000","last_undegraded":"2024-09-13T18:43:38.727590+0000","last_fullsized":"2024-09-13T18:43:38.727590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.732104+0000","last_change":"2024-09-13T18:39:14.586254+0000","last_active":"2024-09-13T18:43:38.732104+0000","last_peered":"2024-09-13T18:43:38.732104+0000","last_clean":"2024-09-13T18:43:38.732104+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:43:38.732104+0000","last_undegraded":"2024-09-13T18:43:38.732104+0000","last_fullsized":"2024-09-13T18:43:38.732104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"23'173","reported_seq":185,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.733542+0000","last_change":"2024-09-13T18:39:14.583960+0000","last_active":"2024-09-13T18:43:38.733542+0000","last_peered":"2024-09-13T18:43:38.733542+0000","last_clean":"2024-09-13T18:43:38.733542+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:43:38.733542+0000","last_undegraded":"2024-09-13T18:43:38.733542+0000","last_fullsized":"2024-09-13T18:43:38.733542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"23'148","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727037+0000","last_change":"2024-09-13T18:39:14.577865+0000","last_active":"2024-09-13T18:43:38.727037+0000","last_peered":"2024-09-13T18:43:38.727037+0000","last_clean":"2024-09-13T18:43:38.727037+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:43:38.727037+0000","last_undegraded":"2024-09-13T18:43:38.727037+0000","last_fullsized":"2024-09-13T18:43:38.727037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'135","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.729288+0000","last_change":"2024-09-13T18:39:14.590785+0000","last_active":"2024-09-13T18:43:38.729288+0000","last_peered":"2024-09-13T18:43:38.729288+0000","last_clean":"2024-09-13T18:43:38.729288+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:43:38.729288+0000","last_undegraded":"2024-09-13T18:43:38.729288+0000","last_fullsized":"2024-09-13T18:43:38.729288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:24.453184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'164","reported_seq":176,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734491+0000","last_change":"2024-09-13T18:39:14.590893+0000","last_active":"2024-09-13T18:43:38.734491+0000","last_peered":"2024-09-13T18:43:38.734491+0000","last_clean":"2024-09-13T18:43:38.734491+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:43:38.734491+0000","last_undegraded":"2024-09-13T18:43:38.734491+0000","last_fullsized":"2024-09-13T18:43:38.734491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:57.986187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'186","reported_seq":198,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717710+0000","last_change":"2024-09-13T18:39:14.595160+0000","last_active":"2024-09-13T18:43:38.717710+0000","last_peered":"2024-09-13T18:43:38.717710+0000","last_clean":"2024-09-13T18:43:38.717710+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:43:38.717710+0000","last_undegraded":"2024-09-13T18:43:38.717710+0000","last_fullsized":"2024-09-13T18:43:38.717710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"23'152","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.722317+0000","last_change":"2024-09-13T18:39:14.586790+0000","last_active":"2024-09-13T18:43:38.722317+0000","last_peered":"2024-09-13T18:43:38.722317+0000","last_clean":"2024-09-13T18:43:38.722317+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:43:38.722317+0000","last_undegraded":"2024-09-13T18:43:38.722317+0000","last_fullsized":"2024-09-13T18:43:38.722317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:49.397008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'156","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736032+0000","last_change":"2024-09-13T18:39:14.591231+0000","last_active":"2024-09-13T18:43:38.736032+0000","last_peered":"2024-09-13T18:43:38.736032+0000","last_clean":"2024-09-13T18:43:38.736032+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:43:38.736032+0000","last_undegraded":"2024-09-13T18:43:38.736032+0000","last_fullsized":"2024-09-13T18:43:38.736032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"23'189","reported_seq":201,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730161+0000","last_change":"2024-09-13T18:39:14.589017+0000","last_active":"2024-09-13T18:43:38.730161+0000","last_peered":"2024-09-13T18:43:38.730161+0000","last_clean":"2024-09-13T18:43:38.730161+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:43:38.730161+0000","last_undegraded":"2024-09-13T18:43:38.730161+0000","last_fullsized":"2024-09-13T18:43:38.730161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"23'142","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.715282+0000","last_change":"2024-09-13T18:39:14.592629+0000","last_active":"2024-09-13T18:43:38.715282+0000","last_peered":"2024-09-13T18:43:38.715282+0000","last_clean":"2024-09-13T18:43:38.715282+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:43:38.715282+0000","last_undegraded":"2024-09-13T18:43:38.715282+0000","last_fullsized":"2024-09-13T18:43:38.715282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:43.190066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738828+0000","last_change":"2024-09-13T18:39:14.597709+0000","last_active":"2024-09-13T18:43:38.738828+0000","last_peered":"2024-09-13T18:43:38.738828+0000","last_clean":"2024-09-13T18:43:38.738828+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:43:38.738828+0000","last_undegraded":"2024-09-13T18:43:38.738828+0000","last_fullsized":"2024-09-13T18:43:38.738828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.367739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'149","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731243+0000","last_change":"2024-09-13T18:39:14.572267+0000","last_active":"2024-09-13T18:43:38.731243+0000","last_peered":"2024-09-13T18:43:38.731243+0000","last_clean":"2024-09-13T18:43:38.731243+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:43:38.731243+0000","last_undegraded":"2024-09-13T18:43:38.731243+0000","last_fullsized":"2024-09-13T18:43:38.731243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:33.982238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.728216+0000","last_change":"2024-09-13T18:39:14.583318+0000","last_active":"2024-09-13T18:43:38.728216+0000","last_peered":"2024-09-13T18:43:38.728216+0000","last_clean":"2024-09-13T18:43:38.728216+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:43:38.728216+0000","last_undegraded":"2024-09-13T18:43:38.728216+0000","last_fullsized":"2024-09-13T18:43:38.728216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"23'147","reported_seq":159,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741185+0000","last_change":"2024-09-13T18:39:14.592378+0000","last_active":"2024-09-13T18:43:38.741185+0000","last_peered":"2024-09-13T18:43:38.741185+0000","last_clean":"2024-09-13T18:43:38.741185+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:43:38.741185+0000","last_undegraded":"2024-09-13T18:43:38.741185+0000","last_fullsized":"2024-09-13T18:43:38.741185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:02.414361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'146","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.721992+0000","last_change":"2024-09-13T18:39:14.586945+0000","last_active":"2024-09-13T18:43:38.721992+0000","last_peered":"2024-09-13T18:43:38.721992+0000","last_clean":"2024-09-13T18:43:38.721992+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:43:38.721992+0000","last_undegraded":"2024-09-13T18:43:38.721992+0000","last_fullsized":"2024-09-13T18:43:38.721992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:57.889039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'157","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734859+0000","last_change":"2024-09-13T18:39:14.587172+0000","last_active":"2024-09-13T18:43:38.734859+0000","last_peered":"2024-09-13T18:43:38.734859+0000","last_clean":"2024-09-13T18:43:38.734859+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:43:38.734859+0000","last_undegraded":"2024-09-13T18:43:38.734859+0000","last_fullsized":"2024-09-13T18:43:38.734859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"23'172","reported_seq":184,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719162+0000","last_change":"2024-09-13T18:39:14.594291+0000","last_active":"2024-09-13T18:43:38.719162+0000","last_peered":"2024-09-13T18:43:38.719162+0000","last_clean":"2024-09-13T18:43:38.719162+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:43:38.719162+0000","last_undegraded":"2024-09-13T18:43:38.719162+0000","last_fullsized":"2024-09-13T18:43:38.719162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:29.208875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'161","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737482+0000","last_change":"2024-09-13T18:39:14.585973+0000","last_active":"2024-09-13T18:43:38.737482+0000","last_peered":"2024-09-13T18:43:38.737482+0000","last_clean":"2024-09-13T18:43:38.737482+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:43:38.737482+0000","last_undegraded":"2024-09-13T18:43:38.737482+0000","last_fullsized":"2024-09-13T18:43:38.737482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:48.875040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"23'137","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727488+0000","last_change":"2024-09-13T18:39:14.595451+0000","last_active":"2024-09-13T18:43:38.727488+0000","last_peered":"2024-09-13T18:43:38.727488+0000","last_clean":"2024-09-13T18:43:38.727488+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:43:38.727488+0000","last_undegraded":"2024-09-13T18:43:38.727488+0000","last_fullsized":"2024-09-13T18:43:38.727488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:45.368802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"23'166","reported_seq":178,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727552+0000","last_change":"2024-09-13T18:39:14.583590+0000","last_active":"2024-09-13T18:43:38.727552+0000","last_peered":"2024-09-13T18:43:38.727552+0000","last_clean":"2024-09-13T18:43:38.727552+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:43:38.727552+0000","last_undegraded":"2024-09-13T18:43:38.727552+0000","last_fullsized":"2024-09-13T18:43:38.727552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:55.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'134","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737455+0000","last_change":"2024-09-13T18:39:14.590724+0000","last_active":"2024-09-13T18:43:38.737455+0000","last_peered":"2024-09-13T18:43:38.737455+0000","last_clean":"2024-09-13T18:43:38.737455+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:43:38.737455+0000","last_undegraded":"2024-09-13T18:43:38.737455+0000","last_fullsized":"2024-09-13T18:43:38.737455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:09.353955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"23'180","reported_seq":192,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731840+0000","last_change":"2024-09-13T18:39:14.577642+0000","last_active":"2024-09-13T18:43:38.731840+0000","last_peered":"2024-09-13T18:43:38.731840+0000","last_clean":"2024-09-13T18:43:38.731840+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:43:38.731840+0000","last_undegraded":"2024-09-13T18:43:38.731840+0000","last_fullsized":"2024-09-13T18:43:38.731840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"23'134","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736869+0000","last_change":"2024-09-13T18:39:14.592432+0000","last_active":"2024-09-13T18:43:38.736869+0000","last_peered":"2024-09-13T18:43:38.736869+0000","last_clean":"2024-09-13T18:43:38.736869+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:43:38.736869+0000","last_undegraded":"2024-09-13T18:43:38.736869+0000","last_fullsized":"2024-09-13T18:43:38.736869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:43.945214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'198","reported_seq":210,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.728569+0000","last_change":"2024-09-13T18:39:14.571893+0000","last_active":"2024-09-13T18:43:38.728569+0000","last_peered":"2024-09-13T18:43:38.728569+0000","last_clean":"2024-09-13T18:43:38.728569+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:43:38.728569+0000","last_undegraded":"2024-09-13T18:43:38.728569+0000","last_fullsized":"2024-09-13T18:43:38.728569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:48.983666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'144","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719698+0000","last_change":"2024-09-13T18:39:14.594222+0000","last_active":"2024-09-13T18:43:38.719698+0000","last_peered":"2024-09-13T18:43:38.719698+0000","last_clean":"2024-09-13T18:43:38.719698+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:43:38.719698+0000","last_undegraded":"2024-09-13T18:43:38.719698+0000","last_fullsized":"2024-09-13T18:43:38.719698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:20.265556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'133","reported_seq":145,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739499+0000","last_change":"2024-09-13T18:39:14.576203+0000","last_active":"2024-09-13T18:43:38.739499+0000","last_peered":"2024-09-13T18:43:38.739499+0000","last_clean":"2024-09-13T18:43:38.739499+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:43:38.739499+0000","last_undegraded":"2024-09-13T18:43:38.739499+0000","last_fullsized":"2024-09-13T18:43:38.739499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.125966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"23'118","reported_seq":130,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740575+0000","last_change":"2024-09-13T18:39:14.586374+0000","last_active":"2024-09-13T18:43:38.740575+0000","last_peered":"2024-09-13T18:43:38.740575+0000","last_clean":"2024-09-13T18:43:38.740575+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:43:38.740575+0000","last_undegraded":"2024-09-13T18:43:38.740575+0000","last_fullsized":"2024-09-13T18:43:38.740575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:03.191196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'131","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.714196+0000","last_change":"2024-09-13T18:39:14.577392+0000","last_active":"2024-09-13T18:43:38.714196+0000","last_peered":"2024-09-13T18:43:38.714196+0000","last_clean":"2024-09-13T18:43:38.714196+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:43:38.714196+0000","last_undegraded":"2024-09-13T18:43:38.714196+0000","last_fullsized":"2024-09-13T18:43:38.714196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:26.709807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"23'135","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740453+0000","last_change":"2024-09-13T18:39:14.580898+0000","last_active":"2024-09-13T18:43:38.740453+0000","last_peered":"2024-09-13T18:43:38.740453+0000","last_clean":"2024-09-13T18:43:38.740453+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:43:38.740453+0000","last_undegraded":"2024-09-13T18:43:38.740453+0000","last_fullsized":"2024-09-13T18:43:38.740453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:23.630337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"23'150","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.716995+0000","last_change":"2024-09-13T18:39:14.574811+0000","last_active":"2024-09-13T18:43:38.716995+0000","last_peered":"2024-09-13T18:43:38.716995+0000","last_clean":"2024-09-13T18:43:38.716995+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:43:38.716995+0000","last_undegraded":"2024-09-13T18:43:38.716995+0000","last_fullsized":"2024-09-13T18:43:38.716995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"23'149","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730224+0000","last_change":"2024-09-13T18:39:14.579494+0000","last_active":"2024-09-13T18:43:38.730224+0000","last_peered":"2024-09-13T18:43:38.730224+0000","last_clean":"2024-09-13T18:43:38.730224+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:43:38.730224+0000","last_undegraded":"2024-09-13T18:43:38.730224+0000","last_fullsized":"2024-09-13T18:43:38.730224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:19.432936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660311+0000","last_change":"2024-09-13T18:39:13.575179+0000","last_active":"2024-09-13T18:39:53.660311+0000","last_peered":"2024-09-13T18:39:53.660311+0000","last_clean":"2024-09-13T18:39:53.660311+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:39:53.660311+0000","last_undegraded":"2024-09-13T18:39:53.660311+0000","last_fullsized":"2024-09-13T18:39:53.660311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:25.703093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"23'150","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717407+0000","last_change":"2024-09-13T18:39:14.594066+0000","last_active":"2024-09-13T18:43:38.717407+0000","last_peered":"2024-09-13T18:43:38.717407+0000","last_clean":"2024-09-13T18:43:38.717407+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:43:38.717407+0000","last_undegraded":"2024-09-13T18:43:38.717407+0000","last_fullsized":"2024-09-13T18:43:38.717407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:14.964806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.665780+0000","last_change":"2024-09-13T18:39:13.570778+0000","last_active":"2024-09-13T18:39:53.665780+0000","last_peered":"2024-09-13T18:39:53.665780+0000","last_clean":"2024-09-13T18:39:53.665780+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:39:53.665780+0000","last_undegraded":"2024-09-13T18:39:53.665780+0000","last_fullsized":"2024-09-13T18:39:53.665780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"23'229","reported_seq":250,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739934+0000","last_change":"2024-09-13T18:39:54.668508+0000","last_active":"2024-09-13T18:43:38.739934+0000","last_peered":"2024-09-13T18:43:38.739934+0000","last_clean":"2024-09-13T18:43:38.739934+0000","last_became_active":"2024-09-13T18:39:54.668035+0000","last_became_peered":"2024-09-13T18:39:54.668035+0000","last_unstale":"2024-09-13T18:43:38.739934+0000","last_undegraded":"2024-09-13T18:43:38.739934+0000","last_fullsized":"2024-09-13T18:43:38.739934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:40.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663232+0000","last_change":"2024-09-13T18:39:13.575436+0000","last_active":"2024-09-13T18:39:53.663232+0000","last_peered":"2024-09-13T18:39:53.663232+0000","last_clean":"2024-09-13T18:39:53.663232+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:39:53.663232+0000","last_undegraded":"2024-09-13T18:39:53.663232+0000","last_fullsized":"2024-09-13T18:39:53.663232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:34.408199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'141","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737866+0000","last_change":"2024-09-13T18:39:14.584791+0000","last_active":"2024-09-13T18:43:38.737866+0000","last_peered":"2024-09-13T18:43:38.737866+0000","last_clean":"2024-09-13T18:43:38.737866+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:43:38.737866+0000","last_undegraded":"2024-09-13T18:43:38.737866+0000","last_fullsized":"2024-09-13T18:43:38.737866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:08.799126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'9","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.663475+0000","last_change":"2024-09-13T18:39:13.578940+0000","last_active":"2024-09-13T18:39:54.663475+0000","last_peered":"2024-09-13T18:39:54.663475+0000","last_clean":"2024-09-13T18:39:54.663475+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:39:54.663475+0000","last_undegraded":"2024-09-13T18:39:54.663475+0000","last_fullsized":"2024-09-13T18:39:54.663475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:34.109209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666409+0000","last_change":"2024-09-13T18:39:13.583184+0000","last_active":"2024-09-13T18:39:53.666409+0000","last_peered":"2024-09-13T18:39:53.666409+0000","last_clean":"2024-09-13T18:39:53.666409+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:39:53.666409+0000","last_undegraded":"2024-09-13T18:39:53.666409+0000","last_fullsized":"2024-09-13T18:39:53.666409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"23'153","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741409+0000","last_change":"2024-09-13T18:39:54.668672+0000","last_active":"2024-09-13T18:43:38.741409+0000","last_peered":"2024-09-13T18:43:38.741409+0000","last_clean":"2024-09-13T18:43:38.741409+0000","last_became_active":"2024-09-13T18:39:54.668322+0000","last_became_peered":"2024-09-13T18:39:54.668322+0000","last_unstale":"2024-09-13T18:43:38.741409+0000","last_undegraded":"2024-09-13T18:43:38.741409+0000","last_fullsized":"2024-09-13T18:43:38.741409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:43.914025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662667+0000","last_change":"2024-09-13T18:39:13.571043+0000","last_active":"2024-09-13T18:39:53.662667+0000","last_peered":"2024-09-13T18:39:53.662667+0000","last_clean":"2024-09-13T18:39:53.662667+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:39:53.662667+0000","last_undegraded":"2024-09-13T18:39:53.662667+0000","last_fullsized":"2024-09-13T18:39:53.662667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.757855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'134","reported_seq":146,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.709074+0000","last_change":"2024-09-13T18:39:14.577177+0000","last_active":"2024-09-13T18:43:38.709074+0000","last_peered":"2024-09-13T18:43:38.709074+0000","last_clean":"2024-09-13T18:43:38.709074+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:43:38.709074+0000","last_undegraded":"2024-09-13T18:43:38.709074+0000","last_fullsized":"2024-09-13T18:43:38.709074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:29.703024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667326+0000","last_change":"2024-09-13T18:39:13.581627+0000","last_active":"2024-09-13T18:39:53.667326+0000","last_peered":"2024-09-13T18:39:53.667326+0000","last_clean":"2024-09-13T18:39:53.667326+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:39:53.667326+0000","last_undegraded":"2024-09-13T18:39:53.667326+0000","last_fullsized":"2024-09-13T18:39:53.667326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:48.023626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'128","reported_seq":140,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.724030+0000","last_change":"2024-09-13T18:39:14.596602+0000","last_active":"2024-09-13T18:43:38.724030+0000","last_peered":"2024-09-13T18:43:38.724030+0000","last_clean":"2024-09-13T18:43:38.724030+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:43:38.724030+0000","last_undegraded":"2024-09-13T18:43:38.724030+0000","last_fullsized":"2024-09-13T18:43:38.724030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:35.414913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666092+0000","last_change":"2024-09-13T18:39:13.570169+0000","last_active":"2024-09-13T18:39:53.666092+0000","last_peered":"2024-09-13T18:39:53.666092+0000","last_clean":"2024-09-13T18:39:53.666092+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:39:53.666092+0000","last_undegraded":"2024-09-13T18:39:53.666092+0000","last_fullsized":"2024-09-13T18:39:53.666092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"23'143","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727371+0000","last_change":"2024-09-13T18:39:14.584580+0000","last_active":"2024-09-13T18:43:38.727371+0000","last_peered":"2024-09-13T18:43:38.727371+0000","last_clean":"2024-09-13T18:43:38.727371+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:43:38.727371+0000","last_undegraded":"2024-09-13T18:43:38.727371+0000","last_fullsized":"2024-09-13T18:43:38.727371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.869146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664054+0000","last_change":"2024-09-13T18:39:13.575713+0000","last_active":"2024-09-13T18:39:54.664054+0000","last_peered":"2024-09-13T18:39:54.664054+0000","last_clean":"2024-09-13T18:39:54.664054+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:39:54.664054+0000","last_undegraded":"2024-09-13T18:39:54.664054+0000","last_fullsized":"2024-09-13T18:39:54.664054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:59.985917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'144","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.711181+0000","last_change":"2024-09-13T18:39:14.577151+0000","last_active":"2024-09-13T18:43:38.711181+0000","last_peered":"2024-09-13T18:43:38.711181+0000","last_clean":"2024-09-13T18:43:38.711181+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:43:38.711181+0000","last_undegraded":"2024-09-13T18:43:38.711181+0000","last_fullsized":"2024-09-13T18:43:38.711181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:20.982345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663898+0000","last_change":"2024-09-13T18:39:13.581445+0000","last_active":"2024-09-13T18:39:53.663898+0000","last_peered":"2024-09-13T18:39:53.663898+0000","last_clean":"2024-09-13T18:39:53.663898+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:39:53.663898+0000","last_undegraded":"2024-09-13T18:39:53.663898+0000","last_fullsized":"2024-09-13T18:39:53.663898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:39.003339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'151","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734368+0000","last_change":"2024-09-13T18:39:14.584122+0000","last_active":"2024-09-13T18:43:38.734368+0000","last_peered":"2024-09-13T18:43:38.734368+0000","last_clean":"2024-09-13T18:43:38.734368+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:43:38.734368+0000","last_undegraded":"2024-09-13T18:43:38.734368+0000","last_fullsized":"2024-09-13T18:43:38.734368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:30.405734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663324+0000","last_change":"2024-09-13T18:39:13.575316+0000","last_active":"2024-09-13T18:39:53.663324+0000","last_peered":"2024-09-13T18:39:53.663324+0000","last_clean":"2024-09-13T18:39:53.663324+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:39:53.663324+0000","last_undegraded":"2024-09-13T18:39:53.663324+0000","last_fullsized":"2024-09-13T18:39:53.663324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:06.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'146","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719389+0000","last_change":"2024-09-13T18:39:14.593058+0000","last_active":"2024-09-13T18:43:38.719389+0000","last_peered":"2024-09-13T18:43:38.719389+0000","last_clean":"2024-09-13T18:43:38.719389+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:43:38.719389+0000","last_undegraded":"2024-09-13T18:43:38.719389+0000","last_fullsized":"2024-09-13T18:43:38.719389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:24.454698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661099+0000","last_change":"2024-09-13T18:39:13.581217+0000","last_active":"2024-09-13T18:39:53.661099+0000","last_peered":"2024-09-13T18:39:53.661099+0000","last_clean":"2024-09-13T18:39:53.661099+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:39:53.661099+0000","last_undegraded":"2024-09-13T18:39:53.661099+0000","last_fullsized":"2024-09-13T18:39:53.661099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:27.361025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'138","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739846+0000","last_change":"2024-09-13T18:39:14.596597+0000","last_active":"2024-09-13T18:43:38.739846+0000","last_peered":"2024-09-13T18:43:38.739846+0000","last_clean":"2024-09-13T18:43:38.739846+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:43:38.739846+0000","last_undegraded":"2024-09-13T18:43:38.739846+0000","last_fullsized":"2024-09-13T18:43:38.739846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:47.680908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":87,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661174+0000","last_change":"2024-09-13T18:39:03.413753+0000","last_active":"2024-09-13T18:39:53.661174+0000","last_peered":"2024-09-13T18:39:53.661174+0000","last_clean":"2024-09-13T18:39:53.661174+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:39:53.661174+0000","last_undegraded":"2024-09-13T18:39:53.661174+0000","last_fullsized":"2024-09-13T18:39:53.661174+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.425159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:05.703287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660538+0000","last_change":"2024-09-13T18:39:09.531787+0000","last_active":"2024-09-13T18:39:53.660538+0000","last_peered":"2024-09-13T18:39:53.660538+0000","last_clean":"2024-09-13T18:39:53.660538+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:39:53.660538+0000","last_undegraded":"2024-09-13T18:39:53.660538+0000","last_fullsized":"2024-09-13T18:39:53.660538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:21.652872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664040+0000","last_change":"2024-09-13T18:39:13.575940+0000","last_active":"2024-09-13T18:39:53.664040+0000","last_peered":"2024-09-13T18:39:53.664040+0000","last_clean":"2024-09-13T18:39:53.664040+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:39:53.664040+0000","last_undegraded":"2024-09-13T18:39:53.664040+0000","last_fullsized":"2024-09-13T18:39:53.664040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:23.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'143","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730832+0000","last_change":"2024-09-13T18:39:54.668486+0000","last_active":"2024-09-13T18:43:38.730832+0000","last_peered":"2024-09-13T18:43:38.730832+0000","last_clean":"2024-09-13T18:43:38.730832+0000","last_became_active":"2024-09-13T18:39:54.668177+0000","last_became_peered":"2024-09-13T18:39:54.668177+0000","last_unstale":"2024-09-13T18:43:38.730832+0000","last_undegraded":"2024-09-13T18:43:38.730832+0000","last_fullsized":"2024-09-13T18:43:38.730832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:01.415577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661120+0000","last_change":"2024-09-13T18:39:09.531377+0000","last_active":"2024-09-13T18:39:53.661120+0000","last_peered":"2024-09-13T18:39:53.661120+0000","last_clean":"2024-09-13T18:39:53.661120+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:39:53.661120+0000","last_undegraded":"2024-09-13T18:39:53.661120+0000","last_fullsized":"2024-09-13T18:39:53.661120+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'5","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.437998+0000","last_change":"2024-09-13T18:39:13.563570+0000","last_active":"2024-09-13T18:43:37.437998+0000","last_peered":"2024-09-13T18:43:37.437998+0000","last_clean":"2024-09-13T18:43:37.437998+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:43:37.437998+0000","last_undegraded":"2024-09-13T18:43:37.437998+0000","last_fullsized":"2024-09-13T18:43:37.437998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'163","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736074+0000","last_change":"2024-09-13T18:39:14.587017+0000","last_active":"2024-09-13T18:43:38.736074+0000","last_peered":"2024-09-13T18:43:38.736074+0000","last_clean":"2024-09-13T18:43:38.736074+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:43:38.736074+0000","last_undegraded":"2024-09-13T18:43:38.736074+0000","last_fullsized":"2024-09-13T18:43:38.736074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:22.507784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661881+0000","last_change":"2024-09-13T18:39:09.533004+0000","last_active":"2024-09-13T18:39:53.661881+0000","last_peered":"2024-09-13T18:39:53.661881+0000","last_clean":"2024-09-13T18:39:53.661881+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:39:53.661881+0000","last_undegraded":"2024-09-13T18:39:53.661881+0000","last_fullsized":"2024-09-13T18:39:53.661881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:41.079838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660963+0000","last_change":"2024-09-13T18:39:13.579066+0000","last_active":"2024-09-13T18:39:53.660963+0000","last_peered":"2024-09-13T18:39:53.660963+0000","last_clean":"2024-09-13T18:39:53.660963+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:39:53.660963+0000","last_undegraded":"2024-09-13T18:39:53.660963+0000","last_fullsized":"2024-09-13T18:39:53.660963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:19.488135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'143","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730317+0000","last_change":"2024-09-13T18:39:14.589734+0000","last_active":"2024-09-13T18:43:38.730317+0000","last_peered":"2024-09-13T18:43:38.730317+0000","last_clean":"2024-09-13T18:43:38.730317+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:43:38.730317+0000","last_undegraded":"2024-09-13T18:43:38.730317+0000","last_fullsized":"2024-09-13T18:43:38.730317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:52.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.664123+0000","last_change":"2024-09-13T18:39:09.532311+0000","last_active":"2024-09-13T18:39:53.664123+0000","last_peered":"2024-09-13T18:39:53.664123+0000","last_clean":"2024-09-13T18:39:53.664123+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:39:53.664123+0000","last_undegraded":"2024-09-13T18:39:53.664123+0000","last_fullsized":"2024-09-13T18:39:53.664123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:53.060128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666753+0000","last_change":"2024-09-13T18:39:13.571488+0000","last_active":"2024-09-13T18:39:53.666753+0000","last_peered":"2024-09-13T18:39:53.666753+0000","last_clean":"2024-09-13T18:39:53.666753+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:39:53.666753+0000","last_undegraded":"2024-09-13T18:39:53.666753+0000","last_fullsized":"2024-09-13T18:39:53.666753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:44.121699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"23'144","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730418+0000","last_change":"2024-09-13T18:39:14.579779+0000","last_active":"2024-09-13T18:43:38.730418+0000","last_peered":"2024-09-13T18:43:38.730418+0000","last_clean":"2024-09-13T18:43:38.730418+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:43:38.730418+0000","last_undegraded":"2024-09-13T18:43:38.730418+0000","last_fullsized":"2024-09-13T18:43:38.730418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:48.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660742+0000","last_change":"2024-09-13T18:39:13.577844+0000","last_active":"2024-09-13T18:39:53.660742+0000","last_peered":"2024-09-13T18:39:53.660742+0000","last_clean":"2024-09-13T18:39:53.660742+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:39:53.660742+0000","last_undegraded":"2024-09-13T18:39:53.660742+0000","last_fullsized":"2024-09-13T18:39:53.660742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:38.602531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661619+0000","last_change":"2024-09-13T18:39:09.533091+0000","last_active":"2024-09-13T18:39:53.661619+0000","last_peered":"2024-09-13T18:39:53.661619+0000","last_clean":"2024-09-13T18:39:53.661619+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:39:53.661619+0000","last_undegraded":"2024-09-13T18:39:53.661619+0000","last_fullsized":"2024-09-13T18:39:53.661619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:59.843796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"23'158","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.728247+0000","last_change":"2024-09-13T18:39:14.597238+0000","last_active":"2024-09-13T18:43:38.728247+0000","last_peered":"2024-09-13T18:43:38.728247+0000","last_clean":"2024-09-13T18:43:38.728247+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:43:38.728247+0000","last_undegraded":"2024-09-13T18:43:38.728247+0000","last_fullsized":"2024-09-13T18:43:38.728247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.849783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660988+0000","last_change":"2024-09-13T18:39:13.583071+0000","last_active":"2024-09-13T18:39:53.660988+0000","last_peered":"2024-09-13T18:39:53.660988+0000","last_clean":"2024-09-13T18:39:53.660988+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:39:53.660988+0000","last_undegraded":"2024-09-13T18:39:53.660988+0000","last_fullsized":"2024-09-13T18:39:53.660988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:56.918180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.667429+0000","last_change":"2024-09-13T18:39:09.532042+0000","last_active":"2024-09-13T18:39:53.667429+0000","last_peered":"2024-09-13T18:39:53.667429+0000","last_clean":"2024-09-13T18:39:53.667429+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:39:53.667429+0000","last_undegraded":"2024-09-13T18:39:53.667429+0000","last_fullsized":"2024-09-13T18:39:53.667429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:24.541036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"23'145","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717323+0000","last_change":"2024-09-13T18:39:14.584428+0000","last_active":"2024-09-13T18:43:38.717323+0000","last_peered":"2024-09-13T18:43:38.717323+0000","last_clean":"2024-09-13T18:43:38.717323+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:43:38.717323+0000","last_undegraded":"2024-09-13T18:43:38.717323+0000","last_fullsized":"2024-09-13T18:43:38.717323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:13.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.662382+0000","last_change":"2024-09-13T18:39:13.583868+0000","last_active":"2024-09-13T18:39:54.662382+0000","last_peered":"2024-09-13T18:39:54.662382+0000","last_clean":"2024-09-13T18:39:54.662382+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:39:54.662382+0000","last_undegraded":"2024-09-13T18:39:54.662382+0000","last_fullsized":"2024-09-13T18:39:54.662382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:52.540883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662865+0000","last_change":"2024-09-13T18:39:09.532757+0000","last_active":"2024-09-13T18:39:53.662865+0000","last_peered":"2024-09-13T18:39:53.662865+0000","last_clean":"2024-09-13T18:39:53.662865+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:39:53.662865+0000","last_undegraded":"2024-09-13T18:39:53.662865+0000","last_fullsized":"2024-09-13T18:39:53.662865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:32.617744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"23'131","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741518+0000","last_change":"2024-09-13T18:39:14.582490+0000","last_active":"2024-09-13T18:43:38.741518+0000","last_peered":"2024-09-13T18:43:38.741518+0000","last_clean":"2024-09-13T18:43:38.741518+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:43:38.741518+0000","last_undegraded":"2024-09-13T18:43:38.741518+0000","last_fullsized":"2024-09-13T18:43:38.741518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:44.239715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'10","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:34.630546+0000","last_change":"2024-09-13T18:39:13.583929+0000","last_active":"2024-09-13T18:43:34.630546+0000","last_peered":"2024-09-13T18:43:34.630546+0000","last_clean":"2024-09-13T18:43:34.630546+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:43:34.630546+0000","last_undegraded":"2024-09-13T18:43:34.630546+0000","last_fullsized":"2024-09-13T18:43:34.630546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:57.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.663547+0000","last_change":"2024-09-13T18:39:09.531717+0000","last_active":"2024-09-13T18:39:53.663547+0000","last_peered":"2024-09-13T18:39:53.663547+0000","last_clean":"2024-09-13T18:39:53.663547+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:39:53.663547+0000","last_undegraded":"2024-09-13T18:39:53.663547+0000","last_fullsized":"2024-09-13T18:39:53.663547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:33.878130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"23'131","reported_seq":152,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.715217+0000","last_change":"2024-09-13T18:39:54.667668+0000","last_active":"2024-09-13T18:43:38.715217+0000","last_peered":"2024-09-13T18:43:38.715217+0000","last_clean":"2024-09-13T18:43:38.715217+0000","last_became_active":"2024-09-13T18:39:54.667244+0000","last_became_peered":"2024-09-13T18:39:54.667244+0000","last_unstale":"2024-09-13T18:43:38.715217+0000","last_undegraded":"2024-09-13T18:43:38.715217+0000","last_fullsized":"2024-09-13T18:43:38.715217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:56.127916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"23'171","reported_seq":183,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739130+0000","last_change":"2024-09-13T18:39:14.593754+0000","last_active":"2024-09-13T18:43:38.739130+0000","last_peered":"2024-09-13T18:43:38.739130+0000","last_clean":"2024-09-13T18:43:38.739130+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:43:38.739130+0000","last_undegraded":"2024-09-13T18:43:38.739130+0000","last_fullsized":"2024-09-13T18:43:38.739130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:07.651837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"23'95","reported_seq":108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.742654+0000","last_change":"2024-09-13T18:39:13.575507+0000","last_active":"2024-09-13T18:43:38.742654+0000","last_peered":"2024-09-13T18:43:38.742654+0000","last_clean":"2024-09-13T18:43:38.742654+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:43:38.742654+0000","last_undegraded":"2024-09-13T18:43:38.742654+0000","last_fullsized":"2024-09-13T18:43:38.742654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:42.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198201,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"23'157","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.735249+0000","last_change":"2024-09-13T18:39:14.598160+0000","last_active":"2024-09-13T18:43:38.735249+0000","last_peered":"2024-09-13T18:43:38.735249+0000","last_clean":"2024-09-13T18:43:38.735249+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:43:38.735249+0000","last_undegraded":"2024-09-13T18:43:38.735249+0000","last_fullsized":"2024-09-13T18:43:38.735249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.437719+0000","last_change":"2024-09-13T18:39:13.572017+0000","last_active":"2024-09-13T18:43:37.437719+0000","last_peered":"2024-09-13T18:43:37.437719+0000","last_clean":"2024-09-13T18:43:37.437719+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:43:37.437719+0000","last_undegraded":"2024-09-13T18:43:37.437719+0000","last_fullsized":"2024-09-13T18:43:37.437719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:25.536255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.662584+0000","last_change":"2024-09-13T18:39:13.571792+0000","last_active":"2024-09-13T18:39:53.662584+0000","last_peered":"2024-09-13T18:39:53.662584+0000","last_clean":"2024-09-13T18:39:53.662584+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:39:53.662584+0000","last_undegraded":"2024-09-13T18:39:53.662584+0000","last_fullsized":"2024-09-13T18:39:53.662584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:30.415348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'189","reported_seq":201,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737335+0000","last_change":"2024-09-13T18:39:14.590748+0000","last_active":"2024-09-13T18:43:38.737335+0000","last_peered":"2024-09-13T18:43:38.737335+0000","last_clean":"2024-09-13T18:43:38.737335+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:43:38.737335+0000","last_undegraded":"2024-09-13T18:43:38.737335+0000","last_fullsized":"2024-09-13T18:43:38.737335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:49.557245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.666030+0000","last_change":"2024-09-13T18:39:13.569863+0000","last_active":"2024-09-13T18:39:54.666030+0000","last_peered":"2024-09-13T18:39:54.666030+0000","last_clean":"2024-09-13T18:39:54.666030+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:39:54.666030+0000","last_undegraded":"2024-09-13T18:39:54.666030+0000","last_fullsized":"2024-09-13T18:39:54.666030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'165","reported_seq":177,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740654+0000","last_change":"2024-09-13T18:39:14.582205+0000","last_active":"2024-09-13T18:43:38.740654+0000","last_peered":"2024-09-13T18:43:38.740654+0000","last_clean":"2024-09-13T18:43:38.740654+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:43:38.740654+0000","last_undegraded":"2024-09-13T18:43:38.740654+0000","last_fullsized":"2024-09-13T18:43:38.740654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:43.186210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'135","reported_seq":144,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730768+0000","last_change":"2024-09-13T18:39:54.668351+0000","last_active":"2024-09-13T18:43:38.730768+0000","last_peered":"2024-09-13T18:43:38.730768+0000","last_clean":"2024-09-13T18:43:38.730768+0000","last_became_active":"2024-09-13T18:39:54.667809+0000","last_became_peered":"2024-09-13T18:39:54.667809+0000","last_unstale":"2024-09-13T18:43:38.730768+0000","last_undegraded":"2024-09-13T18:43:38.730768+0000","last_fullsized":"2024-09-13T18:43:38.730768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:40.114429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661053+0000","last_change":"2024-09-13T18:39:13.573803+0000","last_active":"2024-09-13T18:39:53.661053+0000","last_peered":"2024-09-13T18:39:53.661053+0000","last_clean":"2024-09-13T18:39:53.661053+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:39:53.661053+0000","last_undegraded":"2024-09-13T18:39:53.661053+0000","last_fullsized":"2024-09-13T18:39:53.661053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:08.298094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"23'152","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734010+0000","last_change":"2024-09-13T18:39:14.586848+0000","last_active":"2024-09-13T18:43:38.734010+0000","last_peered":"2024-09-13T18:43:38.734010+0000","last_clean":"2024-09-13T18:43:38.734010+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:43:38.734010+0000","last_undegraded":"2024-09-13T18:43:38.734010+0000","last_fullsized":"2024-09-13T18:43:38.734010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:51.276936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660115+0000","last_change":"2024-09-13T18:39:13.586123+0000","last_active":"2024-09-13T18:39:53.660115+0000","last_peered":"2024-09-13T18:39:53.660115+0000","last_clean":"2024-09-13T18:39:53.660115+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:39:53.660115+0000","last_undegraded":"2024-09-13T18:39:53.660115+0000","last_fullsized":"2024-09-13T18:39:53.660115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"23'183","reported_seq":192,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731266+0000","last_change":"2024-09-13T18:39:54.668883+0000","last_active":"2024-09-13T18:43:38.731266+0000","last_peered":"2024-09-13T18:43:38.731266+0000","last_clean":"2024-09-13T18:43:38.731266+0000","last_became_active":"2024-09-13T18:39:54.668613+0000","last_became_peered":"2024-09-13T18:39:54.668613+0000","last_unstale":"2024-09-13T18:43:38.731266+0000","last_undegraded":"2024-09-13T18:43:38.731266+0000","last_fullsized":"2024-09-13T18:43:38.731266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:31.076844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661254+0000","last_change":"2024-09-13T18:39:13.575435+0000","last_active":"2024-09-13T18:39:53.661254+0000","last_peered":"2024-09-13T18:39:53.661254+0000","last_clean":"2024-09-13T18:39:53.661254+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:39:53.661254+0000","last_undegraded":"2024-09-13T18:39:53.661254+0000","last_fullsized":"2024-09-13T18:39:53.661254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"23'141","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727330+0000","last_change":"2024-09-13T18:39:14.580846+0000","last_active":"2024-09-13T18:43:38.727330+0000","last_peered":"2024-09-13T18:43:38.727330+0000","last_clean":"2024-09-13T18:43:38.727330+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:43:38.727330+0000","last_undegraded":"2024-09-13T18:43:38.727330+0000","last_fullsized":"2024-09-13T18:43:38.727330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.010053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666752+0000","last_change":"2024-09-13T18:39:13.571042+0000","last_active":"2024-09-13T18:39:53.666752+0000","last_peered":"2024-09-13T18:39:53.666752+0000","last_clean":"2024-09-13T18:39:53.666752+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:39:53.666752+0000","last_undegraded":"2024-09-13T18:39:53.666752+0000","last_fullsized":"2024-09-13T18:39:53.666752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:12.288993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"23'137","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738740+0000","last_change":"2024-09-13T18:39:14.593258+0000","last_active":"2024-09-13T18:43:38.738740+0000","last_peered":"2024-09-13T18:43:38.738740+0000","last_clean":"2024-09-13T18:43:38.738740+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:43:38.738740+0000","last_undegraded":"2024-09-13T18:43:38.738740+0000","last_fullsized":"2024-09-13T18:43:38.738740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:21.972039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.660913+0000","last_change":"2024-09-13T18:39:13.584903+0000","last_active":"2024-09-13T18:39:53.660913+0000","last_peered":"2024-09-13T18:39:53.660913+0000","last_clean":"2024-09-13T18:39:53.660913+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:39:53.660913+0000","last_undegraded":"2024-09-13T18:39:53.660913+0000","last_fullsized":"2024-09-13T18:39:53.660913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:46.551317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"23'130","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.714269+0000","last_change":"2024-09-13T18:39:54.667465+0000","last_active":"2024-09-13T18:43:38.714269+0000","last_peered":"2024-09-13T18:43:38.714269+0000","last_clean":"2024-09-13T18:43:38.714269+0000","last_became_active":"2024-09-13T18:39:54.667188+0000","last_became_peered":"2024-09-13T18:39:54.667188+0000","last_unstale":"2024-09-13T18:43:38.714269+0000","last_undegraded":"2024-09-13T18:43:38.714269+0000","last_fullsized":"2024-09-13T18:43:38.714269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:40.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664322+0000","last_change":"2024-09-13T18:39:13.574044+0000","last_active":"2024-09-13T18:39:54.664322+0000","last_peered":"2024-09-13T18:39:54.664322+0000","last_clean":"2024-09-13T18:39:54.664322+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:39:54.664322+0000","last_undegraded":"2024-09-13T18:39:54.664322+0000","last_fullsized":"2024-09-13T18:39:54.664322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:12.168801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'157","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739642+0000","last_change":"2024-09-13T18:39:14.591381+0000","last_active":"2024-09-13T18:43:38.739642+0000","last_peered":"2024-09-13T18:43:38.739642+0000","last_clean":"2024-09-13T18:43:38.739642+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:43:38.739642+0000","last_undegraded":"2024-09-13T18:43:38.739642+0000","last_fullsized":"2024-09-13T18:43:38.739642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:17.239023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.661826+0000","last_change":"2024-09-13T18:39:13.575357+0000","last_active":"2024-09-13T18:39:53.661826+0000","last_peered":"2024-09-13T18:39:53.661826+0000","last_clean":"2024-09-13T18:39:53.661826+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:39:53.661826+0000","last_undegraded":"2024-09-13T18:39:53.661826+0000","last_fullsized":"2024-09-13T18:39:53.661826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:20.965325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"23'170","reported_seq":182,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.722266+0000","last_change":"2024-09-13T18:39:14.580750+0000","last_active":"2024-09-13T18:43:38.722266+0000","last_peered":"2024-09-13T18:43:38.722266+0000","last_clean":"2024-09-13T18:43:38.722266+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:43:38.722266+0000","last_undegraded":"2024-09-13T18:43:38.722266+0000","last_fullsized":"2024-09-13T18:43:38.722266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:08.613249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:39:53.666153+0000","last_change":"2024-09-13T18:39:13.583221+0000","last_active":"2024-09-13T18:39:53.666153+0000","last_peered":"2024-09-13T18:39:53.666153+0000","last_clean":"2024-09-13T18:39:53.666153+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:39:53.666153+0000","last_undegraded":"2024-09-13T18:39:53.666153+0000","last_fullsized":"2024-09-13T18:39:53.666153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:19.897744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":199492,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":160,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":398984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705725,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306084,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065756,"statfs":{"total":96636764160,"available":96323334144,"internally_reserved":0,"allocated":421888,"data_stored":266388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.33900000000000002,"15min":0.32100000000000001},"min":{"1min":0.184,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":4.5049999999999999,"5min":4.5049999999999999,"15min":4.5049999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.20399999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"min":{"1min":0.191,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":3.8980000000000001,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.35699999999999998,"15min":0.33800000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.23499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":3,"5min":3,"15min":3},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":4.5590000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":0.46100000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705726,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306072,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065768,"statfs":{"total":96636764160,"available":96323346432,"internally_reserved":0,"allocated":409600,"data_stored":266680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.151,"5min":0.151,"15min":0.151},"max":{"1min":0.39400000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.193,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.376},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.35399999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705724,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306460,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065380,"statfs":{"total":96636764160,"available":96322949120,"internally_reserved":0,"allocated":806912,"data_stored":659023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.315},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.31,"5min":0.33300000000000002,"15min":0.32900000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52500000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.39600000000000002,"15min":0.35199999999999998},"min":{"1min":0.217,"5min":0.184,"15min":0.184},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.35899999999999999,"15min":0.34599999999999997},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.44}]},{"osd":3,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.42099999999999999,"15min":0.378},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.218},"max":{"1min":6.468,"5min":6.468,"15min":6.468},"last":0.42299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306464,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065376,"statfs":{"total":96636764160,"available":96322945024,"internally_reserved":0,"allocated":811008,"data_stored":659563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.29699999999999999,"15min":0.30399999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.43099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.33200000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.313,"15min":0.32100000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.371,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.315,"5min":0.33200000000000002,"15min":0.33700000000000002},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47799999999999998,"5min":0.5,"15min":0.5},"last":0.35499999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34699999999999998,"15min":0.35499999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.436}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":198706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":198395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:43:49.429 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.429 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.429 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.429 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.429 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.430 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.430 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.430 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.430 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.430 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.430 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.430 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.430 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.430 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.431 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.431 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.431 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.431 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.431 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.431 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.431 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.431 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.431 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.432 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.432 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.432 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.432 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.432 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.432 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.432 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.432 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.432 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.432 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.433 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.433 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.433 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.433 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.433 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.433 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.434 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.434 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.434 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.434 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.434 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.434 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.434 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.435 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.435 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.435 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.435 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.435 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.435 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.435 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.435 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.435 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.436 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.436 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T18:39:01.425159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.436 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.436 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.436 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.436 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.436 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.436 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.436 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.437 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.437 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.437 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.437 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.437 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.438 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.438 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.438 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.438 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.438 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.438 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.438 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.438 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.438 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.439 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.439 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.439 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.439 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.439 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.439 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.439 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.439 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.439 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.439 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.440 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.440 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.440 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.440 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.440 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.440 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.440 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.440 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.441 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.441 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.441 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.441 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.441 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.441 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.441 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.441 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.441 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:43:49.441 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:44:09.442 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:44:09.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.545+0000 7f469b91d640 1 Processor -- start 2024-09-13T18:44:09.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.545+0000 7f469b91d640 1 -- start start 2024-09-13T18:44:09.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f469b91d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f46940a32b0 0x7f469412f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:09.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f469b91d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f469412fed0 0x7f4694068970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:09.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f469b91d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46940a3680 con 0x7f4694068eb0 2024-09-13T18:44:09.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f469b91d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4694097460 con 0x7f46940a32b0 2024-09-13T18:44:09.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f469b91d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46941302c0 con 0x7f469412fed0 2024-09-13T18:44:09.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f46996b9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f46940a32b0 0x7f469412f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:09.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f4698eb8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f469412fed0 0x7f4694068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:09.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f46996b9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f46940a32b0 0x7f469412f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51318/0 (socket says 172.21.15.97:51318) 2024-09-13T18:44:09.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f46996b9640 1 -- 172.21.15.97:0/3840781708 learned_addr learned my addr 172.21.15.97:0/3840781708 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:44:09.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f4699eba640 1 --1- 172.21.15.97:0/3840781708 >> v1:172.21.15.97:6789/0 conn(0x7f4694068eb0 0x7f4694136760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46128/0 (socket says 172.21.15.97:46128) 2024-09-13T18:44:09.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f46996b9640 1 -- 172.21.15.97:0/3840781708 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f469412fed0 msgr2=0x7f4694068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:09.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f46996b9640 1 --2- 172.21.15.97:0/3840781708 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f469412fed0 0x7f4694068970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:09.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f46996b9640 1 -- 172.21.15.97:0/3840781708 >> v1:172.21.15.97:6789/0 conn(0x7f4694068eb0 legacy=0x7f4694136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:09.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f46996b9640 1 -- 172.21.15.97:0/3840781708 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469412d770 con 0x7f46940a32b0 2024-09-13T18:44:09.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f4693fff640 1 -- 172.21.15.97:0/3840781708 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473693712 0 0) 0x7f46940a3680 con 0x7f4694068eb0 2024-09-13T18:44:09.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.546+0000 7f4698eb8640 1 --2- 172.21.15.97:0/3840781708 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f469412fed0 0x7f4694068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:09.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.547+0000 7f46996b9640 1 --2- 172.21.15.97:0/3840781708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46940a32b0 0x7f469412f990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4684009910 tx=0x7f46840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2a4d501dcc546e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:09.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.547+0000 7f4693fff640 1 -- 172.21.15.97:0/3840781708 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468402adb0 con 0x7f46940a32b0 2024-09-13T18:44:09.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.547+0000 7f4693fff640 1 -- 172.21.15.97:0/3840781708 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4684032440 con 0x7f46940a32b0 2024-09-13T18:44:09.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.547+0000 7f4693fff640 1 -- 172.21.15.97:0/3840781708 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840327e0 con 0x7f46940a32b0 2024-09-13T18:44:09.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.548+0000 7f469b91d640 1 -- 172.21.15.97:0/3840781708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46940a32b0 msgr2=0x7f469412f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:09.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.548+0000 7f469b91d640 1 --2- 172.21.15.97:0/3840781708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46940a32b0 0x7f469412f990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4684009910 tx=0x7f46840091d0 comp rx=0 tx=0).stop 2024-09-13T18:44:09.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.548+0000 7f469b91d640 1 -- 172.21.15.97:0/3840781708 shutdown_connections 2024-09-13T18:44:09.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.548+0000 7f469b91d640 1 --2- 172.21.15.97:0/3840781708 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f469412fed0 0x7f4694068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:09.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.548+0000 7f469b91d640 1 --2- 172.21.15.97:0/3840781708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46940a32b0 0x7f469412f990 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.548+0000 7f469b91d640 1 -- 172.21.15.97:0/3840781708 >> 172.21.15.97:0/3840781708 conn(0x7f469406eef0 msgr2=0x7f46940a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.548+0000 7f469b91d640 1 -- 172.21.15.97:0/3840781708 shutdown_connections 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.548+0000 7f469b91d640 1 -- 172.21.15.97:0/3840781708 wait complete. 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.549+0000 7f469b91d640 1 Processor -- start 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.549+0000 7f469b91d640 1 -- start start 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.549+0000 7f469b91d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4694068eb0 0x7f469413ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.549+0000 7f469b91d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46940a32b0 0x7f469413ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.549+0000 7f469b91d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f469412fed0 0x7f46941190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.549+0000 7f469b91d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469411baf0 con 0x7f469412fed0 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.549+0000 7f469b91d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469411a5e0 con 0x7f46940a32b0 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.549+0000 7f469b91d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f469411bcd0 con 0x7f4694068eb0 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f46996b9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4694068eb0 0x7f469413ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f46996b9640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4694068eb0 0x7f469413ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:57736/0 (socket says 172.21.15.97:57736) 2024-09-13T18:44:09.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f4699eba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f469412fed0 0x7f46941190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:09.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f46996b9640 1 -- 172.21.15.97:0/3891701878 learned_addr learned my addr 172.21.15.97:0/3891701878 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:44:09.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f4698eb8640 1 --2- 172.21.15.97:0/3891701878 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46940a32b0 0x7f469413ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:09.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f46996b9640 1 -- 172.21.15.97:0/3891701878 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46940a32b0 msgr2=0x7f469413ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:09.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f46996b9640 1 --2- 172.21.15.97:0/3891701878 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46940a32b0 0x7f469413ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:09.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f46996b9640 1 -- 172.21.15.97:0/3891701878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f469412fed0 msgr2=0x7f46941190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:09.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f46996b9640 1 --2- 172.21.15.97:0/3891701878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f469412fed0 0x7f46941190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:09.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f46996b9640 1 -- 172.21.15.97:0/3891701878 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4688009a20 con 0x7f4694068eb0 2024-09-13T18:44:09.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f46996b9640 1 --2- 172.21.15.97:0/3891701878 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4694068eb0 0x7f469413ea30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f468402a7b0 tx=0x7f4684032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:09.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f46917fa640 1 -- 172.21.15.97:0/3891701878 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684000c40 con 0x7f4694068eb0 2024-09-13T18:44:09.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f46917fa640 1 -- 172.21.15.97:0/3891701878 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4684031a60 con 0x7f4694068eb0 2024-09-13T18:44:09.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f469b91d640 1 -- 172.21.15.97:0/3891701878 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4684009450 con 0x7f4694068eb0 2024-09-13T18:44:09.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f46917fa640 1 -- 172.21.15.97:0/3891701878 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684031e40 con 0x7f4694068eb0 2024-09-13T18:44:09.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.550+0000 7f469b91d640 1 -- 172.21.15.97:0/3891701878 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469409be20 con 0x7f4694068eb0 2024-09-13T18:44:09.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.551+0000 7f46917fa640 1 -- 172.21.15.97:0/3891701878 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f468403c610 con 0x7f4694068eb0 2024-09-13T18:44:09.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.551+0000 7f469b91d640 1 -- 172.21.15.97:0/3891701878 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4694064000 con 0x7f4694068eb0 2024-09-13T18:44:09.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.551+0000 7f46917fa640 1 -- 172.21.15.97:0/3891701878 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f4684062640 con 0x7f4694068eb0 2024-09-13T18:44:09.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.556+0000 7f46917fa640 1 -- 172.21.15.97:0/3891701878 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f4684037080 con 0x7f4694068eb0 2024-09-13T18:44:09.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.709+0000 7f469b91d640 1 -- 172.21.15.97:0/3891701878 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4694133810 con 0x7f4680031160 2024-09-13T18:44:09.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.715+0000 7f46917fa640 1 -- 172.21.15.97:0/3891701878 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275209 (unknown 2965378022 0 4084182070) 0x7f4694133810 con 0x7f4680031160 2024-09-13T18:44:09.721 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:44:09.722 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:44:09.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.718+0000 7f469b91d640 1 -- 172.21.15.97:0/3891701878 >> v1:172.21.15.97:6816/34603 conn(0x7f4680031160 legacy=0x7f4680033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:09.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.718+0000 7f469b91d640 1 -- 172.21.15.97:0/3891701878 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4694068eb0 msgr2=0x7f469413ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:09.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.718+0000 7f469b91d640 1 --2- 172.21.15.97:0/3891701878 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4694068eb0 0x7f469413ea30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f468402a7b0 tx=0x7f4684032000 comp rx=0 tx=0).stop 2024-09-13T18:44:09.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.719+0000 7f469b91d640 1 -- 172.21.15.97:0/3891701878 shutdown_connections 2024-09-13T18:44:09.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.719+0000 7f469b91d640 1 --2- 172.21.15.97:0/3891701878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f469412fed0 0x7f46941190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:09.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.719+0000 7f469b91d640 1 --2- 172.21.15.97:0/3891701878 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f46940a32b0 0x7f469413ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:09.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.719+0000 7f469b91d640 1 --2- 172.21.15.97:0/3891701878 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f4694068eb0 0x7f469413ea30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:09.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.719+0000 7f469b91d640 1 -- 172.21.15.97:0/3891701878 >> 172.21.15.97:0/3891701878 conn(0x7f469406eef0 msgr2=0x7f4694132530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:09.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.719+0000 7f469b91d640 1 -- 172.21.15.97:0/3891701878 shutdown_connections 2024-09-13T18:44:09.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:09.719+0000 7f469b91d640 1 -- 172.21.15.97:0/3891701878 wait complete. 2024-09-13T18:44:09.732 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-13T18:44:09.418040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":789879,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":60,"num_read_kb":50,"num_write":9457,"num_write_kb":25167188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9926,"ondisk_log_size":9926,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1225080,"kb_used_data":2392,"kb_used_omap":6,"kb_used_meta":1222649,"kb_avail":376262280,"statfs":{"total":386547056640,"available":385292574720,"internally_reserved":0,"allocated":2449408,"data_stored":1851654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1251992928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002907"},"pg_stats":[{"pgid":"4.3f","version":"23'146","reported_seq":159,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719662+0000","last_change":"2024-09-13T18:39:14.592723+0000","last_active":"2024-09-13T18:43:38.719662+0000","last_peered":"2024-09-13T18:43:38.719662+0000","last_clean":"2024-09-13T18:43:38.719662+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:43:38.719662+0000","last_undegraded":"2024-09-13T18:43:38.719662+0000","last_fullsized":"2024-09-13T18:43:38.719662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'130","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727670+0000","last_change":"2024-09-13T18:39:14.581266+0000","last_active":"2024-09-13T18:43:38.727670+0000","last_peered":"2024-09-13T18:43:38.727670+0000","last_clean":"2024-09-13T18:43:38.727670+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:43:38.727670+0000","last_undegraded":"2024-09-13T18:43:38.727670+0000","last_fullsized":"2024-09-13T18:43:38.727670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'151","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:54.481559+0000","last_change":"2024-09-13T18:43:54.481533+0000","last_active":"2024-09-13T18:43:54.481559+0000","last_peered":"2024-09-13T18:43:54.481559+0000","last_clean":"2024-09-13T18:43:54.481559+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:43:54.481559+0000","last_undegraded":"2024-09-13T18:43:54.481559+0000","last_fullsized":"2024-09-13T18:43:54.481559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-09-13T18:43:54.481437+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-09-13T18:43:54.481437+0000","last_clean_scrub_stamp":"2024-09-13T18:43:54.481437+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:14.609499+0000","scrub_duration":0.0021815789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"23'173","reported_seq":186,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.733636+0000","last_change":"2024-09-13T18:39:14.583960+0000","last_active":"2024-09-13T18:43:38.733636+0000","last_peered":"2024-09-13T18:43:38.733636+0000","last_clean":"2024-09-13T18:43:38.733636+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:43:38.733636+0000","last_undegraded":"2024-09-13T18:43:38.733636+0000","last_fullsized":"2024-09-13T18:43:38.733636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"23'148","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737162+0000","last_change":"2024-09-13T18:39:14.577865+0000","last_active":"2024-09-13T18:43:38.737162+0000","last_peered":"2024-09-13T18:43:38.737162+0000","last_clean":"2024-09-13T18:43:38.737162+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:43:38.737162+0000","last_undegraded":"2024-09-13T18:43:38.737162+0000","last_fullsized":"2024-09-13T18:43:38.737162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'135","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731955+0000","last_change":"2024-09-13T18:39:14.590785+0000","last_active":"2024-09-13T18:43:38.731955+0000","last_peered":"2024-09-13T18:43:38.731955+0000","last_clean":"2024-09-13T18:43:38.731955+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:43:38.731955+0000","last_undegraded":"2024-09-13T18:43:38.731955+0000","last_fullsized":"2024-09-13T18:43:38.731955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'164","reported_seq":177,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738539+0000","last_change":"2024-09-13T18:39:14.590893+0000","last_active":"2024-09-13T18:43:38.738539+0000","last_peered":"2024-09-13T18:43:38.738539+0000","last_clean":"2024-09-13T18:43:38.738539+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:43:38.738539+0000","last_undegraded":"2024-09-13T18:43:38.738539+0000","last_fullsized":"2024-09-13T18:43:38.738539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'186","reported_seq":199,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717791+0000","last_change":"2024-09-13T18:39:14.595160+0000","last_active":"2024-09-13T18:43:38.717791+0000","last_peered":"2024-09-13T18:43:38.717791+0000","last_clean":"2024-09-13T18:43:38.717791+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:43:38.717791+0000","last_undegraded":"2024-09-13T18:43:38.717791+0000","last_fullsized":"2024-09-13T18:43:38.717791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"23'152","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.726476+0000","last_change":"2024-09-13T18:39:14.586790+0000","last_active":"2024-09-13T18:43:38.726476+0000","last_peered":"2024-09-13T18:43:38.726476+0000","last_clean":"2024-09-13T18:43:38.726476+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:43:38.726476+0000","last_undegraded":"2024-09-13T18:43:38.726476+0000","last_fullsized":"2024-09-13T18:43:38.726476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'156","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736110+0000","last_change":"2024-09-13T18:39:14.591231+0000","last_active":"2024-09-13T18:43:38.736110+0000","last_peered":"2024-09-13T18:43:38.736110+0000","last_clean":"2024-09-13T18:43:38.736110+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:43:38.736110+0000","last_undegraded":"2024-09-13T18:43:38.736110+0000","last_fullsized":"2024-09-13T18:43:38.736110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"23'189","reported_seq":212,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:57.776603+0000","last_change":"2024-09-13T18:43:57.776571+0000","last_active":"2024-09-13T18:43:57.776603+0000","last_peered":"2024-09-13T18:43:57.776603+0000","last_clean":"2024-09-13T18:43:57.776603+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:43:57.776603+0000","last_undegraded":"2024-09-13T18:43:57.776603+0000","last_fullsized":"2024-09-13T18:43:57.776603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'189","last_scrub_stamp":"2024-09-13T18:43:57.776474+0000","last_deep_scrub":"23'189","last_deep_scrub_stamp":"2024-09-13T18:43:57.776474+0000","last_clean_scrub_stamp":"2024-09-13T18:43:57.776474+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:17.904536+0000","scrub_duration":0.0023429969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"23'142","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.716541+0000","last_change":"2024-09-13T18:39:14.592629+0000","last_active":"2024-09-13T18:43:38.716541+0000","last_peered":"2024-09-13T18:43:38.716541+0000","last_clean":"2024-09-13T18:43:38.716541+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:43:38.716541+0000","last_undegraded":"2024-09-13T18:43:38.716541+0000","last_fullsized":"2024-09-13T18:43:38.716541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'151","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739070+0000","last_change":"2024-09-13T18:39:14.597709+0000","last_active":"2024-09-13T18:43:38.739070+0000","last_peered":"2024-09-13T18:43:38.739070+0000","last_clean":"2024-09-13T18:43:38.739070+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:43:38.739070+0000","last_undegraded":"2024-09-13T18:43:38.739070+0000","last_fullsized":"2024-09-13T18:43:38.739070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'149","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737073+0000","last_change":"2024-09-13T18:39:14.572267+0000","last_active":"2024-09-13T18:43:38.737073+0000","last_peered":"2024-09-13T18:43:38.737073+0000","last_clean":"2024-09-13T18:43:38.737073+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:43:38.737073+0000","last_undegraded":"2024-09-13T18:43:38.737073+0000","last_fullsized":"2024-09-13T18:43:38.737073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"23'151","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:52.482503+0000","last_change":"2024-09-13T18:43:52.482459+0000","last_active":"2024-09-13T18:43:52.482503+0000","last_peered":"2024-09-13T18:43:52.482503+0000","last_clean":"2024-09-13T18:43:52.482503+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:43:52.482503+0000","last_undegraded":"2024-09-13T18:43:52.482503+0000","last_fullsized":"2024-09-13T18:43:52.482503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-09-13T18:43:52.482365+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-09-13T18:43:52.482365+0000","last_clean_scrub_stamp":"2024-09-13T18:43:52.482365+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:01.098502+0000","scrub_duration":0.002317221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"23'147","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741591+0000","last_change":"2024-09-13T18:39:14.592378+0000","last_active":"2024-09-13T18:43:38.741591+0000","last_peered":"2024-09-13T18:43:38.741591+0000","last_clean":"2024-09-13T18:43:38.741591+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:43:38.741591+0000","last_undegraded":"2024-09-13T18:43:38.741591+0000","last_fullsized":"2024-09-13T18:43:38.741591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'146","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:02.509096+0000","last_change":"2024-09-13T18:44:02.509068+0000","last_active":"2024-09-13T18:44:02.509096+0000","last_peered":"2024-09-13T18:44:02.509096+0000","last_clean":"2024-09-13T18:44:02.509096+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:44:02.509096+0000","last_undegraded":"2024-09-13T18:44:02.509096+0000","last_fullsized":"2024-09-13T18:44:02.509096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'146","last_scrub_stamp":"2024-09-13T18:44:02.508957+0000","last_deep_scrub":"23'146","last_deep_scrub_stamp":"2024-09-13T18:44:02.508957+0000","last_clean_scrub_stamp":"2024-09-13T18:44:02.508957+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:56.954687+0000","scrub_duration":0.0021744939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'157","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740152+0000","last_change":"2024-09-13T18:39:14.587172+0000","last_active":"2024-09-13T18:43:38.740152+0000","last_peered":"2024-09-13T18:43:38.740152+0000","last_clean":"2024-09-13T18:43:38.740152+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:43:38.740152+0000","last_undegraded":"2024-09-13T18:43:38.740152+0000","last_fullsized":"2024-09-13T18:43:38.740152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"23'172","reported_seq":195,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:51.707972+0000","last_change":"2024-09-13T18:43:51.707927+0000","last_active":"2024-09-13T18:43:51.707972+0000","last_peered":"2024-09-13T18:43:51.707972+0000","last_clean":"2024-09-13T18:43:51.707972+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:43:51.707972+0000","last_undegraded":"2024-09-13T18:43:51.707972+0000","last_fullsized":"2024-09-13T18:43:51.707972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'172","last_scrub_stamp":"2024-09-13T18:43:51.707829+0000","last_deep_scrub":"23'172","last_deep_scrub_stamp":"2024-09-13T18:43:51.707829+0000","last_clean_scrub_stamp":"2024-09-13T18:43:51.707829+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:11.835892+0000","scrub_duration":0.002475564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'161","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739716+0000","last_change":"2024-09-13T18:39:14.585973+0000","last_active":"2024-09-13T18:43:38.739716+0000","last_peered":"2024-09-13T18:43:38.739716+0000","last_clean":"2024-09-13T18:43:38.739716+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:43:38.739716+0000","last_undegraded":"2024-09-13T18:43:38.739716+0000","last_fullsized":"2024-09-13T18:43:38.739716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"23'137","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:03.709035+0000","last_change":"2024-09-13T18:44:03.708966+0000","last_active":"2024-09-13T18:44:03.709035+0000","last_peered":"2024-09-13T18:44:03.709035+0000","last_clean":"2024-09-13T18:44:03.709035+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:44:03.709035+0000","last_undegraded":"2024-09-13T18:44:03.709035+0000","last_fullsized":"2024-09-13T18:44:03.709035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'137","last_scrub_stamp":"2024-09-13T18:44:03.708829+0000","last_deep_scrub":"23'137","last_deep_scrub_stamp":"2024-09-13T18:44:03.708829+0000","last_clean_scrub_stamp":"2024-09-13T18:44:03.708829+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.890108+0000","scrub_duration":0.0021117660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"23'166","reported_seq":189,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:48.471538+0000","last_change":"2024-09-13T18:43:48.471516+0000","last_active":"2024-09-13T18:43:48.471538+0000","last_peered":"2024-09-13T18:43:48.471538+0000","last_clean":"2024-09-13T18:43:48.471538+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:43:48.471538+0000","last_undegraded":"2024-09-13T18:43:48.471538+0000","last_fullsized":"2024-09-13T18:43:48.471538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'166","last_scrub_stamp":"2024-09-13T18:43:48.471441+0000","last_deep_scrub":"23'166","last_deep_scrub_stamp":"2024-09-13T18:43:48.471441+0000","last_clean_scrub_stamp":"2024-09-13T18:43:48.471441+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:13.500560+0000","scrub_duration":0.0020110710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'134","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738567+0000","last_change":"2024-09-13T18:39:14.590724+0000","last_active":"2024-09-13T18:43:38.738567+0000","last_peered":"2024-09-13T18:43:38.738567+0000","last_clean":"2024-09-13T18:43:38.738567+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:43:38.738567+0000","last_undegraded":"2024-09-13T18:43:38.738567+0000","last_fullsized":"2024-09-13T18:43:38.738567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"23'180","reported_seq":193,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731930+0000","last_change":"2024-09-13T18:39:14.577642+0000","last_active":"2024-09-13T18:43:38.731930+0000","last_peered":"2024-09-13T18:43:38.731930+0000","last_clean":"2024-09-13T18:43:38.731930+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:43:38.731930+0000","last_undegraded":"2024-09-13T18:43:38.731930+0000","last_fullsized":"2024-09-13T18:43:38.731930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"23'134","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:04.699685+0000","last_change":"2024-09-13T18:44:04.699659+0000","last_active":"2024-09-13T18:44:04.699685+0000","last_peered":"2024-09-13T18:44:04.699685+0000","last_clean":"2024-09-13T18:44:04.699685+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:44:04.699685+0000","last_undegraded":"2024-09-13T18:44:04.699685+0000","last_fullsized":"2024-09-13T18:44:04.699685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'134","last_scrub_stamp":"2024-09-13T18:44:04.699563+0000","last_deep_scrub":"23'134","last_deep_scrub_stamp":"2024-09-13T18:44:04.699563+0000","last_clean_scrub_stamp":"2024-09-13T18:44:04.699563+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:01.099849+0000","scrub_duration":0.0021420480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'198","reported_seq":221,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:48.832232+0000","last_change":"2024-09-13T18:43:48.832211+0000","last_active":"2024-09-13T18:43:48.832232+0000","last_peered":"2024-09-13T18:43:48.832232+0000","last_clean":"2024-09-13T18:43:48.832232+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:43:48.832232+0000","last_undegraded":"2024-09-13T18:43:48.832232+0000","last_fullsized":"2024-09-13T18:43:48.832232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'198","last_scrub_stamp":"2024-09-13T18:43:48.832137+0000","last_deep_scrub":"23'198","last_deep_scrub_stamp":"2024-09-13T18:43:48.832137+0000","last_clean_scrub_stamp":"2024-09-13T18:43:48.832137+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:46.877580+0000","scrub_duration":0.00187283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'144","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.729145+0000","last_change":"2024-09-13T18:39:14.594222+0000","last_active":"2024-09-13T18:43:38.729145+0000","last_peered":"2024-09-13T18:43:38.729145+0000","last_clean":"2024-09-13T18:43:38.729145+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:43:38.729145+0000","last_undegraded":"2024-09-13T18:43:38.729145+0000","last_fullsized":"2024-09-13T18:43:38.729145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'133","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:01.731808+0000","last_change":"2024-09-13T18:44:01.731780+0000","last_active":"2024-09-13T18:44:01.731808+0000","last_peered":"2024-09-13T18:44:01.731808+0000","last_clean":"2024-09-13T18:44:01.731808+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:44:01.731808+0000","last_undegraded":"2024-09-13T18:44:01.731808+0000","last_fullsized":"2024-09-13T18:44:01.731808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'133","last_scrub_stamp":"2024-09-13T18:44:01.731680+0000","last_deep_scrub":"23'133","last_deep_scrub_stamp":"2024-09-13T18:44:01.731680+0000","last_clean_scrub_stamp":"2024-09-13T18:44:01.731680+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:51.427166+0000","scrub_duration":0.0020361139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"23'118","reported_seq":131,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741177+0000","last_change":"2024-09-13T18:39:14.586374+0000","last_active":"2024-09-13T18:43:38.741177+0000","last_peered":"2024-09-13T18:43:38.741177+0000","last_clean":"2024-09-13T18:43:38.741177+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:43:38.741177+0000","last_undegraded":"2024-09-13T18:43:38.741177+0000","last_fullsized":"2024-09-13T18:43:38.741177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'131","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:58.440745+0000","last_change":"2024-09-13T18:43:58.440702+0000","last_active":"2024-09-13T18:43:58.440745+0000","last_peered":"2024-09-13T18:43:58.440745+0000","last_clean":"2024-09-13T18:43:58.440745+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:43:58.440745+0000","last_undegraded":"2024-09-13T18:43:58.440745+0000","last_fullsized":"2024-09-13T18:43:58.440745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-09-13T18:43:58.440608+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-09-13T18:43:58.440608+0000","last_clean_scrub_stamp":"2024-09-13T18:43:58.440608+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:48.136093+0000","scrub_duration":0.00209691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"23'135","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740554+0000","last_change":"2024-09-13T18:39:14.580898+0000","last_active":"2024-09-13T18:43:38.740554+0000","last_peered":"2024-09-13T18:43:38.740554+0000","last_clean":"2024-09-13T18:43:38.740554+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:43:38.740554+0000","last_undegraded":"2024-09-13T18:43:38.740554+0000","last_fullsized":"2024-09-13T18:43:38.740554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"23'150","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717082+0000","last_change":"2024-09-13T18:39:14.574811+0000","last_active":"2024-09-13T18:43:38.717082+0000","last_peered":"2024-09-13T18:43:38.717082+0000","last_clean":"2024-09-13T18:43:38.717082+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:43:38.717082+0000","last_undegraded":"2024-09-13T18:43:38.717082+0000","last_fullsized":"2024-09-13T18:43:38.717082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"23'149","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731603+0000","last_change":"2024-09-13T18:39:14.579494+0000","last_active":"2024-09-13T18:43:38.731603+0000","last_peered":"2024-09-13T18:43:38.731603+0000","last_clean":"2024-09-13T18:43:38.731603+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:43:38.731603+0000","last_undegraded":"2024-09-13T18:43:38.731603+0000","last_fullsized":"2024-09-13T18:43:38.731603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.663071+0000","last_change":"2024-09-13T18:39:13.575179+0000","last_active":"2024-09-13T18:39:54.663071+0000","last_peered":"2024-09-13T18:39:54.663071+0000","last_clean":"2024-09-13T18:39:54.663071+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:39:54.663071+0000","last_undegraded":"2024-09-13T18:39:54.663071+0000","last_fullsized":"2024-09-13T18:39:54.663071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"23'150","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:50.732202+0000","last_change":"2024-09-13T18:43:50.732167+0000","last_active":"2024-09-13T18:43:50.732202+0000","last_peered":"2024-09-13T18:43:50.732202+0000","last_clean":"2024-09-13T18:43:50.732202+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:43:50.732202+0000","last_undegraded":"2024-09-13T18:43:50.732202+0000","last_fullsized":"2024-09-13T18:43:50.732202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'150","last_scrub_stamp":"2024-09-13T18:43:50.732031+0000","last_deep_scrub":"23'150","last_deep_scrub_stamp":"2024-09-13T18:43:50.732031+0000","last_clean_scrub_stamp":"2024-09-13T18:43:50.732031+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:46.913310+0000","scrub_duration":0.0023725059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.665330+0000","last_change":"2024-09-13T18:39:13.570778+0000","last_active":"2024-09-13T18:39:54.665330+0000","last_peered":"2024-09-13T18:39:54.665330+0000","last_clean":"2024-09-13T18:39:54.665330+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:39:54.665330+0000","last_undegraded":"2024-09-13T18:39:54.665330+0000","last_fullsized":"2024-09-13T18:39:54.665330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"23'229","reported_seq":251,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740210+0000","last_change":"2024-09-13T18:39:54.668508+0000","last_active":"2024-09-13T18:43:38.740210+0000","last_peered":"2024-09-13T18:43:38.740210+0000","last_clean":"2024-09-13T18:43:38.740210+0000","last_became_active":"2024-09-13T18:39:54.668035+0000","last_became_peered":"2024-09-13T18:39:54.668035+0000","last_unstale":"2024-09-13T18:43:38.740210+0000","last_undegraded":"2024-09-13T18:43:38.740210+0000","last_fullsized":"2024-09-13T18:43:38.740210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.662956+0000","last_change":"2024-09-13T18:39:13.575436+0000","last_active":"2024-09-13T18:39:54.662956+0000","last_peered":"2024-09-13T18:39:54.662956+0000","last_clean":"2024-09-13T18:39:54.662956+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:39:54.662956+0000","last_undegraded":"2024-09-13T18:39:54.662956+0000","last_fullsized":"2024-09-13T18:39:54.662956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'141","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738045+0000","last_change":"2024-09-13T18:39:14.584791+0000","last_active":"2024-09-13T18:43:38.738045+0000","last_peered":"2024-09-13T18:43:38.738045+0000","last_clean":"2024-09-13T18:43:38.738045+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:43:38.738045+0000","last_undegraded":"2024-09-13T18:43:38.738045+0000","last_fullsized":"2024-09-13T18:43:38.738045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'9","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.439512+0000","last_change":"2024-09-13T18:39:13.578940+0000","last_active":"2024-09-13T18:43:37.439512+0000","last_peered":"2024-09-13T18:43:37.439512+0000","last_clean":"2024-09-13T18:43:37.439512+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:43:37.439512+0000","last_undegraded":"2024-09-13T18:43:37.439512+0000","last_fullsized":"2024-09-13T18:43:37.439512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.666141+0000","last_change":"2024-09-13T18:39:13.583184+0000","last_active":"2024-09-13T18:39:54.666141+0000","last_peered":"2024-09-13T18:39:54.666141+0000","last_clean":"2024-09-13T18:39:54.666141+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:39:54.666141+0000","last_undegraded":"2024-09-13T18:39:54.666141+0000","last_fullsized":"2024-09-13T18:39:54.666141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"23'153","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741462+0000","last_change":"2024-09-13T18:39:54.668672+0000","last_active":"2024-09-13T18:43:38.741462+0000","last_peered":"2024-09-13T18:43:38.741462+0000","last_clean":"2024-09-13T18:43:38.741462+0000","last_became_active":"2024-09-13T18:39:54.668322+0000","last_became_peered":"2024-09-13T18:39:54.668322+0000","last_unstale":"2024-09-13T18:43:38.741462+0000","last_undegraded":"2024-09-13T18:43:38.741462+0000","last_fullsized":"2024-09-13T18:43:38.741462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.663544+0000","last_change":"2024-09-13T18:39:13.571043+0000","last_active":"2024-09-13T18:39:54.663544+0000","last_peered":"2024-09-13T18:39:54.663544+0000","last_clean":"2024-09-13T18:39:54.663544+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:39:54.663544+0000","last_undegraded":"2024-09-13T18:39:54.663544+0000","last_fullsized":"2024-09-13T18:39:54.663544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'134","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:52.779568+0000","last_change":"2024-09-13T18:43:52.779541+0000","last_active":"2024-09-13T18:43:52.779568+0000","last_peered":"2024-09-13T18:43:52.779568+0000","last_clean":"2024-09-13T18:43:52.779568+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:43:52.779568+0000","last_undegraded":"2024-09-13T18:43:52.779568+0000","last_fullsized":"2024-09-13T18:43:52.779568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'134","last_scrub_stamp":"2024-09-13T18:43:52.779447+0000","last_deep_scrub":"23'134","last_deep_scrub_stamp":"2024-09-13T18:43:52.779447+0000","last_clean_scrub_stamp":"2024-09-13T18:43:52.779447+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:10.283130+0000","scrub_duration":0.0020289090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664406+0000","last_change":"2024-09-13T18:39:13.581627+0000","last_active":"2024-09-13T18:39:54.664406+0000","last_peered":"2024-09-13T18:39:54.664406+0000","last_clean":"2024-09-13T18:39:54.664406+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:39:54.664406+0000","last_undegraded":"2024-09-13T18:39:54.664406+0000","last_fullsized":"2024-09-13T18:39:54.664406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'128","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:57.708932+0000","last_change":"2024-09-13T18:43:57.708904+0000","last_active":"2024-09-13T18:43:57.708932+0000","last_peered":"2024-09-13T18:43:57.708932+0000","last_clean":"2024-09-13T18:43:57.708932+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:43:57.708932+0000","last_undegraded":"2024-09-13T18:43:57.708932+0000","last_fullsized":"2024-09-13T18:43:57.708932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'128","last_scrub_stamp":"2024-09-13T18:43:57.708808+0000","last_deep_scrub":"23'128","last_deep_scrub_stamp":"2024-09-13T18:43:57.708808+0000","last_clean_scrub_stamp":"2024-09-13T18:43:57.708808+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:53.890087+0000","scrub_duration":0.0020534289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664143+0000","last_change":"2024-09-13T18:39:13.570169+0000","last_active":"2024-09-13T18:39:54.664143+0000","last_peered":"2024-09-13T18:39:54.664143+0000","last_clean":"2024-09-13T18:39:54.664143+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:39:54.664143+0000","last_undegraded":"2024-09-13T18:39:54.664143+0000","last_fullsized":"2024-09-13T18:39:54.664143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"23'143","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727442+0000","last_change":"2024-09-13T18:39:14.584580+0000","last_active":"2024-09-13T18:43:38.727442+0000","last_peered":"2024-09-13T18:43:38.727442+0000","last_clean":"2024-09-13T18:43:38.727442+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:43:38.727442+0000","last_undegraded":"2024-09-13T18:43:38.727442+0000","last_fullsized":"2024-09-13T18:43:38.727442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:42:19.743794+0000","last_change":"2024-09-13T18:39:13.575713+0000","last_active":"2024-09-13T18:42:19.743794+0000","last_peered":"2024-09-13T18:42:19.743794+0000","last_clean":"2024-09-13T18:42:19.743794+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:42:19.743794+0000","last_undegraded":"2024-09-13T18:42:19.743794+0000","last_fullsized":"2024-09-13T18:42:19.743794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'144","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:49.448761+0000","last_change":"2024-09-13T18:43:49.448742+0000","last_active":"2024-09-13T18:43:49.448761+0000","last_peered":"2024-09-13T18:43:49.448761+0000","last_clean":"2024-09-13T18:43:49.448761+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:43:49.448761+0000","last_undegraded":"2024-09-13T18:43:49.448761+0000","last_fullsized":"2024-09-13T18:43:49.448761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'144","last_scrub_stamp":"2024-09-13T18:43:49.448666+0000","last_deep_scrub":"23'144","last_deep_scrub_stamp":"2024-09-13T18:43:49.448666+0000","last_clean_scrub_stamp":"2024-09-13T18:43:49.448666+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:13.477250+0000","scrub_duration":0.0016535639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:53.634394+0000","last_change":"2024-09-13T18:43:53.634366+0000","last_active":"2024-09-13T18:43:53.634394+0000","last_peered":"2024-09-13T18:43:53.634394+0000","last_clean":"2024-09-13T18:43:53.634394+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:43:53.634394+0000","last_undegraded":"2024-09-13T18:43:53.634394+0000","last_fullsized":"2024-09-13T18:43:53.634394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:53.634259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:53.634259+0000","last_clean_scrub_stamp":"2024-09-13T18:43:53.634259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:48.079989+0000","scrub_duration":0.0013690830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'151","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734462+0000","last_change":"2024-09-13T18:39:14.584122+0000","last_active":"2024-09-13T18:43:38.734462+0000","last_peered":"2024-09-13T18:43:38.734462+0000","last_clean":"2024-09-13T18:43:38.734462+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:43:38.734462+0000","last_undegraded":"2024-09-13T18:43:38.734462+0000","last_fullsized":"2024-09-13T18:43:38.734462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.663042+0000","last_change":"2024-09-13T18:39:13.575316+0000","last_active":"2024-09-13T18:39:54.663042+0000","last_peered":"2024-09-13T18:39:54.663042+0000","last_clean":"2024-09-13T18:39:54.663042+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:39:54.663042+0000","last_undegraded":"2024-09-13T18:39:54.663042+0000","last_fullsized":"2024-09-13T18:39:54.663042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'146","reported_seq":159,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719511+0000","last_change":"2024-09-13T18:39:14.593058+0000","last_active":"2024-09-13T18:43:38.719511+0000","last_peered":"2024-09-13T18:43:38.719511+0000","last_clean":"2024-09-13T18:43:38.719511+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:43:38.719511+0000","last_undegraded":"2024-09-13T18:43:38.719511+0000","last_fullsized":"2024-09-13T18:43:38.719511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:56.691083+0000","last_change":"2024-09-13T18:43:56.691044+0000","last_active":"2024-09-13T18:43:56.691083+0000","last_peered":"2024-09-13T18:43:56.691083+0000","last_clean":"2024-09-13T18:43:56.691083+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:43:56.691083+0000","last_undegraded":"2024-09-13T18:43:56.691083+0000","last_fullsized":"2024-09-13T18:43:56.691083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:56.690932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:56.690932+0000","last_clean_scrub_stamp":"2024-09-13T18:43:56.690932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:08.734413+0000","scrub_duration":0.0015086730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'138","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:56.782349+0000","last_change":"2024-09-13T18:43:56.782319+0000","last_active":"2024-09-13T18:43:56.782349+0000","last_peered":"2024-09-13T18:43:56.782349+0000","last_clean":"2024-09-13T18:43:56.782349+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:43:56.782349+0000","last_undegraded":"2024-09-13T18:43:56.782349+0000","last_fullsized":"2024-09-13T18:43:56.782349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'138","last_scrub_stamp":"2024-09-13T18:43:56.782222+0000","last_deep_scrub":"23'138","last_deep_scrub_stamp":"2024-09-13T18:43:56.782222+0000","last_clean_scrub_stamp":"2024-09-13T18:43:56.782222+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.423073+0000","scrub_duration":0.001943909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":88,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.663596+0000","last_change":"2024-09-13T18:39:03.413753+0000","last_active":"2024-09-13T18:39:54.663596+0000","last_peered":"2024-09-13T18:39:54.663596+0000","last_clean":"2024-09-13T18:39:54.663596+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:39:54.663596+0000","last_undegraded":"2024-09-13T18:39:54.663596+0000","last_fullsized":"2024-09-13T18:39:54.663596+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:01.425159+0000","last_clean_scrub_stamp":"2024-09-13T18:39:01.425159+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664142+0000","last_change":"2024-09-13T18:39:09.531787+0000","last_active":"2024-09-13T18:39:54.664142+0000","last_peered":"2024-09-13T18:39:54.664142+0000","last_clean":"2024-09-13T18:39:54.664142+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:39:54.664142+0000","last_undegraded":"2024-09-13T18:39:54.664142+0000","last_fullsized":"2024-09-13T18:39:54.664142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:02.713921+0000","last_change":"2024-09-13T18:44:02.713894+0000","last_active":"2024-09-13T18:44:02.713921+0000","last_peered":"2024-09-13T18:44:02.713921+0000","last_clean":"2024-09-13T18:44:02.713921+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:44:02.713921+0000","last_undegraded":"2024-09-13T18:44:02.713921+0000","last_fullsized":"2024-09-13T18:44:02.713921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:02.713794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:02.713794+0000","last_clean_scrub_stamp":"2024-09-13T18:44:02.713794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:39.673817+0000","scrub_duration":0.001383649,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'143","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731187+0000","last_change":"2024-09-13T18:39:54.668486+0000","last_active":"2024-09-13T18:43:38.731187+0000","last_peered":"2024-09-13T18:43:38.731187+0000","last_clean":"2024-09-13T18:43:38.731187+0000","last_became_active":"2024-09-13T18:39:54.668177+0000","last_became_peered":"2024-09-13T18:39:54.668177+0000","last_unstale":"2024-09-13T18:43:38.731187+0000","last_undegraded":"2024-09-13T18:43:38.731187+0000","last_fullsized":"2024-09-13T18:43:38.731187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.662354+0000","last_change":"2024-09-13T18:39:09.531377+0000","last_active":"2024-09-13T18:39:54.662354+0000","last_peered":"2024-09-13T18:39:54.662354+0000","last_clean":"2024-09-13T18:39:54.662354+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:39:54.662354+0000","last_undegraded":"2024-09-13T18:39:54.662354+0000","last_fullsized":"2024-09-13T18:39:54.662354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.438318+0000","last_change":"2024-09-13T18:39:13.563570+0000","last_active":"2024-09-13T18:43:37.438318+0000","last_peered":"2024-09-13T18:43:37.438318+0000","last_clean":"2024-09-13T18:43:37.438318+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:43:37.438318+0000","last_undegraded":"2024-09-13T18:43:37.438318+0000","last_fullsized":"2024-09-13T18:43:37.438318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'163","reported_seq":186,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:00.482872+0000","last_change":"2024-09-13T18:44:00.482832+0000","last_active":"2024-09-13T18:44:00.482872+0000","last_peered":"2024-09-13T18:44:00.482872+0000","last_clean":"2024-09-13T18:44:00.482872+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:44:00.482872+0000","last_undegraded":"2024-09-13T18:44:00.482872+0000","last_fullsized":"2024-09-13T18:44:00.482872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'163","last_scrub_stamp":"2024-09-13T18:44:00.482724+0000","last_deep_scrub":"23'163","last_deep_scrub_stamp":"2024-09-13T18:44:00.482724+0000","last_clean_scrub_stamp":"2024-09-13T18:44:00.482724+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:56.664003+0000","scrub_duration":0.0023912109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:58.706954+0000","last_change":"2024-09-13T18:43:58.706931+0000","last_active":"2024-09-13T18:43:58.706954+0000","last_peered":"2024-09-13T18:43:58.706954+0000","last_clean":"2024-09-13T18:43:58.706954+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:43:58.706954+0000","last_undegraded":"2024-09-13T18:43:58.706954+0000","last_fullsized":"2024-09-13T18:43:58.706954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:58.706831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:58.706831+0000","last_clean_scrub_stamp":"2024-09-13T18:43:58.706831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:55.107117+0000","scrub_duration":0.001356496,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.663510+0000","last_change":"2024-09-13T18:39:13.579066+0000","last_active":"2024-09-13T18:39:54.663510+0000","last_peered":"2024-09-13T18:39:54.663510+0000","last_clean":"2024-09-13T18:39:54.663510+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:39:54.663510+0000","last_undegraded":"2024-09-13T18:39:54.663510+0000","last_fullsized":"2024-09-13T18:39:54.663510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'143","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:50.837495+0000","last_change":"2024-09-13T18:43:50.837457+0000","last_active":"2024-09-13T18:43:50.837495+0000","last_peered":"2024-09-13T18:43:50.837495+0000","last_clean":"2024-09-13T18:43:50.837495+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:43:50.837495+0000","last_undegraded":"2024-09-13T18:43:50.837495+0000","last_fullsized":"2024-09-13T18:43:50.837495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'143","last_scrub_stamp":"2024-09-13T18:43:50.837363+0000","last_deep_scrub":"23'143","last_deep_scrub_stamp":"2024-09-13T18:43:50.837363+0000","last_clean_scrub_stamp":"2024-09-13T18:43:50.837363+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:24.539015+0000","scrub_duration":0.002064204,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.662493+0000","last_change":"2024-09-13T18:39:09.532311+0000","last_active":"2024-09-13T18:39:54.662493+0000","last_peered":"2024-09-13T18:39:54.662493+0000","last_clean":"2024-09-13T18:39:54.662493+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:39:54.662493+0000","last_undegraded":"2024-09-13T18:39:54.662493+0000","last_fullsized":"2024-09-13T18:39:54.662493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.665888+0000","last_change":"2024-09-13T18:39:13.571488+0000","last_active":"2024-09-13T18:39:54.665888+0000","last_peered":"2024-09-13T18:39:54.665888+0000","last_clean":"2024-09-13T18:39:54.665888+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:39:54.665888+0000","last_undegraded":"2024-09-13T18:39:54.665888+0000","last_fullsized":"2024-09-13T18:39:54.665888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"23'144","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739562+0000","last_change":"2024-09-13T18:39:14.579779+0000","last_active":"2024-09-13T18:43:38.739562+0000","last_peered":"2024-09-13T18:43:38.739562+0000","last_clean":"2024-09-13T18:43:38.739562+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:43:38.739562+0000","last_undegraded":"2024-09-13T18:43:38.739562+0000","last_fullsized":"2024-09-13T18:43:38.739562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:59.744352+0000","last_change":"2024-09-13T18:43:59.744323+0000","last_active":"2024-09-13T18:43:59.744352+0000","last_peered":"2024-09-13T18:43:59.744352+0000","last_clean":"2024-09-13T18:43:59.744352+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:43:59.744352+0000","last_undegraded":"2024-09-13T18:43:59.744352+0000","last_fullsized":"2024-09-13T18:43:59.744352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:59.744215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:59.744215+0000","last_clean_scrub_stamp":"2024-09-13T18:43:59.744215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:54.189945+0000","scrub_duration":0.0013975039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.661958+0000","last_change":"2024-09-13T18:39:09.533091+0000","last_active":"2024-09-13T18:39:54.661958+0000","last_peered":"2024-09-13T18:39:54.661958+0000","last_clean":"2024-09-13T18:39:54.661958+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:39:54.661958+0000","last_undegraded":"2024-09-13T18:39:54.661958+0000","last_fullsized":"2024-09-13T18:39:54.661958+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"23'158","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.735333+0000","last_change":"2024-09-13T18:39:14.597238+0000","last_active":"2024-09-13T18:43:38.735333+0000","last_peered":"2024-09-13T18:43:38.735333+0000","last_clean":"2024-09-13T18:43:38.735333+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:43:38.735333+0000","last_undegraded":"2024-09-13T18:43:38.735333+0000","last_fullsized":"2024-09-13T18:43:38.735333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.661807+0000","last_change":"2024-09-13T18:39:13.583071+0000","last_active":"2024-09-13T18:39:54.661807+0000","last_peered":"2024-09-13T18:39:54.661807+0000","last_clean":"2024-09-13T18:39:54.661807+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:39:54.661807+0000","last_undegraded":"2024-09-13T18:39:54.661807+0000","last_fullsized":"2024-09-13T18:39:54.661807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664478+0000","last_change":"2024-09-13T18:39:09.532042+0000","last_active":"2024-09-13T18:39:54.664478+0000","last_peered":"2024-09-13T18:39:54.664478+0000","last_clean":"2024-09-13T18:39:54.664478+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:39:54.664478+0000","last_undegraded":"2024-09-13T18:39:54.664478+0000","last_fullsized":"2024-09-13T18:39:54.664478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"23'145","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717400+0000","last_change":"2024-09-13T18:39:14.584428+0000","last_active":"2024-09-13T18:43:38.717400+0000","last_peered":"2024-09-13T18:43:38.717400+0000","last_clean":"2024-09-13T18:43:38.717400+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:43:38.717400+0000","last_undegraded":"2024-09-13T18:43:38.717400+0000","last_fullsized":"2024-09-13T18:43:38.717400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.439733+0000","last_change":"2024-09-13T18:39:13.583868+0000","last_active":"2024-09-13T18:43:37.439733+0000","last_peered":"2024-09-13T18:43:37.439733+0000","last_clean":"2024-09-13T18:43:37.439733+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:43:37.439733+0000","last_undegraded":"2024-09-13T18:43:37.439733+0000","last_fullsized":"2024-09-13T18:43:37.439733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664249+0000","last_change":"2024-09-13T18:39:09.532757+0000","last_active":"2024-09-13T18:39:54.664249+0000","last_peered":"2024-09-13T18:39:54.664249+0000","last_clean":"2024-09-13T18:39:54.664249+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:39:54.664249+0000","last_undegraded":"2024-09-13T18:39:54.664249+0000","last_fullsized":"2024-09-13T18:39:54.664249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"23'131","reported_seq":144,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741601+0000","last_change":"2024-09-13T18:39:14.582490+0000","last_active":"2024-09-13T18:43:38.741601+0000","last_peered":"2024-09-13T18:43:38.741601+0000","last_clean":"2024-09-13T18:43:38.741601+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:43:38.741601+0000","last_undegraded":"2024-09-13T18:43:38.741601+0000","last_fullsized":"2024-09-13T18:43:38.741601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'10","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:39.630702+0000","last_change":"2024-09-13T18:39:13.583929+0000","last_active":"2024-09-13T18:43:39.630702+0000","last_peered":"2024-09-13T18:43:39.630702+0000","last_clean":"2024-09-13T18:43:39.630702+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:43:39.630702+0000","last_undegraded":"2024-09-13T18:43:39.630702+0000","last_fullsized":"2024-09-13T18:43:39.630702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.662316+0000","last_change":"2024-09-13T18:39:09.531717+0000","last_active":"2024-09-13T18:39:54.662316+0000","last_peered":"2024-09-13T18:39:54.662316+0000","last_clean":"2024-09-13T18:39:54.662316+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:39:54.662316+0000","last_undegraded":"2024-09-13T18:39:54.662316+0000","last_fullsized":"2024-09-13T18:39:54.662316+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"23'131","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:49.688601+0000","last_change":"2024-09-13T18:43:49.688580+0000","last_active":"2024-09-13T18:43:49.688601+0000","last_peered":"2024-09-13T18:43:49.688601+0000","last_clean":"2024-09-13T18:43:49.688601+0000","last_became_active":"2024-09-13T18:39:54.667244+0000","last_became_peered":"2024-09-13T18:39:54.667244+0000","last_unstale":"2024-09-13T18:43:49.688601+0000","last_undegraded":"2024-09-13T18:43:49.688601+0000","last_fullsized":"2024-09-13T18:43:49.688601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-09-13T18:43:49.688505+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-09-13T18:43:49.688505+0000","last_clean_scrub_stamp":"2024-09-13T18:43:49.688505+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:54.329356+0000","scrub_duration":0.00167341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"23'171","reported_seq":184,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739349+0000","last_change":"2024-09-13T18:39:14.593754+0000","last_active":"2024-09-13T18:43:38.739349+0000","last_peered":"2024-09-13T18:43:38.739349+0000","last_clean":"2024-09-13T18:43:38.739349+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:43:38.739349+0000","last_undegraded":"2024-09-13T18:43:38.739349+0000","last_fullsized":"2024-09-13T18:43:38.739349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"23'95","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:39.631230+0000","last_change":"2024-09-13T18:39:13.575507+0000","last_active":"2024-09-13T18:43:39.631230+0000","last_peered":"2024-09-13T18:43:39.631230+0000","last_clean":"2024-09-13T18:43:39.631230+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:43:39.631230+0000","last_undegraded":"2024-09-13T18:43:39.631230+0000","last_fullsized":"2024-09-13T18:43:39.631230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198201,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"23'157","reported_seq":180,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:55.780613+0000","last_change":"2024-09-13T18:43:55.780577+0000","last_active":"2024-09-13T18:43:55.780613+0000","last_peered":"2024-09-13T18:43:55.780613+0000","last_clean":"2024-09-13T18:43:55.780613+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:43:55.780613+0000","last_undegraded":"2024-09-13T18:43:55.780613+0000","last_fullsized":"2024-09-13T18:43:55.780613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'157","last_scrub_stamp":"2024-09-13T18:43:55.780470+0000","last_deep_scrub":"23'157","last_deep_scrub_stamp":"2024-09-13T18:43:55.780470+0000","last_clean_scrub_stamp":"2024-09-13T18:43:55.780470+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:19.819546+0000","scrub_duration":0.0021443629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.440837+0000","last_change":"2024-09-13T18:39:13.572017+0000","last_active":"2024-09-13T18:43:37.440837+0000","last_peered":"2024-09-13T18:43:37.440837+0000","last_clean":"2024-09-13T18:43:37.440837+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:43:37.440837+0000","last_undegraded":"2024-09-13T18:43:37.440837+0000","last_fullsized":"2024-09-13T18:43:37.440837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.663466+0000","last_change":"2024-09-13T18:39:13.571792+0000","last_active":"2024-09-13T18:39:54.663466+0000","last_peered":"2024-09-13T18:39:54.663466+0000","last_clean":"2024-09-13T18:39:54.663466+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:39:54.663466+0000","last_undegraded":"2024-09-13T18:39:54.663466+0000","last_fullsized":"2024-09-13T18:39:54.663466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'189","reported_seq":202,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740018+0000","last_change":"2024-09-13T18:39:14.590748+0000","last_active":"2024-09-13T18:43:38.740018+0000","last_peered":"2024-09-13T18:43:38.740018+0000","last_clean":"2024-09-13T18:43:38.740018+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:43:38.740018+0000","last_undegraded":"2024-09-13T18:43:38.740018+0000","last_fullsized":"2024-09-13T18:43:38.740018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:42:19.744177+0000","last_change":"2024-09-13T18:39:13.569863+0000","last_active":"2024-09-13T18:42:19.744177+0000","last_peered":"2024-09-13T18:42:19.744177+0000","last_clean":"2024-09-13T18:42:19.744177+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:42:19.744177+0000","last_undegraded":"2024-09-13T18:42:19.744177+0000","last_fullsized":"2024-09-13T18:42:19.744177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'165","reported_seq":178,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740721+0000","last_change":"2024-09-13T18:39:14.582205+0000","last_active":"2024-09-13T18:43:38.740721+0000","last_peered":"2024-09-13T18:43:38.740721+0000","last_clean":"2024-09-13T18:43:38.740721+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:43:38.740721+0000","last_undegraded":"2024-09-13T18:43:38.740721+0000","last_fullsized":"2024-09-13T18:43:38.740721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'135","reported_seq":145,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730860+0000","last_change":"2024-09-13T18:39:54.668351+0000","last_active":"2024-09-13T18:43:38.730860+0000","last_peered":"2024-09-13T18:43:38.730860+0000","last_clean":"2024-09-13T18:43:38.730860+0000","last_became_active":"2024-09-13T18:39:54.667809+0000","last_became_peered":"2024-09-13T18:39:54.667809+0000","last_unstale":"2024-09-13T18:43:38.730860+0000","last_undegraded":"2024-09-13T18:43:38.730860+0000","last_fullsized":"2024-09-13T18:43:38.730860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:58.697793+0000","last_change":"2024-09-13T18:43:58.697767+0000","last_active":"2024-09-13T18:43:58.697793+0000","last_peered":"2024-09-13T18:43:58.697793+0000","last_clean":"2024-09-13T18:43:58.697793+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:43:58.697793+0000","last_undegraded":"2024-09-13T18:43:58.697793+0000","last_fullsized":"2024-09-13T18:43:58.697793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:58.697674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:58.697674+0000","last_clean_scrub_stamp":"2024-09-13T18:43:58.697674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:47.894303+0000","scrub_duration":0.0013764059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"23'152","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734778+0000","last_change":"2024-09-13T18:39:14.586848+0000","last_active":"2024-09-13T18:43:38.734778+0000","last_peered":"2024-09-13T18:43:38.734778+0000","last_clean":"2024-09-13T18:43:38.734778+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:43:38.734778+0000","last_undegraded":"2024-09-13T18:43:38.734778+0000","last_fullsized":"2024-09-13T18:43:38.734778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.661308+0000","last_change":"2024-09-13T18:39:13.586123+0000","last_active":"2024-09-13T18:39:54.661308+0000","last_peered":"2024-09-13T18:39:54.661308+0000","last_clean":"2024-09-13T18:39:54.661308+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:39:54.661308+0000","last_undegraded":"2024-09-13T18:39:54.661308+0000","last_fullsized":"2024-09-13T18:39:54.661308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"23'183","reported_seq":193,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731343+0000","last_change":"2024-09-13T18:39:54.668883+0000","last_active":"2024-09-13T18:43:38.731343+0000","last_peered":"2024-09-13T18:43:38.731343+0000","last_clean":"2024-09-13T18:43:38.731343+0000","last_became_active":"2024-09-13T18:39:54.668613+0000","last_became_peered":"2024-09-13T18:39:54.668613+0000","last_unstale":"2024-09-13T18:43:38.731343+0000","last_undegraded":"2024-09-13T18:43:38.731343+0000","last_fullsized":"2024-09-13T18:43:38.731343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.663369+0000","last_change":"2024-09-13T18:39:13.575435+0000","last_active":"2024-09-13T18:39:54.663369+0000","last_peered":"2024-09-13T18:39:54.663369+0000","last_clean":"2024-09-13T18:39:54.663369+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:39:54.663369+0000","last_undegraded":"2024-09-13T18:39:54.663369+0000","last_fullsized":"2024-09-13T18:39:54.663369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"23'141","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727406+0000","last_change":"2024-09-13T18:39:14.580846+0000","last_active":"2024-09-13T18:43:38.727406+0000","last_peered":"2024-09-13T18:43:38.727406+0000","last_clean":"2024-09-13T18:43:38.727406+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:43:38.727406+0000","last_undegraded":"2024-09-13T18:43:38.727406+0000","last_fullsized":"2024-09-13T18:43:38.727406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.665804+0000","last_change":"2024-09-13T18:39:13.571042+0000","last_active":"2024-09-13T18:39:54.665804+0000","last_peered":"2024-09-13T18:39:54.665804+0000","last_clean":"2024-09-13T18:39:54.665804+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:39:54.665804+0000","last_undegraded":"2024-09-13T18:39:54.665804+0000","last_fullsized":"2024-09-13T18:39:54.665804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"23'137","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739263+0000","last_change":"2024-09-13T18:39:14.593258+0000","last_active":"2024-09-13T18:43:38.739263+0000","last_peered":"2024-09-13T18:43:38.739263+0000","last_clean":"2024-09-13T18:43:38.739263+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:43:38.739263+0000","last_undegraded":"2024-09-13T18:43:38.739263+0000","last_fullsized":"2024-09-13T18:43:38.739263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.661727+0000","last_change":"2024-09-13T18:39:13.584903+0000","last_active":"2024-09-13T18:39:54.661727+0000","last_peered":"2024-09-13T18:39:54.661727+0000","last_clean":"2024-09-13T18:39:54.661727+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:39:54.661727+0000","last_undegraded":"2024-09-13T18:39:54.661727+0000","last_fullsized":"2024-09-13T18:39:54.661727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"23'130","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:55.721042+0000","last_change":"2024-09-13T18:43:55.721011+0000","last_active":"2024-09-13T18:43:55.721042+0000","last_peered":"2024-09-13T18:43:55.721042+0000","last_clean":"2024-09-13T18:43:55.721042+0000","last_became_active":"2024-09-13T18:39:54.667188+0000","last_became_peered":"2024-09-13T18:39:54.667188+0000","last_unstale":"2024-09-13T18:43:55.721042+0000","last_undegraded":"2024-09-13T18:43:55.721042+0000","last_fullsized":"2024-09-13T18:43:55.721042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'130","last_scrub_stamp":"2024-09-13T18:43:55.720852+0000","last_deep_scrub":"23'130","last_deep_scrub_stamp":"2024-09-13T18:43:55.720852+0000","last_clean_scrub_stamp":"2024-09-13T18:43:55.720852+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:45.416337+0000","scrub_duration":0.002372299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:42:19.743949+0000","last_change":"2024-09-13T18:39:13.574044+0000","last_active":"2024-09-13T18:42:19.743949+0000","last_peered":"2024-09-13T18:42:19.743949+0000","last_clean":"2024-09-13T18:42:19.743949+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:42:19.743949+0000","last_undegraded":"2024-09-13T18:42:19.743949+0000","last_fullsized":"2024-09-13T18:42:19.743949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'157","reported_seq":180,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:51.713030+0000","last_change":"2024-09-13T18:43:51.713001+0000","last_active":"2024-09-13T18:43:51.713030+0000","last_peered":"2024-09-13T18:43:51.713030+0000","last_clean":"2024-09-13T18:43:51.713030+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:43:51.713030+0000","last_undegraded":"2024-09-13T18:43:51.713030+0000","last_fullsized":"2024-09-13T18:43:51.713030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'157","last_scrub_stamp":"2024-09-13T18:43:51.712881+0000","last_deep_scrub":"23'157","last_deep_scrub_stamp":"2024-09-13T18:43:51.712881+0000","last_clean_scrub_stamp":"2024-09-13T18:43:51.712881+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:48.113167+0000","scrub_duration":0.002119082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.662833+0000","last_change":"2024-09-13T18:39:13.575357+0000","last_active":"2024-09-13T18:39:54.662833+0000","last_peered":"2024-09-13T18:39:54.662833+0000","last_clean":"2024-09-13T18:39:54.662833+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:39:54.662833+0000","last_undegraded":"2024-09-13T18:39:54.662833+0000","last_fullsized":"2024-09-13T18:39:54.662833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"23'170","reported_seq":183,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.722354+0000","last_change":"2024-09-13T18:39:14.580750+0000","last_active":"2024-09-13T18:43:38.722354+0000","last_peered":"2024-09-13T18:43:38.722354+0000","last_clean":"2024-09-13T18:43:38.722354+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:43:38.722354+0000","last_undegraded":"2024-09-13T18:43:38.722354+0000","last_fullsized":"2024-09-13T18:43:38.722354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"23'6","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:01.483853+0000","last_change":"2024-09-13T18:44:01.483824+0000","last_active":"2024-09-13T18:44:01.483853+0000","last_peered":"2024-09-13T18:44:01.483853+0000","last_clean":"2024-09-13T18:44:01.483853+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:44:01.483853+0000","last_undegraded":"2024-09-13T18:44:01.483853+0000","last_fullsized":"2024-09-13T18:44:01.483853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-09-13T18:44:01.483735+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-09-13T18:44:01.483735+0000","last_clean_scrub_stamp":"2024-09-13T18:44:01.483735+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:57.884021+0000","scrub_duration":0.0032014309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":199492,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":160,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":398984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705729,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306084,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065756,"statfs":{"total":96636764160,"available":96323334144,"internally_reserved":0,"allocated":421888,"data_stored":266388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.33900000000000002,"15min":0.32100000000000001},"min":{"1min":0.184,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":4.5049999999999999,"5min":4.5049999999999999,"15min":4.5049999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.20399999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"min":{"1min":0.191,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":3.8980000000000001,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.35699999999999998,"15min":0.33800000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":2.9660000000000002,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:43:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.39000000000000001,"15min":0.38100000000000001},"min":{"1min":0.23499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":3,"5min":3,"15min":3},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":4.5590000000000002,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":0.47399999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705730,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306072,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065768,"statfs":{"total":96636764160,"available":96323346432,"internally_reserved":0,"allocated":409600,"data_stored":266680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.151,"5min":0.151,"15min":0.151},"max":{"1min":0.39400000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.193,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.371}]},{"osd":1,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:43:10 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.314},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.376},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.35399999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705728,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306460,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065380,"statfs":{"total":96636764160,"available":96322949120,"internally_reserved":0,"allocated":806912,"data_stored":659023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.315},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.371},{"interface":"front","average":{"1min":0.31,"5min":0.33300000000000002,"15min":0.32900000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52500000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.39600000000000002,"15min":0.35199999999999998},"min":{"1min":0.217,"5min":0.184,"15min":0.184},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.35899999999999999,"15min":0.34599999999999997},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:43:09 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.42099999999999999,"15min":0.378},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.218},"max":{"1min":6.468,"5min":6.468,"15min":6.468},"last":0.436}]}]},{"osd":0,"up_from":9,"seq":38654705729,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306464,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065376,"statfs":{"total":96636764160,"available":96322945024,"internally_reserved":0,"allocated":811008,"data_stored":659563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.29699999999999999,"15min":0.30399999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.43099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.33200000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.313,"15min":0.32100000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.371,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.372},{"interface":"front","average":{"1min":0.315,"5min":0.33200000000000002,"15min":0.33700000000000002},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47799999999999998,"5min":0.5,"15min":0.5},"last":0.432}]},{"osd":3,"last update":"Fri Sep 13 18:43:06 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34699999999999998,"15min":0.35499999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.38600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":198706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":198395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:44:09.738 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.738 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.738 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.738 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.739 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.739 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.739 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.739 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.739 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.739 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.739 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.739 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.740 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.740 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.740 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.740 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.740 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.740 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.740 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.740 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.741 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.741 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.741 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.741 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.741 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.741 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.741 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.741 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.742 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.742 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.742 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.742 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.742 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.742 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.742 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.742 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.742 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.743 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.743 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T18:39:01.425159+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=1, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.743 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.743 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.743 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.743 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.743 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.743 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.744 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.744 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.744 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.744 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.744 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.744 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.744 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.744 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.745 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.745 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.745 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.745 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.745 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.745 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.745 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.745 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.745 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.746 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.746 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.746 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.746 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.746 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.746 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.746 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.746 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.746 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.747 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.747 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.747 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.747 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.747 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:09.747 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:44:29.749 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:44:29.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.850+0000 7f76db094640 1 Processor -- start 2024-09-13T18:44:29.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.850+0000 7f76db094640 1 -- start start 2024-09-13T18:44:29.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76db094640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f76d41300a0 0x7f76d4134750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:29.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76db094640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f76d4134c90 0x7f76d4137070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:29.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76db094640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d40a3680 con 0x7f76d40a32b0 2024-09-13T18:44:29.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76db094640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d4097460 con 0x7f76d4134c90 2024-09-13T18:44:29.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76db094640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76d412d770 con 0x7f76d41300a0 2024-09-13T18:44:29.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76d3fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f76d41300a0 0x7f76d4134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:29.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76d9631640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f76d4134c90 0x7f76d4137070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:29.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76d8e30640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f76d40a32b0 0x7f76d412f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:38382/0 (socket says 172.21.15.97:38382) 2024-09-13T18:44:29.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76d8e30640 1 -- 172.21.15.97:0/4226403734 learned_addr learned my addr 172.21.15.97:0/4226403734 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:44:29.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76d9631640 1 --2- 172.21.15.97:0/4226403734 >> v2:172.21.15.97:3300/0 conn(0x7f76d4134c90 0x7f76d4137070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:45762/0 (socket says 172.21.15.97:45762) 2024-09-13T18:44:29.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76d3fff640 1 --2- 172.21.15.97:0/4226403734 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f76d41300a0 0x7f76d4134750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:38174/0 (socket says 172.21.15.97:38174) 2024-09-13T18:44:29.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76d9631640 1 -- 172.21.15.97:0/4226403734 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f76d41300a0 msgr2=0x7f76d4134750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:29.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76d9631640 1 --2- 172.21.15.97:0/4226403734 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f76d41300a0 0x7f76d4134750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:29.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76d9631640 1 -- 172.21.15.97:0/4226403734 >> v1:172.21.15.97:6789/0 conn(0x7f76d40a32b0 legacy=0x7f76d412f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:29.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76d9631640 1 -- 172.21.15.97:0/4226403734 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d409dc40 con 0x7f76d4134c90 2024-09-13T18:44:29.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76d37fe640 1 -- 172.21.15.97:0/4226403734 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627013483 0 0) 0x7f76d40a3680 con 0x7f76d40a32b0 2024-09-13T18:44:29.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.851+0000 7f76d3fff640 1 --2- 172.21.15.97:0/4226403734 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f76d41300a0 0x7f76d4134750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.852+0000 7f76d9631640 1 --2- 172.21.15.97:0/4226403734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76d4134c90 0x7f76d4137070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009e60 tx=0x7f76cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca3841c93e0bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.852+0000 7f76d37fe640 1 -- 172.21.15.97:0/4226403734 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc007550 con 0x7f76d4134c90 2024-09-13T18:44:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.852+0000 7f76d37fe640 1 -- 172.21.15.97:0/4226403734 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc02d050 con 0x7f76d4134c90 2024-09-13T18:44:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.852+0000 7f76d37fe640 1 -- 172.21.15.97:0/4226403734 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0078e0 con 0x7f76d4134c90 2024-09-13T18:44:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.853+0000 7f76db094640 1 -- 172.21.15.97:0/4226403734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76d4134c90 msgr2=0x7f76d4137070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.853+0000 7f76db094640 1 --2- 172.21.15.97:0/4226403734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76d4134c90 0x7f76d4137070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009e60 tx=0x7f76cc009780 comp rx=0 tx=0).stop 2024-09-13T18:44:29.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.853+0000 7f76db094640 1 -- 172.21.15.97:0/4226403734 shutdown_connections 2024-09-13T18:44:29.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.853+0000 7f76db094640 1 --2- 172.21.15.97:0/4226403734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76d4134c90 0x7f76d4137070 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:29.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.853+0000 7f76db094640 1 --2- 172.21.15.97:0/4226403734 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f76d41300a0 0x7f76d4134750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:29.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.853+0000 7f76db094640 1 -- 172.21.15.97:0/4226403734 >> 172.21.15.97:0/4226403734 conn(0x7f76d406eef0 msgr2=0x7f76d40a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:29.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.853+0000 7f76db094640 1 -- 172.21.15.97:0/4226403734 shutdown_connections 2024-09-13T18:44:29.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.853+0000 7f76db094640 1 -- 172.21.15.97:0/4226403734 wait complete. 2024-09-13T18:44:29.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.854+0000 7f76db094640 1 Processor -- start 2024-09-13T18:44:29.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.854+0000 7f76db094640 1 -- start start 2024-09-13T18:44:29.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.854+0000 7f76db094640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76d40a32b0 0x7f76d412cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:29.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.854+0000 7f76db094640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76d41300a0 0x7f76d409a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:29.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.854+0000 7f76db094640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f76d4134c90 0x7f76d409a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:29.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.854+0000 7f76db094640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d411a6b0 con 0x7f76d41300a0 2024-09-13T18:44:29.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.854+0000 7f76db094640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d409be20 con 0x7f76d40a32b0 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.854+0000 7f76db094640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76d409c360 con 0x7f76d4134c90 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.854+0000 7f76d3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76d41300a0 0x7f76d409a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.854+0000 7f76d9631640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f76d4134c90 0x7f76d409a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.854+0000 7f76d8e30640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76d40a32b0 0x7f76d412cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.854+0000 7f76d3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76d41300a0 0x7f76d409a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:45772/0 (socket says 172.21.15.97:45772) 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.855+0000 7f76d3fff640 1 -- 172.21.15.97:0/2384821248 learned_addr learned my addr 172.21.15.97:0/2384821248 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.855+0000 7f76d3fff640 1 -- 172.21.15.97:0/2384821248 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f76d4134c90 msgr2=0x7f76d409a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.855+0000 7f76d3fff640 1 --2- 172.21.15.97:0/2384821248 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f76d4134c90 0x7f76d409a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.855+0000 7f76d3fff640 1 -- 172.21.15.97:0/2384821248 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76d40a32b0 msgr2=0x7f76d412cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.855+0000 7f76d3fff640 1 --2- 172.21.15.97:0/2384821248 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76d40a32b0 0x7f76d412cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.855+0000 7f76d3fff640 1 -- 172.21.15.97:0/2384821248 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c8009390 con 0x7f76d41300a0 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.855+0000 7f76d3fff640 1 --2- 172.21.15.97:0/2384821248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76d41300a0 0x7f76d409a3d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f76c800ec80 tx=0x7f76c80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.855+0000 7f76d0ff9640 1 -- 172.21.15.97:0/2384821248 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c800eec0 con 0x7f76d41300a0 2024-09-13T18:44:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.855+0000 7f76d0ff9640 1 -- 172.21.15.97:0/2384821248 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c800cbc0 con 0x7f76d41300a0 2024-09-13T18:44:29.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.855+0000 7f76d0ff9640 1 -- 172.21.15.97:0/2384821248 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c8013470 con 0x7f76d41300a0 2024-09-13T18:44:29.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.855+0000 7f76db094640 1 -- 172.21.15.97:0/2384821248 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc009a20 con 0x7f76d41300a0 2024-09-13T18:44:29.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.855+0000 7f76db094640 1 -- 172.21.15.97:0/2384821248 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d409e710 con 0x7f76d41300a0 2024-09-13T18:44:29.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.856+0000 7f76d0ff9640 1 -- 172.21.15.97:0/2384821248 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f76c8013820 con 0x7f76d41300a0 2024-09-13T18:44:29.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.856+0000 7f76d0ff9640 1 -- 172.21.15.97:0/2384821248 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f76c80425d0 con 0x7f76d41300a0 2024-09-13T18:44:29.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.856+0000 7f76db094640 1 -- 172.21.15.97:0/2384821248 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d4064000 con 0x7f76d41300a0 2024-09-13T18:44:29.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:29.861+0000 7f76d0ff9640 1 -- 172.21.15.97:0/2384821248 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f76c8021070 con 0x7f76d41300a0 2024-09-13T18:44:30.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:30.011+0000 7f76db094640 1 -- 172.21.15.97:0/2384821248 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76d40008d0 con 0x7f76c0031190 2024-09-13T18:44:30.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:30.017+0000 7f76d0ff9640 1 -- 172.21.15.97:0/2384821248 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276707 (unknown 2965378022 0 916283475) 0x7f76d40008d0 con 0x7f76c0031190 2024-09-13T18:44:30.024 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:44:30.026 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:44:30.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:30.021+0000 7f76db094640 1 -- 172.21.15.97:0/2384821248 >> v1:172.21.15.97:6816/34603 conn(0x7f76c0031190 legacy=0x7f76c0033640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:30.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:30.021+0000 7f76db094640 1 -- 172.21.15.97:0/2384821248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76d41300a0 msgr2=0x7f76d409a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:30.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:30.021+0000 7f76db094640 1 --2- 172.21.15.97:0/2384821248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76d41300a0 0x7f76d409a3d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f76c800ec80 tx=0x7f76c80090f0 comp rx=0 tx=0).stop 2024-09-13T18:44:30.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:30.021+0000 7f76db094640 1 -- 172.21.15.97:0/2384821248 shutdown_connections 2024-09-13T18:44:30.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:30.021+0000 7f76db094640 1 --2- 172.21.15.97:0/2384821248 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f76d4134c90 0x7f76d409a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:30.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:30.021+0000 7f76db094640 1 --2- 172.21.15.97:0/2384821248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f76d41300a0 0x7f76d409a3d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:30.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:30.021+0000 7f76db094640 1 --2- 172.21.15.97:0/2384821248 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f76d40a32b0 0x7f76d412cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:30.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:30.021+0000 7f76db094640 1 -- 172.21.15.97:0/2384821248 >> 172.21.15.97:0/2384821248 conn(0x7f76d406eef0 msgr2=0x7f76d40a2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:30.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:30.021+0000 7f76db094640 1 -- 172.21.15.97:0/2384821248 shutdown_connections 2024-09-13T18:44:30.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:30.021+0000 7f76db094640 1 -- 172.21.15.97:0/2384821248 wait complete. 2024-09-13T18:44:30.034 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-13T18:44:29.423034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":789879,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":60,"num_read_kb":50,"num_write":9457,"num_write_kb":25167188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9937,"ondisk_log_size":9937,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1225080,"kb_used_data":2392,"kb_used_omap":6,"kb_used_meta":1222649,"kb_avail":376262280,"statfs":{"total":386547056640,"available":385292574720,"internally_reserved":0,"allocated":2449408,"data_stored":1851654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1251992928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003056"},"pg_stats":[{"pgid":"4.3f","version":"23'146","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:24.587458+0000","last_change":"2024-09-13T18:44:24.587416+0000","last_active":"2024-09-13T18:44:24.587458+0000","last_peered":"2024-09-13T18:44:24.587458+0000","last_clean":"2024-09-13T18:44:24.587458+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:44:24.587458+0000","last_undegraded":"2024-09-13T18:44:24.587458+0000","last_fullsized":"2024-09-13T18:44:24.587458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'146","last_scrub_stamp":"2024-09-13T18:44:24.587315+0000","last_deep_scrub":"23'146","last_deep_scrub_stamp":"2024-09-13T18:44:24.587315+0000","last_clean_scrub_stamp":"2024-09-13T18:44:24.587315+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:57.059776+0000","scrub_duration":0.0022202530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'130","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727670+0000","last_change":"2024-09-13T18:39:14.581266+0000","last_active":"2024-09-13T18:43:38.727670+0000","last_peered":"2024-09-13T18:43:38.727670+0000","last_clean":"2024-09-13T18:43:38.727670+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:43:38.727670+0000","last_undegraded":"2024-09-13T18:43:38.727670+0000","last_fullsized":"2024-09-13T18:43:38.727670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'151","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:54.481559+0000","last_change":"2024-09-13T18:43:54.481533+0000","last_active":"2024-09-13T18:43:54.481559+0000","last_peered":"2024-09-13T18:43:54.481559+0000","last_clean":"2024-09-13T18:43:54.481559+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:43:54.481559+0000","last_undegraded":"2024-09-13T18:43:54.481559+0000","last_fullsized":"2024-09-13T18:43:54.481559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-09-13T18:43:54.481437+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-09-13T18:43:54.481437+0000","last_clean_scrub_stamp":"2024-09-13T18:43:54.481437+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:14.609499+0000","scrub_duration":0.0021815789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"23'173","reported_seq":186,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.733636+0000","last_change":"2024-09-13T18:39:14.583960+0000","last_active":"2024-09-13T18:43:38.733636+0000","last_peered":"2024-09-13T18:43:38.733636+0000","last_clean":"2024-09-13T18:43:38.733636+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:43:38.733636+0000","last_undegraded":"2024-09-13T18:43:38.733636+0000","last_fullsized":"2024-09-13T18:43:38.733636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"23'148","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737162+0000","last_change":"2024-09-13T18:39:14.577865+0000","last_active":"2024-09-13T18:43:38.737162+0000","last_peered":"2024-09-13T18:43:38.737162+0000","last_clean":"2024-09-13T18:43:38.737162+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:43:38.737162+0000","last_undegraded":"2024-09-13T18:43:38.737162+0000","last_fullsized":"2024-09-13T18:43:38.737162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'135","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731955+0000","last_change":"2024-09-13T18:39:14.590785+0000","last_active":"2024-09-13T18:43:38.731955+0000","last_peered":"2024-09-13T18:43:38.731955+0000","last_clean":"2024-09-13T18:43:38.731955+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:43:38.731955+0000","last_undegraded":"2024-09-13T18:43:38.731955+0000","last_fullsized":"2024-09-13T18:43:38.731955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'164","reported_seq":177,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738539+0000","last_change":"2024-09-13T18:39:14.590893+0000","last_active":"2024-09-13T18:43:38.738539+0000","last_peered":"2024-09-13T18:43:38.738539+0000","last_clean":"2024-09-13T18:43:38.738539+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:43:38.738539+0000","last_undegraded":"2024-09-13T18:43:38.738539+0000","last_fullsized":"2024-09-13T18:43:38.738539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'186","reported_seq":199,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717791+0000","last_change":"2024-09-13T18:39:14.595160+0000","last_active":"2024-09-13T18:43:38.717791+0000","last_peered":"2024-09-13T18:43:38.717791+0000","last_clean":"2024-09-13T18:43:38.717791+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:43:38.717791+0000","last_undegraded":"2024-09-13T18:43:38.717791+0000","last_fullsized":"2024-09-13T18:43:38.717791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"23'152","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.726476+0000","last_change":"2024-09-13T18:39:14.586790+0000","last_active":"2024-09-13T18:43:38.726476+0000","last_peered":"2024-09-13T18:43:38.726476+0000","last_clean":"2024-09-13T18:43:38.726476+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:43:38.726476+0000","last_undegraded":"2024-09-13T18:43:38.726476+0000","last_fullsized":"2024-09-13T18:43:38.726476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'156","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.736110+0000","last_change":"2024-09-13T18:39:14.591231+0000","last_active":"2024-09-13T18:43:38.736110+0000","last_peered":"2024-09-13T18:43:38.736110+0000","last_clean":"2024-09-13T18:43:38.736110+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:43:38.736110+0000","last_undegraded":"2024-09-13T18:43:38.736110+0000","last_fullsized":"2024-09-13T18:43:38.736110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"23'189","reported_seq":212,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:57.776603+0000","last_change":"2024-09-13T18:43:57.776571+0000","last_active":"2024-09-13T18:43:57.776603+0000","last_peered":"2024-09-13T18:43:57.776603+0000","last_clean":"2024-09-13T18:43:57.776603+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:43:57.776603+0000","last_undegraded":"2024-09-13T18:43:57.776603+0000","last_fullsized":"2024-09-13T18:43:57.776603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'189","last_scrub_stamp":"2024-09-13T18:43:57.776474+0000","last_deep_scrub":"23'189","last_deep_scrub_stamp":"2024-09-13T18:43:57.776474+0000","last_clean_scrub_stamp":"2024-09-13T18:43:57.776474+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:17.904536+0000","scrub_duration":0.0023429969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"23'142","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.716541+0000","last_change":"2024-09-13T18:39:14.592629+0000","last_active":"2024-09-13T18:43:38.716541+0000","last_peered":"2024-09-13T18:43:38.716541+0000","last_clean":"2024-09-13T18:43:38.716541+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:43:38.716541+0000","last_undegraded":"2024-09-13T18:43:38.716541+0000","last_fullsized":"2024-09-13T18:43:38.716541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'151","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739070+0000","last_change":"2024-09-13T18:39:14.597709+0000","last_active":"2024-09-13T18:43:38.739070+0000","last_peered":"2024-09-13T18:43:38.739070+0000","last_clean":"2024-09-13T18:43:38.739070+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:43:38.739070+0000","last_undegraded":"2024-09-13T18:43:38.739070+0000","last_fullsized":"2024-09-13T18:43:38.739070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'149","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737073+0000","last_change":"2024-09-13T18:39:14.572267+0000","last_active":"2024-09-13T18:43:38.737073+0000","last_peered":"2024-09-13T18:43:38.737073+0000","last_clean":"2024-09-13T18:43:38.737073+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:43:38.737073+0000","last_undegraded":"2024-09-13T18:43:38.737073+0000","last_fullsized":"2024-09-13T18:43:38.737073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"23'151","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:52.482503+0000","last_change":"2024-09-13T18:43:52.482459+0000","last_active":"2024-09-13T18:43:52.482503+0000","last_peered":"2024-09-13T18:43:52.482503+0000","last_clean":"2024-09-13T18:43:52.482503+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:43:52.482503+0000","last_undegraded":"2024-09-13T18:43:52.482503+0000","last_fullsized":"2024-09-13T18:43:52.482503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-09-13T18:43:52.482365+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-09-13T18:43:52.482365+0000","last_clean_scrub_stamp":"2024-09-13T18:43:52.482365+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:01.098502+0000","scrub_duration":0.002317221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"23'147","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741591+0000","last_change":"2024-09-13T18:39:14.592378+0000","last_active":"2024-09-13T18:43:38.741591+0000","last_peered":"2024-09-13T18:43:38.741591+0000","last_clean":"2024-09-13T18:43:38.741591+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:43:38.741591+0000","last_undegraded":"2024-09-13T18:43:38.741591+0000","last_fullsized":"2024-09-13T18:43:38.741591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'146","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:02.509096+0000","last_change":"2024-09-13T18:44:02.509068+0000","last_active":"2024-09-13T18:44:02.509096+0000","last_peered":"2024-09-13T18:44:02.509096+0000","last_clean":"2024-09-13T18:44:02.509096+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:44:02.509096+0000","last_undegraded":"2024-09-13T18:44:02.509096+0000","last_fullsized":"2024-09-13T18:44:02.509096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'146","last_scrub_stamp":"2024-09-13T18:44:02.508957+0000","last_deep_scrub":"23'146","last_deep_scrub_stamp":"2024-09-13T18:44:02.508957+0000","last_clean_scrub_stamp":"2024-09-13T18:44:02.508957+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:56.954687+0000","scrub_duration":0.0021744939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'157","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740152+0000","last_change":"2024-09-13T18:39:14.587172+0000","last_active":"2024-09-13T18:43:38.740152+0000","last_peered":"2024-09-13T18:43:38.740152+0000","last_clean":"2024-09-13T18:43:38.740152+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:43:38.740152+0000","last_undegraded":"2024-09-13T18:43:38.740152+0000","last_fullsized":"2024-09-13T18:43:38.740152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"23'172","reported_seq":195,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:51.707972+0000","last_change":"2024-09-13T18:43:51.707927+0000","last_active":"2024-09-13T18:43:51.707972+0000","last_peered":"2024-09-13T18:43:51.707972+0000","last_clean":"2024-09-13T18:43:51.707972+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:43:51.707972+0000","last_undegraded":"2024-09-13T18:43:51.707972+0000","last_fullsized":"2024-09-13T18:43:51.707972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'172","last_scrub_stamp":"2024-09-13T18:43:51.707829+0000","last_deep_scrub":"23'172","last_deep_scrub_stamp":"2024-09-13T18:43:51.707829+0000","last_clean_scrub_stamp":"2024-09-13T18:43:51.707829+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:11.835892+0000","scrub_duration":0.002475564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'161","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739716+0000","last_change":"2024-09-13T18:39:14.585973+0000","last_active":"2024-09-13T18:43:38.739716+0000","last_peered":"2024-09-13T18:43:38.739716+0000","last_clean":"2024-09-13T18:43:38.739716+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:43:38.739716+0000","last_undegraded":"2024-09-13T18:43:38.739716+0000","last_fullsized":"2024-09-13T18:43:38.739716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"23'137","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:03.709035+0000","last_change":"2024-09-13T18:44:03.708966+0000","last_active":"2024-09-13T18:44:03.709035+0000","last_peered":"2024-09-13T18:44:03.709035+0000","last_clean":"2024-09-13T18:44:03.709035+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:44:03.709035+0000","last_undegraded":"2024-09-13T18:44:03.709035+0000","last_fullsized":"2024-09-13T18:44:03.709035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'137","last_scrub_stamp":"2024-09-13T18:44:03.708829+0000","last_deep_scrub":"23'137","last_deep_scrub_stamp":"2024-09-13T18:44:03.708829+0000","last_clean_scrub_stamp":"2024-09-13T18:44:03.708829+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.890108+0000","scrub_duration":0.0021117660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"23'166","reported_seq":189,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:48.471538+0000","last_change":"2024-09-13T18:43:48.471516+0000","last_active":"2024-09-13T18:43:48.471538+0000","last_peered":"2024-09-13T18:43:48.471538+0000","last_clean":"2024-09-13T18:43:48.471538+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:43:48.471538+0000","last_undegraded":"2024-09-13T18:43:48.471538+0000","last_fullsized":"2024-09-13T18:43:48.471538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'166","last_scrub_stamp":"2024-09-13T18:43:48.471441+0000","last_deep_scrub":"23'166","last_deep_scrub_stamp":"2024-09-13T18:43:48.471441+0000","last_clean_scrub_stamp":"2024-09-13T18:43:48.471441+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:13.500560+0000","scrub_duration":0.0020110710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'134","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738567+0000","last_change":"2024-09-13T18:39:14.590724+0000","last_active":"2024-09-13T18:43:38.738567+0000","last_peered":"2024-09-13T18:43:38.738567+0000","last_clean":"2024-09-13T18:43:38.738567+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:43:38.738567+0000","last_undegraded":"2024-09-13T18:43:38.738567+0000","last_fullsized":"2024-09-13T18:43:38.738567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"23'180","reported_seq":193,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731930+0000","last_change":"2024-09-13T18:39:14.577642+0000","last_active":"2024-09-13T18:43:38.731930+0000","last_peered":"2024-09-13T18:43:38.731930+0000","last_clean":"2024-09-13T18:43:38.731930+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:43:38.731930+0000","last_undegraded":"2024-09-13T18:43:38.731930+0000","last_fullsized":"2024-09-13T18:43:38.731930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"23'134","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:04.699685+0000","last_change":"2024-09-13T18:44:04.699659+0000","last_active":"2024-09-13T18:44:04.699685+0000","last_peered":"2024-09-13T18:44:04.699685+0000","last_clean":"2024-09-13T18:44:04.699685+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:44:04.699685+0000","last_undegraded":"2024-09-13T18:44:04.699685+0000","last_fullsized":"2024-09-13T18:44:04.699685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'134","last_scrub_stamp":"2024-09-13T18:44:04.699563+0000","last_deep_scrub":"23'134","last_deep_scrub_stamp":"2024-09-13T18:44:04.699563+0000","last_clean_scrub_stamp":"2024-09-13T18:44:04.699563+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:01.099849+0000","scrub_duration":0.0021420480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'198","reported_seq":221,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:48.832232+0000","last_change":"2024-09-13T18:43:48.832211+0000","last_active":"2024-09-13T18:43:48.832232+0000","last_peered":"2024-09-13T18:43:48.832232+0000","last_clean":"2024-09-13T18:43:48.832232+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:43:48.832232+0000","last_undegraded":"2024-09-13T18:43:48.832232+0000","last_fullsized":"2024-09-13T18:43:48.832232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'198","last_scrub_stamp":"2024-09-13T18:43:48.832137+0000","last_deep_scrub":"23'198","last_deep_scrub_stamp":"2024-09-13T18:43:48.832137+0000","last_clean_scrub_stamp":"2024-09-13T18:43:48.832137+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:46.877580+0000","scrub_duration":0.00187283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'144","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.729145+0000","last_change":"2024-09-13T18:39:14.594222+0000","last_active":"2024-09-13T18:43:38.729145+0000","last_peered":"2024-09-13T18:43:38.729145+0000","last_clean":"2024-09-13T18:43:38.729145+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:43:38.729145+0000","last_undegraded":"2024-09-13T18:43:38.729145+0000","last_fullsized":"2024-09-13T18:43:38.729145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'133","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:01.731808+0000","last_change":"2024-09-13T18:44:01.731780+0000","last_active":"2024-09-13T18:44:01.731808+0000","last_peered":"2024-09-13T18:44:01.731808+0000","last_clean":"2024-09-13T18:44:01.731808+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:44:01.731808+0000","last_undegraded":"2024-09-13T18:44:01.731808+0000","last_fullsized":"2024-09-13T18:44:01.731808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'133","last_scrub_stamp":"2024-09-13T18:44:01.731680+0000","last_deep_scrub":"23'133","last_deep_scrub_stamp":"2024-09-13T18:44:01.731680+0000","last_clean_scrub_stamp":"2024-09-13T18:44:01.731680+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:51.427166+0000","scrub_duration":0.0020361139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"23'118","reported_seq":131,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741177+0000","last_change":"2024-09-13T18:39:14.586374+0000","last_active":"2024-09-13T18:43:38.741177+0000","last_peered":"2024-09-13T18:43:38.741177+0000","last_clean":"2024-09-13T18:43:38.741177+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:43:38.741177+0000","last_undegraded":"2024-09-13T18:43:38.741177+0000","last_fullsized":"2024-09-13T18:43:38.741177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'131","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:58.440745+0000","last_change":"2024-09-13T18:43:58.440702+0000","last_active":"2024-09-13T18:43:58.440745+0000","last_peered":"2024-09-13T18:43:58.440745+0000","last_clean":"2024-09-13T18:43:58.440745+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:43:58.440745+0000","last_undegraded":"2024-09-13T18:43:58.440745+0000","last_fullsized":"2024-09-13T18:43:58.440745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-09-13T18:43:58.440608+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-09-13T18:43:58.440608+0000","last_clean_scrub_stamp":"2024-09-13T18:43:58.440608+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:48.136093+0000","scrub_duration":0.00209691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"23'135","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740554+0000","last_change":"2024-09-13T18:39:14.580898+0000","last_active":"2024-09-13T18:43:38.740554+0000","last_peered":"2024-09-13T18:43:38.740554+0000","last_clean":"2024-09-13T18:43:38.740554+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:43:38.740554+0000","last_undegraded":"2024-09-13T18:43:38.740554+0000","last_fullsized":"2024-09-13T18:43:38.740554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"23'150","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717082+0000","last_change":"2024-09-13T18:39:14.574811+0000","last_active":"2024-09-13T18:43:38.717082+0000","last_peered":"2024-09-13T18:43:38.717082+0000","last_clean":"2024-09-13T18:43:38.717082+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:43:38.717082+0000","last_undegraded":"2024-09-13T18:43:38.717082+0000","last_fullsized":"2024-09-13T18:43:38.717082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"23'149","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731603+0000","last_change":"2024-09-13T18:39:14.579494+0000","last_active":"2024-09-13T18:43:38.731603+0000","last_peered":"2024-09-13T18:43:38.731603+0000","last_clean":"2024-09-13T18:43:38.731603+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:43:38.731603+0000","last_undegraded":"2024-09-13T18:43:38.731603+0000","last_fullsized":"2024-09-13T18:43:38.731603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'4","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:17.657876+0000","last_change":"2024-09-13T18:44:17.657850+0000","last_active":"2024-09-13T18:44:17.657876+0000","last_peered":"2024-09-13T18:44:17.657876+0000","last_clean":"2024-09-13T18:44:17.657876+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:44:17.657876+0000","last_undegraded":"2024-09-13T18:44:17.657876+0000","last_fullsized":"2024-09-13T18:44:17.657876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-09-13T18:44:17.657744+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-09-13T18:44:17.657744+0000","last_clean_scrub_stamp":"2024-09-13T18:44:17.657744+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:50.130205+0000","scrub_duration":0.0032028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"23'150","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:50.732202+0000","last_change":"2024-09-13T18:43:50.732167+0000","last_active":"2024-09-13T18:43:50.732202+0000","last_peered":"2024-09-13T18:43:50.732202+0000","last_clean":"2024-09-13T18:43:50.732202+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:43:50.732202+0000","last_undegraded":"2024-09-13T18:43:50.732202+0000","last_fullsized":"2024-09-13T18:43:50.732202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'150","last_scrub_stamp":"2024-09-13T18:43:50.732031+0000","last_deep_scrub":"23'150","last_deep_scrub_stamp":"2024-09-13T18:43:50.732031+0000","last_clean_scrub_stamp":"2024-09-13T18:43:50.732031+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:46.913310+0000","scrub_duration":0.0023725059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:19.599404+0000","last_change":"2024-09-13T18:44:19.599375+0000","last_active":"2024-09-13T18:44:19.599404+0000","last_peered":"2024-09-13T18:44:19.599404+0000","last_clean":"2024-09-13T18:44:19.599404+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:44:19.599404+0000","last_undegraded":"2024-09-13T18:44:19.599404+0000","last_fullsized":"2024-09-13T18:44:19.599404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:19.599273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:19.599273+0000","last_clean_scrub_stamp":"2024-09-13T18:44:19.599273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:41.698763+0000","scrub_duration":0.001383612,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"23'229","reported_seq":251,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740210+0000","last_change":"2024-09-13T18:39:54.668508+0000","last_active":"2024-09-13T18:43:38.740210+0000","last_peered":"2024-09-13T18:43:38.740210+0000","last_clean":"2024-09-13T18:43:38.740210+0000","last_became_active":"2024-09-13T18:39:54.668035+0000","last_became_peered":"2024-09-13T18:39:54.668035+0000","last_unstale":"2024-09-13T18:43:38.740210+0000","last_undegraded":"2024-09-13T18:43:38.740210+0000","last_fullsized":"2024-09-13T18:43:38.740210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:09.653407+0000","last_change":"2024-09-13T18:44:09.653388+0000","last_active":"2024-09-13T18:44:09.653407+0000","last_peered":"2024-09-13T18:44:09.653407+0000","last_clean":"2024-09-13T18:44:09.653407+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:44:09.653407+0000","last_undegraded":"2024-09-13T18:44:09.653407+0000","last_fullsized":"2024-09-13T18:44:09.653407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:09.653310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:09.653310+0000","last_clean_scrub_stamp":"2024-09-13T18:44:09.653310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:31.752800+0000","scrub_duration":0.001209353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'141","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738045+0000","last_change":"2024-09-13T18:39:14.584791+0000","last_active":"2024-09-13T18:43:38.738045+0000","last_peered":"2024-09-13T18:43:38.738045+0000","last_clean":"2024-09-13T18:43:38.738045+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:43:38.738045+0000","last_undegraded":"2024-09-13T18:43:38.738045+0000","last_fullsized":"2024-09-13T18:43:38.738045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'9","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.439512+0000","last_change":"2024-09-13T18:39:13.578940+0000","last_active":"2024-09-13T18:43:37.439512+0000","last_peered":"2024-09-13T18:43:37.439512+0000","last_clean":"2024-09-13T18:43:37.439512+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:43:37.439512+0000","last_undegraded":"2024-09-13T18:43:37.439512+0000","last_fullsized":"2024-09-13T18:43:37.439512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"23'2","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:18.588499+0000","last_change":"2024-09-13T18:44:18.588472+0000","last_active":"2024-09-13T18:44:18.588499+0000","last_peered":"2024-09-13T18:44:18.588499+0000","last_clean":"2024-09-13T18:44:18.588499+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:44:18.588499+0000","last_undegraded":"2024-09-13T18:44:18.588499+0000","last_fullsized":"2024-09-13T18:44:18.588499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-09-13T18:44:18.588351+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-09-13T18:44:18.588351+0000","last_clean_scrub_stamp":"2024-09-13T18:44:18.588351+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:44.506583+0000","scrub_duration":0.002819603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"23'153","reported_seq":185,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:15.675386+0000","last_change":"2024-09-13T18:44:15.675355+0000","last_active":"2024-09-13T18:44:15.675386+0000","last_peered":"2024-09-13T18:44:15.675386+0000","last_clean":"2024-09-13T18:44:15.675386+0000","last_became_active":"2024-09-13T18:39:54.668322+0000","last_became_peered":"2024-09-13T18:39:54.668322+0000","last_unstale":"2024-09-13T18:44:15.675386+0000","last_undegraded":"2024-09-13T18:44:15.675386+0000","last_fullsized":"2024-09-13T18:44:15.675386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'153","last_scrub_stamp":"2024-09-13T18:44:15.675257+0000","last_deep_scrub":"23'153","last_deep_scrub_stamp":"2024-09-13T18:44:15.675257+0000","last_clean_scrub_stamp":"2024-09-13T18:44:15.675257+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:47.380623+0000","scrub_duration":0.0021387390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"23'3","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:05.675395+0000","last_change":"2024-09-13T18:44:05.675363+0000","last_active":"2024-09-13T18:44:05.675395+0000","last_peered":"2024-09-13T18:44:05.675395+0000","last_clean":"2024-09-13T18:44:05.675395+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:44:05.675395+0000","last_undegraded":"2024-09-13T18:44:05.675395+0000","last_fullsized":"2024-09-13T18:44:05.675395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-13T18:44:05.675271+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-13T18:44:05.675271+0000","last_clean_scrub_stamp":"2024-09-13T18:44:05.675271+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:27.405880+0000","scrub_duration":0.0025755109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'134","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:52.779568+0000","last_change":"2024-09-13T18:43:52.779541+0000","last_active":"2024-09-13T18:43:52.779568+0000","last_peered":"2024-09-13T18:43:52.779568+0000","last_clean":"2024-09-13T18:43:52.779568+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:43:52.779568+0000","last_undegraded":"2024-09-13T18:43:52.779568+0000","last_fullsized":"2024-09-13T18:43:52.779568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'134","last_scrub_stamp":"2024-09-13T18:43:52.779447+0000","last_deep_scrub":"23'134","last_deep_scrub_stamp":"2024-09-13T18:43:52.779447+0000","last_clean_scrub_stamp":"2024-09-13T18:43:52.779447+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:10.283130+0000","scrub_duration":0.0020289090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664406+0000","last_change":"2024-09-13T18:39:13.581627+0000","last_active":"2024-09-13T18:39:54.664406+0000","last_peered":"2024-09-13T18:39:54.664406+0000","last_clean":"2024-09-13T18:39:54.664406+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:39:54.664406+0000","last_undegraded":"2024-09-13T18:39:54.664406+0000","last_fullsized":"2024-09-13T18:39:54.664406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'128","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:57.708932+0000","last_change":"2024-09-13T18:43:57.708904+0000","last_active":"2024-09-13T18:43:57.708932+0000","last_peered":"2024-09-13T18:43:57.708932+0000","last_clean":"2024-09-13T18:43:57.708932+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:43:57.708932+0000","last_undegraded":"2024-09-13T18:43:57.708932+0000","last_fullsized":"2024-09-13T18:43:57.708932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'128","last_scrub_stamp":"2024-09-13T18:43:57.708808+0000","last_deep_scrub":"23'128","last_deep_scrub_stamp":"2024-09-13T18:43:57.708808+0000","last_clean_scrub_stamp":"2024-09-13T18:43:57.708808+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:53.890087+0000","scrub_duration":0.0020534289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:25.625794+0000","last_change":"2024-09-13T18:44:25.625767+0000","last_active":"2024-09-13T18:44:25.625794+0000","last_peered":"2024-09-13T18:44:25.625794+0000","last_clean":"2024-09-13T18:44:25.625794+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:44:25.625794+0000","last_undegraded":"2024-09-13T18:44:25.625794+0000","last_fullsized":"2024-09-13T18:44:25.625794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:25.625670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:25.625670+0000","last_clean_scrub_stamp":"2024-09-13T18:44:25.625670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:48.259897+0000","scrub_duration":0.0012567520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"23'143","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.727442+0000","last_change":"2024-09-13T18:39:14.584580+0000","last_active":"2024-09-13T18:43:38.727442+0000","last_peered":"2024-09-13T18:43:38.727442+0000","last_clean":"2024-09-13T18:43:38.727442+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:43:38.727442+0000","last_undegraded":"2024-09-13T18:43:38.727442+0000","last_fullsized":"2024-09-13T18:43:38.727442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:42:19.743794+0000","last_change":"2024-09-13T18:39:13.575713+0000","last_active":"2024-09-13T18:42:19.743794+0000","last_peered":"2024-09-13T18:42:19.743794+0000","last_clean":"2024-09-13T18:42:19.743794+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:42:19.743794+0000","last_undegraded":"2024-09-13T18:42:19.743794+0000","last_fullsized":"2024-09-13T18:42:19.743794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'144","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:49.448761+0000","last_change":"2024-09-13T18:43:49.448742+0000","last_active":"2024-09-13T18:43:49.448761+0000","last_peered":"2024-09-13T18:43:49.448761+0000","last_clean":"2024-09-13T18:43:49.448761+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:43:49.448761+0000","last_undegraded":"2024-09-13T18:43:49.448761+0000","last_fullsized":"2024-09-13T18:43:49.448761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'144","last_scrub_stamp":"2024-09-13T18:43:49.448666+0000","last_deep_scrub":"23'144","last_deep_scrub_stamp":"2024-09-13T18:43:49.448666+0000","last_clean_scrub_stamp":"2024-09-13T18:43:49.448666+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:13.477250+0000","scrub_duration":0.0016535639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:53.634394+0000","last_change":"2024-09-13T18:43:53.634366+0000","last_active":"2024-09-13T18:43:53.634394+0000","last_peered":"2024-09-13T18:43:53.634394+0000","last_clean":"2024-09-13T18:43:53.634394+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:43:53.634394+0000","last_undegraded":"2024-09-13T18:43:53.634394+0000","last_fullsized":"2024-09-13T18:43:53.634394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:53.634259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:53.634259+0000","last_clean_scrub_stamp":"2024-09-13T18:43:53.634259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:48.079989+0000","scrub_duration":0.0013690830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'151","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734462+0000","last_change":"2024-09-13T18:39:14.584122+0000","last_active":"2024-09-13T18:43:38.734462+0000","last_peered":"2024-09-13T18:43:38.734462+0000","last_clean":"2024-09-13T18:43:38.734462+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:43:38.734462+0000","last_undegraded":"2024-09-13T18:43:38.734462+0000","last_fullsized":"2024-09-13T18:43:38.734462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:22.635091+0000","last_change":"2024-09-13T18:44:22.635064+0000","last_active":"2024-09-13T18:44:22.635091+0000","last_peered":"2024-09-13T18:44:22.635091+0000","last_clean":"2024-09-13T18:44:22.635091+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:44:22.635091+0000","last_undegraded":"2024-09-13T18:44:22.635091+0000","last_fullsized":"2024-09-13T18:44:22.635091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:22.634960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:22.634960+0000","last_clean_scrub_stamp":"2024-09-13T18:44:22.634960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:29.216584+0000","scrub_duration":0.0013088489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'146","reported_seq":159,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.719511+0000","last_change":"2024-09-13T18:39:14.593058+0000","last_active":"2024-09-13T18:43:38.719511+0000","last_peered":"2024-09-13T18:43:38.719511+0000","last_clean":"2024-09-13T18:43:38.719511+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:43:38.719511+0000","last_undegraded":"2024-09-13T18:43:38.719511+0000","last_fullsized":"2024-09-13T18:43:38.719511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:56.691083+0000","last_change":"2024-09-13T18:43:56.691044+0000","last_active":"2024-09-13T18:43:56.691083+0000","last_peered":"2024-09-13T18:43:56.691083+0000","last_clean":"2024-09-13T18:43:56.691083+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:43:56.691083+0000","last_undegraded":"2024-09-13T18:43:56.691083+0000","last_fullsized":"2024-09-13T18:43:56.691083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:56.690932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:56.690932+0000","last_clean_scrub_stamp":"2024-09-13T18:43:56.690932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:08.734413+0000","scrub_duration":0.0015086730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'138","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:56.782349+0000","last_change":"2024-09-13T18:43:56.782319+0000","last_active":"2024-09-13T18:43:56.782349+0000","last_peered":"2024-09-13T18:43:56.782349+0000","last_clean":"2024-09-13T18:43:56.782349+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:43:56.782349+0000","last_undegraded":"2024-09-13T18:43:56.782349+0000","last_fullsized":"2024-09-13T18:43:56.782349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'138","last_scrub_stamp":"2024-09-13T18:43:56.782222+0000","last_deep_scrub":"23'138","last_deep_scrub_stamp":"2024-09-13T18:43:56.782222+0000","last_clean_scrub_stamp":"2024-09-13T18:43:56.782222+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.423073+0000","scrub_duration":0.001943909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"23'54","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:09.571937+0000","last_change":"2024-09-13T18:44:09.571904+0000","last_active":"2024-09-13T18:44:09.571937+0000","last_peered":"2024-09-13T18:44:09.571937+0000","last_clean":"2024-09-13T18:44:09.571937+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:44:09.571937+0000","last_undegraded":"2024-09-13T18:44:09.571937+0000","last_fullsized":"2024-09-13T18:44:09.571937+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'54","last_scrub_stamp":"2024-09-13T18:44:09.571788+0000","last_deep_scrub":"23'54","last_deep_scrub_stamp":"2024-09-13T18:44:09.571788+0000","last_clean_scrub_stamp":"2024-09-13T18:44:09.571788+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:21.615268+0000","scrub_duration":0.0065545229999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664142+0000","last_change":"2024-09-13T18:39:09.531787+0000","last_active":"2024-09-13T18:39:54.664142+0000","last_peered":"2024-09-13T18:39:54.664142+0000","last_clean":"2024-09-13T18:39:54.664142+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:39:54.664142+0000","last_undegraded":"2024-09-13T18:39:54.664142+0000","last_fullsized":"2024-09-13T18:39:54.664142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:02.713921+0000","last_change":"2024-09-13T18:44:02.713894+0000","last_active":"2024-09-13T18:44:02.713921+0000","last_peered":"2024-09-13T18:44:02.713921+0000","last_clean":"2024-09-13T18:44:02.713921+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:44:02.713921+0000","last_undegraded":"2024-09-13T18:44:02.713921+0000","last_fullsized":"2024-09-13T18:44:02.713921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:02.713794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:02.713794+0000","last_clean_scrub_stamp":"2024-09-13T18:44:02.713794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:39.673817+0000","scrub_duration":0.001383649,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'143","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731187+0000","last_change":"2024-09-13T18:39:54.668486+0000","last_active":"2024-09-13T18:43:38.731187+0000","last_peered":"2024-09-13T18:43:38.731187+0000","last_clean":"2024-09-13T18:43:38.731187+0000","last_became_active":"2024-09-13T18:39:54.668177+0000","last_became_peered":"2024-09-13T18:39:54.668177+0000","last_unstale":"2024-09-13T18:43:38.731187+0000","last_undegraded":"2024-09-13T18:43:38.731187+0000","last_fullsized":"2024-09-13T18:43:38.731187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.662354+0000","last_change":"2024-09-13T18:39:09.531377+0000","last_active":"2024-09-13T18:39:54.662354+0000","last_peered":"2024-09-13T18:39:54.662354+0000","last_clean":"2024-09-13T18:39:54.662354+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:39:54.662354+0000","last_undegraded":"2024-09-13T18:39:54.662354+0000","last_fullsized":"2024-09-13T18:39:54.662354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'6","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:12.515506+0000","last_change":"2024-09-13T18:44:12.515479+0000","last_active":"2024-09-13T18:44:12.515506+0000","last_peered":"2024-09-13T18:44:12.515506+0000","last_clean":"2024-09-13T18:44:12.515506+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:44:12.515506+0000","last_undegraded":"2024-09-13T18:44:12.515506+0000","last_fullsized":"2024-09-13T18:44:12.515506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-09-13T18:44:12.515392+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-09-13T18:44:12.515392+0000","last_clean_scrub_stamp":"2024-09-13T18:44:12.515392+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:49.475414+0000","scrub_duration":0.0028074189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'163","reported_seq":186,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:00.482872+0000","last_change":"2024-09-13T18:44:00.482832+0000","last_active":"2024-09-13T18:44:00.482872+0000","last_peered":"2024-09-13T18:44:00.482872+0000","last_clean":"2024-09-13T18:44:00.482872+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:44:00.482872+0000","last_undegraded":"2024-09-13T18:44:00.482872+0000","last_fullsized":"2024-09-13T18:44:00.482872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'163","last_scrub_stamp":"2024-09-13T18:44:00.482724+0000","last_deep_scrub":"23'163","last_deep_scrub_stamp":"2024-09-13T18:44:00.482724+0000","last_clean_scrub_stamp":"2024-09-13T18:44:00.482724+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:56.664003+0000","scrub_duration":0.0023912109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:58.706954+0000","last_change":"2024-09-13T18:43:58.706931+0000","last_active":"2024-09-13T18:43:58.706954+0000","last_peered":"2024-09-13T18:43:58.706954+0000","last_clean":"2024-09-13T18:43:58.706954+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:43:58.706954+0000","last_undegraded":"2024-09-13T18:43:58.706954+0000","last_fullsized":"2024-09-13T18:43:58.706954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:58.706831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:58.706831+0000","last_clean_scrub_stamp":"2024-09-13T18:43:58.706831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:55.107117+0000","scrub_duration":0.001356496,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:21.577388+0000","last_change":"2024-09-13T18:44:21.577332+0000","last_active":"2024-09-13T18:44:21.577388+0000","last_peered":"2024-09-13T18:44:21.577388+0000","last_clean":"2024-09-13T18:44:21.577388+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:44:21.577388+0000","last_undegraded":"2024-09-13T18:44:21.577388+0000","last_fullsized":"2024-09-13T18:44:21.577388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:21.577179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:21.577179+0000","last_clean_scrub_stamp":"2024-09-13T18:44:21.577179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:50.889934+0000","scrub_duration":0.001424418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'143","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:50.837495+0000","last_change":"2024-09-13T18:43:50.837457+0000","last_active":"2024-09-13T18:43:50.837495+0000","last_peered":"2024-09-13T18:43:50.837495+0000","last_clean":"2024-09-13T18:43:50.837495+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:43:50.837495+0000","last_undegraded":"2024-09-13T18:43:50.837495+0000","last_fullsized":"2024-09-13T18:43:50.837495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'143","last_scrub_stamp":"2024-09-13T18:43:50.837363+0000","last_deep_scrub":"23'143","last_deep_scrub_stamp":"2024-09-13T18:43:50.837363+0000","last_clean_scrub_stamp":"2024-09-13T18:43:50.837363+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:24.539015+0000","scrub_duration":0.002064204,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.662493+0000","last_change":"2024-09-13T18:39:09.532311+0000","last_active":"2024-09-13T18:39:54.662493+0000","last_peered":"2024-09-13T18:39:54.662493+0000","last_clean":"2024-09-13T18:39:54.662493+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:39:54.662493+0000","last_undegraded":"2024-09-13T18:39:54.662493+0000","last_fullsized":"2024-09-13T18:39:54.662493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.665888+0000","last_change":"2024-09-13T18:39:13.571488+0000","last_active":"2024-09-13T18:39:54.665888+0000","last_peered":"2024-09-13T18:39:54.665888+0000","last_clean":"2024-09-13T18:39:54.665888+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:39:54.665888+0000","last_undegraded":"2024-09-13T18:39:54.665888+0000","last_fullsized":"2024-09-13T18:39:54.665888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"23'144","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739562+0000","last_change":"2024-09-13T18:39:14.579779+0000","last_active":"2024-09-13T18:43:38.739562+0000","last_peered":"2024-09-13T18:43:38.739562+0000","last_clean":"2024-09-13T18:43:38.739562+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:43:38.739562+0000","last_undegraded":"2024-09-13T18:43:38.739562+0000","last_fullsized":"2024-09-13T18:43:38.739562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:59.744352+0000","last_change":"2024-09-13T18:43:59.744323+0000","last_active":"2024-09-13T18:43:59.744352+0000","last_peered":"2024-09-13T18:43:59.744352+0000","last_clean":"2024-09-13T18:43:59.744352+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:43:59.744352+0000","last_undegraded":"2024-09-13T18:43:59.744352+0000","last_fullsized":"2024-09-13T18:43:59.744352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:59.744215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:59.744215+0000","last_clean_scrub_stamp":"2024-09-13T18:43:59.744215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:54.189945+0000","scrub_duration":0.0013975039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:11.635078+0000","last_change":"2024-09-13T18:44:11.635054+0000","last_active":"2024-09-13T18:44:11.635078+0000","last_peered":"2024-09-13T18:44:11.635078+0000","last_clean":"2024-09-13T18:44:11.635078+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:44:11.635078+0000","last_undegraded":"2024-09-13T18:44:11.635078+0000","last_fullsized":"2024-09-13T18:44:11.635078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:11.634944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:11.634944+0000","last_clean_scrub_stamp":"2024-09-13T18:44:11.634944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:00.831573+0000","scrub_duration":0.0014013980000000001,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"23'158","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.735333+0000","last_change":"2024-09-13T18:39:14.597238+0000","last_active":"2024-09-13T18:43:38.735333+0000","last_peered":"2024-09-13T18:43:38.735333+0000","last_clean":"2024-09-13T18:43:38.735333+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:43:38.735333+0000","last_undegraded":"2024-09-13T18:43:38.735333+0000","last_fullsized":"2024-09-13T18:43:38.735333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.661807+0000","last_change":"2024-09-13T18:39:13.583071+0000","last_active":"2024-09-13T18:39:54.661807+0000","last_peered":"2024-09-13T18:39:54.661807+0000","last_clean":"2024-09-13T18:39:54.661807+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:39:54.661807+0000","last_undegraded":"2024-09-13T18:39:54.661807+0000","last_fullsized":"2024-09-13T18:39:54.661807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664478+0000","last_change":"2024-09-13T18:39:09.532042+0000","last_active":"2024-09-13T18:39:54.664478+0000","last_peered":"2024-09-13T18:39:54.664478+0000","last_clean":"2024-09-13T18:39:54.664478+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:39:54.664478+0000","last_undegraded":"2024-09-13T18:39:54.664478+0000","last_fullsized":"2024-09-13T18:39:54.664478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"23'145","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717400+0000","last_change":"2024-09-13T18:39:14.584428+0000","last_active":"2024-09-13T18:43:38.717400+0000","last_peered":"2024-09-13T18:43:38.717400+0000","last_clean":"2024-09-13T18:43:38.717400+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:43:38.717400+0000","last_undegraded":"2024-09-13T18:43:38.717400+0000","last_fullsized":"2024-09-13T18:43:38.717400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.439733+0000","last_change":"2024-09-13T18:39:13.583868+0000","last_active":"2024-09-13T18:43:37.439733+0000","last_peered":"2024-09-13T18:43:37.439733+0000","last_clean":"2024-09-13T18:43:37.439733+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:43:37.439733+0000","last_undegraded":"2024-09-13T18:43:37.439733+0000","last_fullsized":"2024-09-13T18:43:37.439733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:15.614716+0000","last_change":"2024-09-13T18:44:15.614677+0000","last_active":"2024-09-13T18:44:15.614716+0000","last_peered":"2024-09-13T18:44:15.614716+0000","last_clean":"2024-09-13T18:44:15.614716+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:44:15.614716+0000","last_undegraded":"2024-09-13T18:44:15.614716+0000","last_fullsized":"2024-09-13T18:44:15.614716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:15.614585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:15.614585+0000","last_clean_scrub_stamp":"2024-09-13T18:44:15.614585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:52.574608+0000","scrub_duration":0.0015675750000000001,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"23'131","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:08.623912+0000","last_change":"2024-09-13T18:44:08.623882+0000","last_active":"2024-09-13T18:44:08.623912+0000","last_peered":"2024-09-13T18:44:08.623912+0000","last_clean":"2024-09-13T18:44:08.623912+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:44:08.623912+0000","last_undegraded":"2024-09-13T18:44:08.623912+0000","last_fullsized":"2024-09-13T18:44:08.623912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-09-13T18:44:08.623773+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-09-13T18:44:08.623773+0000","last_clean_scrub_stamp":"2024-09-13T18:44:08.623773+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:37.936529+0000","scrub_duration":0.0019630450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'10","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:39.630702+0000","last_change":"2024-09-13T18:39:13.583929+0000","last_active":"2024-09-13T18:43:39.630702+0000","last_peered":"2024-09-13T18:43:39.630702+0000","last_clean":"2024-09-13T18:43:39.630702+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:43:39.630702+0000","last_undegraded":"2024-09-13T18:43:39.630702+0000","last_fullsized":"2024-09-13T18:43:39.630702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.662316+0000","last_change":"2024-09-13T18:39:09.531717+0000","last_active":"2024-09-13T18:39:54.662316+0000","last_peered":"2024-09-13T18:39:54.662316+0000","last_clean":"2024-09-13T18:39:54.662316+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:39:54.662316+0000","last_undegraded":"2024-09-13T18:39:54.662316+0000","last_fullsized":"2024-09-13T18:39:54.662316+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:06.503002+0000","last_clean_scrub_stamp":"2024-09-13T18:39:06.503002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"23'131","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:49.688601+0000","last_change":"2024-09-13T18:43:49.688580+0000","last_active":"2024-09-13T18:43:49.688601+0000","last_peered":"2024-09-13T18:43:49.688601+0000","last_clean":"2024-09-13T18:43:49.688601+0000","last_became_active":"2024-09-13T18:39:54.667244+0000","last_became_peered":"2024-09-13T18:39:54.667244+0000","last_unstale":"2024-09-13T18:43:49.688601+0000","last_undegraded":"2024-09-13T18:43:49.688601+0000","last_fullsized":"2024-09-13T18:43:49.688601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-09-13T18:43:49.688505+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-09-13T18:43:49.688505+0000","last_clean_scrub_stamp":"2024-09-13T18:43:49.688505+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:54.329356+0000","scrub_duration":0.00167341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"23'171","reported_seq":194,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:15.679276+0000","last_change":"2024-09-13T18:44:15.679246+0000","last_active":"2024-09-13T18:44:15.679276+0000","last_peered":"2024-09-13T18:44:15.679276+0000","last_clean":"2024-09-13T18:44:15.679276+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:44:15.679276+0000","last_undegraded":"2024-09-13T18:44:15.679276+0000","last_fullsized":"2024-09-13T18:44:15.679276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'171","last_scrub_stamp":"2024-09-13T18:44:15.679145+0000","last_deep_scrub":"23'171","last_deep_scrub_stamp":"2024-09-13T18:44:15.679145+0000","last_clean_scrub_stamp":"2024-09-13T18:44:15.679145+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:41.597377+0000","scrub_duration":0.002087616,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"23'99","reported_seq":123,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:24.727856+0000","last_change":"2024-09-13T18:44:24.727829+0000","last_active":"2024-09-13T18:44:24.727856+0000","last_peered":"2024-09-13T18:44:24.727856+0000","last_clean":"2024-09-13T18:44:24.727856+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:44:24.727856+0000","last_undegraded":"2024-09-13T18:44:24.727856+0000","last_fullsized":"2024-09-13T18:44:24.727856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'99","last_scrub_stamp":"2024-09-13T18:44:24.727735+0000","last_deep_scrub":"23'99","last_deep_scrub_stamp":"2024-09-13T18:44:24.727735+0000","last_clean_scrub_stamp":"2024-09-13T18:44:24.727735+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:26.329227+0000","scrub_duration":0.0056265730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198201,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"23'157","reported_seq":180,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:55.780613+0000","last_change":"2024-09-13T18:43:55.780577+0000","last_active":"2024-09-13T18:43:55.780613+0000","last_peered":"2024-09-13T18:43:55.780613+0000","last_clean":"2024-09-13T18:43:55.780613+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:43:55.780613+0000","last_undegraded":"2024-09-13T18:43:55.780613+0000","last_fullsized":"2024-09-13T18:43:55.780613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'157","last_scrub_stamp":"2024-09-13T18:43:55.780470+0000","last_deep_scrub":"23'157","last_deep_scrub_stamp":"2024-09-13T18:43:55.780470+0000","last_clean_scrub_stamp":"2024-09-13T18:43:55.780470+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:19.819546+0000","scrub_duration":0.0021443629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:37.440837+0000","last_change":"2024-09-13T18:39:13.572017+0000","last_active":"2024-09-13T18:43:37.440837+0000","last_peered":"2024-09-13T18:43:37.440837+0000","last_clean":"2024-09-13T18:43:37.440837+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:43:37.440837+0000","last_undegraded":"2024-09-13T18:43:37.440837+0000","last_fullsized":"2024-09-13T18:43:37.440837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:09.738028+0000","last_change":"2024-09-13T18:44:09.738008+0000","last_active":"2024-09-13T18:44:09.738028+0000","last_peered":"2024-09-13T18:44:09.738028+0000","last_clean":"2024-09-13T18:44:09.738028+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:44:09.738028+0000","last_undegraded":"2024-09-13T18:44:09.738028+0000","last_fullsized":"2024-09-13T18:44:09.738028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:09.737921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:09.737921+0000","last_clean_scrub_stamp":"2024-09-13T18:44:09.737921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:46.697943+0000","scrub_duration":0.001162988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'189","reported_seq":212,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:23.686400+0000","last_change":"2024-09-13T18:44:23.686366+0000","last_active":"2024-09-13T18:44:23.686400+0000","last_peered":"2024-09-13T18:44:23.686400+0000","last_clean":"2024-09-13T18:44:23.686400+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:44:23.686400+0000","last_undegraded":"2024-09-13T18:44:23.686400+0000","last_fullsized":"2024-09-13T18:44:23.686400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'189","last_scrub_stamp":"2024-09-13T18:44:23.686241+0000","last_deep_scrub":"23'189","last_deep_scrub_stamp":"2024-09-13T18:44:23.686241+0000","last_clean_scrub_stamp":"2024-09-13T18:44:23.686241+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:41.829839+0000","scrub_duration":0.002437472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:08.569034+0000","last_change":"2024-09-13T18:44:08.569010+0000","last_active":"2024-09-13T18:44:08.569034+0000","last_peered":"2024-09-13T18:44:08.569034+0000","last_clean":"2024-09-13T18:44:08.569034+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:44:08.569034+0000","last_undegraded":"2024-09-13T18:44:08.569034+0000","last_fullsized":"2024-09-13T18:44:08.569034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-09-13T18:44:08.568898+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-09-13T18:44:08.568898+0000","last_clean_scrub_stamp":"2024-09-13T18:44:08.568898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:30.299507+0000","scrub_duration":0.00140011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'165","reported_seq":188,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:18.646199+0000","last_change":"2024-09-13T18:44:18.646173+0000","last_active":"2024-09-13T18:44:18.646199+0000","last_peered":"2024-09-13T18:44:18.646199+0000","last_clean":"2024-09-13T18:44:18.646199+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:44:18.646199+0000","last_undegraded":"2024-09-13T18:44:18.646199+0000","last_fullsized":"2024-09-13T18:44:18.646199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'165","last_scrub_stamp":"2024-09-13T18:44:18.646081+0000","last_deep_scrub":"23'165","last_deep_scrub_stamp":"2024-09-13T18:44:18.646081+0000","last_clean_scrub_stamp":"2024-09-13T18:44:18.646081+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:13.468721+0000","scrub_duration":0.0021880950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'135","reported_seq":145,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.730860+0000","last_change":"2024-09-13T18:39:54.668351+0000","last_active":"2024-09-13T18:43:38.730860+0000","last_peered":"2024-09-13T18:43:38.730860+0000","last_clean":"2024-09-13T18:43:38.730860+0000","last_became_active":"2024-09-13T18:39:54.667809+0000","last_became_peered":"2024-09-13T18:39:54.667809+0000","last_unstale":"2024-09-13T18:43:38.730860+0000","last_undegraded":"2024-09-13T18:43:38.730860+0000","last_fullsized":"2024-09-13T18:43:38.730860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:58.697793+0000","last_change":"2024-09-13T18:43:58.697767+0000","last_active":"2024-09-13T18:43:58.697793+0000","last_peered":"2024-09-13T18:43:58.697793+0000","last_clean":"2024-09-13T18:43:58.697793+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:43:58.697793+0000","last_undegraded":"2024-09-13T18:43:58.697793+0000","last_fullsized":"2024-09-13T18:43:58.697793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:58.697674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:58.697674+0000","last_clean_scrub_stamp":"2024-09-13T18:43:58.697674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:47.894303+0000","scrub_duration":0.0013764059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"23'152","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734778+0000","last_change":"2024-09-13T18:39:14.586848+0000","last_active":"2024-09-13T18:43:38.734778+0000","last_peered":"2024-09-13T18:43:38.734778+0000","last_clean":"2024-09-13T18:43:38.734778+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:43:38.734778+0000","last_undegraded":"2024-09-13T18:43:38.734778+0000","last_fullsized":"2024-09-13T18:43:38.734778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:22.538801+0000","last_change":"2024-09-13T18:44:22.538766+0000","last_active":"2024-09-13T18:44:22.538801+0000","last_peered":"2024-09-13T18:44:22.538801+0000","last_clean":"2024-09-13T18:44:22.538801+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:44:22.538801+0000","last_undegraded":"2024-09-13T18:44:22.538801+0000","last_fullsized":"2024-09-13T18:44:22.538801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:22.538665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:22.538665+0000","last_clean_scrub_stamp":"2024-09-13T18:44:22.538665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:44.638156+0000","scrub_duration":0.0014664400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"23'183","reported_seq":193,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731343+0000","last_change":"2024-09-13T18:39:54.668883+0000","last_active":"2024-09-13T18:43:38.731343+0000","last_peered":"2024-09-13T18:43:38.731343+0000","last_clean":"2024-09-13T18:43:38.731343+0000","last_became_active":"2024-09-13T18:39:54.668613+0000","last_became_peered":"2024-09-13T18:39:54.668613+0000","last_unstale":"2024-09-13T18:43:38.731343+0000","last_undegraded":"2024-09-13T18:43:38.731343+0000","last_fullsized":"2024-09-13T18:43:38.731343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:06.658725+0000","last_change":"2024-09-13T18:44:06.658686+0000","last_active":"2024-09-13T18:44:06.658725+0000","last_peered":"2024-09-13T18:44:06.658725+0000","last_clean":"2024-09-13T18:44:06.658725+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:44:06.658725+0000","last_undegraded":"2024-09-13T18:44:06.658725+0000","last_fullsized":"2024-09-13T18:44:06.658725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:44:06.658584+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:44:06.658584+0000","last_clean_scrub_stamp":"2024-09-13T18:44:06.658584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:01.104314+0000","scrub_duration":0.0014171240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"23'141","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:22.638805+0000","last_change":"2024-09-13T18:44:22.638773+0000","last_active":"2024-09-13T18:44:22.638805+0000","last_peered":"2024-09-13T18:44:22.638805+0000","last_clean":"2024-09-13T18:44:22.638805+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:44:22.638805+0000","last_undegraded":"2024-09-13T18:44:22.638805+0000","last_fullsized":"2024-09-13T18:44:22.638805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'141","last_scrub_stamp":"2024-09-13T18:44:22.638683+0000","last_deep_scrub":"23'141","last_deep_scrub_stamp":"2024-09-13T18:44:22.638683+0000","last_clean_scrub_stamp":"2024-09-13T18:44:22.638683+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:54.344049+0000","scrub_duration":0.0020241450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.665804+0000","last_change":"2024-09-13T18:39:13.571042+0000","last_active":"2024-09-13T18:39:54.665804+0000","last_peered":"2024-09-13T18:39:54.665804+0000","last_clean":"2024-09-13T18:39:54.665804+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:39:54.665804+0000","last_undegraded":"2024-09-13T18:39:54.665804+0000","last_fullsized":"2024-09-13T18:39:54.665804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"23'137","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739263+0000","last_change":"2024-09-13T18:39:14.593258+0000","last_active":"2024-09-13T18:43:38.739263+0000","last_peered":"2024-09-13T18:43:38.739263+0000","last_clean":"2024-09-13T18:43:38.739263+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:43:38.739263+0000","last_undegraded":"2024-09-13T18:43:38.739263+0000","last_fullsized":"2024-09-13T18:43:38.739263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.661727+0000","last_change":"2024-09-13T18:39:13.584903+0000","last_active":"2024-09-13T18:39:54.661727+0000","last_peered":"2024-09-13T18:39:54.661727+0000","last_clean":"2024-09-13T18:39:54.661727+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:39:54.661727+0000","last_undegraded":"2024-09-13T18:39:54.661727+0000","last_fullsized":"2024-09-13T18:39:54.661727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"23'130","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:55.721042+0000","last_change":"2024-09-13T18:43:55.721011+0000","last_active":"2024-09-13T18:43:55.721042+0000","last_peered":"2024-09-13T18:43:55.721042+0000","last_clean":"2024-09-13T18:43:55.721042+0000","last_became_active":"2024-09-13T18:39:54.667188+0000","last_became_peered":"2024-09-13T18:39:54.667188+0000","last_unstale":"2024-09-13T18:43:55.721042+0000","last_undegraded":"2024-09-13T18:43:55.721042+0000","last_fullsized":"2024-09-13T18:43:55.721042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'130","last_scrub_stamp":"2024-09-13T18:43:55.720852+0000","last_deep_scrub":"23'130","last_deep_scrub_stamp":"2024-09-13T18:43:55.720852+0000","last_clean_scrub_stamp":"2024-09-13T18:43:55.720852+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:45.416337+0000","scrub_duration":0.002372299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:42:19.743949+0000","last_change":"2024-09-13T18:39:13.574044+0000","last_active":"2024-09-13T18:42:19.743949+0000","last_peered":"2024-09-13T18:42:19.743949+0000","last_clean":"2024-09-13T18:42:19.743949+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:42:19.743949+0000","last_undegraded":"2024-09-13T18:42:19.743949+0000","last_fullsized":"2024-09-13T18:42:19.743949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'157","reported_seq":180,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:51.713030+0000","last_change":"2024-09-13T18:43:51.713001+0000","last_active":"2024-09-13T18:43:51.713030+0000","last_peered":"2024-09-13T18:43:51.713030+0000","last_clean":"2024-09-13T18:43:51.713030+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:43:51.713030+0000","last_undegraded":"2024-09-13T18:43:51.713030+0000","last_fullsized":"2024-09-13T18:43:51.713030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'157","last_scrub_stamp":"2024-09-13T18:43:51.712881+0000","last_deep_scrub":"23'157","last_deep_scrub_stamp":"2024-09-13T18:43:51.712881+0000","last_clean_scrub_stamp":"2024-09-13T18:43:51.712881+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:48.113167+0000","scrub_duration":0.002119082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.662833+0000","last_change":"2024-09-13T18:39:13.575357+0000","last_active":"2024-09-13T18:39:54.662833+0000","last_peered":"2024-09-13T18:39:54.662833+0000","last_clean":"2024-09-13T18:39:54.662833+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:39:54.662833+0000","last_undegraded":"2024-09-13T18:39:54.662833+0000","last_fullsized":"2024-09-13T18:39:54.662833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"23'170","reported_seq":193,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:16.668173+0000","last_change":"2024-09-13T18:44:16.668146+0000","last_active":"2024-09-13T18:44:16.668173+0000","last_peered":"2024-09-13T18:44:16.668173+0000","last_clean":"2024-09-13T18:44:16.668173+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:44:16.668173+0000","last_undegraded":"2024-09-13T18:44:16.668173+0000","last_fullsized":"2024-09-13T18:44:16.668173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'170","last_scrub_stamp":"2024-09-13T18:44:16.668031+0000","last_deep_scrub":"23'170","last_deep_scrub_stamp":"2024-09-13T18:44:16.668031+0000","last_clean_scrub_stamp":"2024-09-13T18:44:16.668031+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:38.767522+0000","scrub_duration":0.002367409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"23'6","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:01.483853+0000","last_change":"2024-09-13T18:44:01.483824+0000","last_active":"2024-09-13T18:44:01.483853+0000","last_peered":"2024-09-13T18:44:01.483853+0000","last_clean":"2024-09-13T18:44:01.483853+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:44:01.483853+0000","last_undegraded":"2024-09-13T18:44:01.483853+0000","last_fullsized":"2024-09-13T18:44:01.483853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-09-13T18:44:01.483735+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-09-13T18:44:01.483735+0000","last_clean_scrub_stamp":"2024-09-13T18:44:01.483735+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:57.884021+0000","scrub_duration":0.0032014309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":199492,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":160,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":398984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705733,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306084,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065756,"statfs":{"total":96636764160,"available":96323334144,"internally_reserved":0,"allocated":421888,"data_stored":266388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.33900000000000002,"15min":0.32100000000000001},"min":{"1min":0.17299999999999999,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.48399999999999999,"5min":4.5049999999999999,"15min":4.5049999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.22600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.1679999999999999,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.375,"15min":0.34899999999999998},"min":{"1min":0.251,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.94599999999999995,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.37,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.187,"15min":0.187},"max":{"1min":0.98399999999999999,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.37}]},{"osd":2,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.96899999999999997,"5min":3,"15min":3},"last":0.438},{"interface":"front","average":{"1min":0.374,"5min":0.39000000000000001,"15min":0.37},"min":{"1min":0.245,"5min":0.22,"15min":0.22},"max":{"1min":0.84899999999999998,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":0.42799999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705734,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306072,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065768,"statfs":{"total":96636764160,"available":96323346432,"internally_reserved":0,"allocated":409600,"data_stored":266680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:44:10 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.21199999999999999,"5min":0.151,"15min":0.151},"max":{"1min":0.42399999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.33000000000000002,"15min":0.33100000000000002},"min":{"1min":0.20200000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.41999999999999998,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:44:10 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.215,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.40699999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34000000000000002,"15min":0.34300000000000003},"min":{"1min":0.23000000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.44700000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.44800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:44:10 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34799999999999998,"15min":0.34499999999999997},"min":{"1min":0.23999999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.51300000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.373,"15min":0.373},"min":{"1min":0.249,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46300000000000002,"5min":1.47,"15min":1.47},"last":0.43099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705732,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306460,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065380,"statfs":{"total":96636764160,"available":96322949120,"internally_reserved":0,"allocated":806912,"data_stored":659023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35699999999999998,"15min":0.31900000000000001},"min":{"1min":0.224,"5min":0.159,"15min":0.159},"max":{"1min":0.75,"5min":1.849,"15min":1.849},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.33800000000000002},"min":{"1min":0.22600000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.39500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40600000000000003,"15min":0.35599999999999998},"min":{"1min":0.19500000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.71899999999999997,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.433},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.38200000000000001,"15min":0.35399999999999998},"min":{"1min":0.26700000000000002,"5min":0.192,"15min":0.192},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.42099999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.38800000000000001,"15min":0.35799999999999998},"min":{"1min":0.25900000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.45500000000000002,"15min":0.38900000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":2.9430000000000001,"5min":6.468,"15min":6.468},"last":0.377}]}]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306464,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065376,"statfs":{"total":96636764160,"available":96322945024,"internally_reserved":0,"allocated":811008,"data_stored":659563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:44:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":0.48499999999999999,"15min":0.36699999999999999},"min":{"1min":0.19,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":20.393000000000001,"5min":20.393000000000001,"15min":20.393000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.41599999999999998,"15min":0.36199999999999999},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":9.7189999999999994,"5min":9.7189999999999994,"15min":9.7189999999999994},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:44:08 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.20499999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.44400000000000001,"15min":0.374},"min":{"1min":0.222,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":11.726000000000001,"5min":11.726000000000001,"15min":11.726000000000001},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:44:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":0.51000000000000001,"15min":0.40999999999999998},"min":{"1min":0.248,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":16.503,"5min":16.503,"15min":16.503},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.34699999999999998,"15min":0.35499999999999998},"min":{"1min":0.21099999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.47699999999999998,"5min":0.496,"15min":0.496},"last":0.39000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":198706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":198395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:44:30.039 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.040 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.040 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.040 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.040 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.040 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.040 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.040 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.041 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.041 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.041 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.041 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.041 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.041 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.041 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.041 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.042 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.042 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.042 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.042 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.042 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.042 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.042 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.042 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.043 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.043 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.043 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.043 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.043 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.043 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.043 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.043 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.044 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.044 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.044 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.044 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.044 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.044 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.044 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.044 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.044 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.045 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T18:39:06.503002+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=6, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.045 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.045 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.045 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.045 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.045 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.045 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.046 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.046 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.046 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:30.046 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:44:50.047 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:44:50.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.150+0000 7f310219d640 1 Processor -- start 2024-09-13T18:44:50.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.150+0000 7f310219d640 1 -- start start 2024-09-13T18:44:50.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.150+0000 7f310219d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f30fc097690 0x7f30fc131350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:50.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.150+0000 7f310219d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f30fc0969d0 0x7f30fc1338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:50.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.150+0000 7f310219d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30fc06a190 con 0x7f30fc09dfb0 2024-09-13T18:44:50.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.150+0000 7f310219d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30fc09e380 con 0x7f30fc097690 2024-09-13T18:44:50.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.150+0000 7f310219d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc098870 con 0x7f30fc0969d0 2024-09-13T18:44:50.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.151+0000 7f30faffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f30fc097690 0x7f30fc131350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:50.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.151+0000 7f30fb7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f30fc09dfb0 0x7f30fc096f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32912/0 (socket says 172.21.15.97:32912) 2024-09-13T18:44:50.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.151+0000 7f30fb7fe640 1 -- 172.21.15.97:0/3917247135 learned_addr learned my addr 172.21.15.97:0/3917247135 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:44:50.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.151+0000 7f30fbfff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f30fc0969d0 0x7f30fc1338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:50.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.151+0000 7f30faffd640 1 -- 172.21.15.97:0/3917247135 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f30fc0969d0 msgr2=0x7f30fc1338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:50.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.151+0000 7f30faffd640 1 --2- 172.21.15.97:0/3917247135 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f30fc0969d0 0x7f30fc1338a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:50.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.151+0000 7f30faffd640 1 -- 172.21.15.97:0/3917247135 >> v1:172.21.15.97:6789/0 conn(0x7f30fc09dfb0 legacy=0x7f30fc096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:50.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.151+0000 7f30faffd640 1 -- 172.21.15.97:0/3917247135 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc098e10 con 0x7f30fc097690 2024-09-13T18:44:50.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.151+0000 7f30fa7fc640 1 -- 172.21.15.97:0/3917247135 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509199381 0 0) 0x7f30fc06a190 con 0x7f30fc09dfb0 2024-09-13T18:44:50.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.151+0000 7f30fbfff640 1 --2- 172.21.15.97:0/3917247135 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f30fc0969d0 0x7f30fc1338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:50.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.152+0000 7f30faffd640 1 --2- 172.21.15.97:0/3917247135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30fc097690 0x7f30fc131350 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009850 tx=0x7f30f00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9fe8bbce554140 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:50.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.152+0000 7f30fa7fc640 1 -- 172.21.15.97:0/3917247135 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f002ad00 con 0x7f30fc097690 2024-09-13T18:44:50.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.152+0000 7f30fa7fc640 1 -- 172.21.15.97:0/3917247135 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f002ae60 con 0x7f30fc097690 2024-09-13T18:44:50.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.152+0000 7f30fa7fc640 1 -- 172.21.15.97:0/3917247135 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f0032670 con 0x7f30fc097690 2024-09-13T18:44:50.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.152+0000 7f310219d640 1 -- 172.21.15.97:0/3917247135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30fc097690 msgr2=0x7f30fc131350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:50.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.152+0000 7f310219d640 1 --2- 172.21.15.97:0/3917247135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30fc097690 0x7f30fc131350 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009850 tx=0x7f30f00090f0 comp rx=0 tx=0).stop 2024-09-13T18:44:50.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.152+0000 7f310219d640 1 -- 172.21.15.97:0/3917247135 shutdown_connections 2024-09-13T18:44:50.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.152+0000 7f310219d640 1 --2- 172.21.15.97:0/3917247135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30fc097690 0x7f30fc131350 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:50.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.152+0000 7f310219d640 1 --2- 172.21.15.97:0/3917247135 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f30fc0969d0 0x7f30fc1338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:50.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.153+0000 7f310219d640 1 -- 172.21.15.97:0/3917247135 >> 172.21.15.97:0/3917247135 conn(0x7f30fc09b200 msgr2=0x7f30fc09b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:50.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.153+0000 7f310219d640 1 -- 172.21.15.97:0/3917247135 shutdown_connections 2024-09-13T18:44:50.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.153+0000 7f310219d640 1 -- 172.21.15.97:0/3917247135 wait complete. 2024-09-13T18:44:50.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.153+0000 7f310219d640 1 Processor -- start 2024-09-13T18:44:50.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f310219d640 1 -- start start 2024-09-13T18:44:50.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f310219d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f30fc0969d0 0x7f30fc12c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:50.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f310219d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30fc097690 0x7f30fc09cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:50.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f310219d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30fc09dfb0 0x7f30fc09d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:50.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f310219d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc115db0 con 0x7f30fc09dfb0 2024-09-13T18:44:50.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f310219d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc116af0 con 0x7f30fc097690 2024-09-13T18:44:50.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f310219d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc06e2e0 con 0x7f30fc0969d0 2024-09-13T18:44:50.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f30fb7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f30fc0969d0 0x7f30fc12c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:50.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f30fb7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f30fc0969d0 0x7f30fc12c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:43182/0 (socket says 172.21.15.97:43182) 2024-09-13T18:44:50.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f30fb7fe640 1 -- 172.21.15.97:0/2727322636 learned_addr learned my addr 172.21.15.97:0/2727322636 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:44:50.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f30fbfff640 1 --2- 172.21.15.97:0/2727322636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30fc09dfb0 0x7f30fc09d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:50.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f30faffd640 1 --2- 172.21.15.97:0/2727322636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30fc097690 0x7f30fc09cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:50.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f30fbfff640 1 -- 172.21.15.97:0/2727322636 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f30fc0969d0 msgr2=0x7f30fc12c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:50.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f30fbfff640 1 --2- 172.21.15.97:0/2727322636 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f30fc0969d0 0x7f30fc12c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:50.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f30fbfff640 1 -- 172.21.15.97:0/2727322636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30fc097690 msgr2=0x7f30fc09cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:50.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f30fbfff640 1 --2- 172.21.15.97:0/2727322636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30fc097690 0x7f30fc09cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:50.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f30fbfff640 1 -- 172.21.15.97:0/2727322636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4009a20 con 0x7f30fc09dfb0 2024-09-13T18:44:50.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.154+0000 7f30fb7fe640 1 --2- 172.21.15.97:0/2727322636 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f30fc0969d0 0x7f30fc12c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:50.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.155+0000 7f30fbfff640 1 --2- 172.21.15.97:0/2727322636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30fc09dfb0 0x7f30fc09d3e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009f10 tx=0x7f30f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:50.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.155+0000 7f30e37fe640 1 -- 172.21.15.97:0/2727322636 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f400cdb0 con 0x7f30fc09dfb0 2024-09-13T18:44:50.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.155+0000 7f30e37fe640 1 -- 172.21.15.97:0/2727322636 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f400f040 con 0x7f30fc09dfb0 2024-09-13T18:44:50.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.155+0000 7f310219d640 1 -- 172.21.15.97:0/2727322636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f0009390 con 0x7f30fc09dfb0 2024-09-13T18:44:50.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.155+0000 7f30e37fe640 1 -- 172.21.15.97:0/2727322636 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f40146d0 con 0x7f30fc09dfb0 2024-09-13T18:44:50.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.155+0000 7f310219d640 1 -- 172.21.15.97:0/2727322636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc133700 con 0x7f30fc09dfb0 2024-09-13T18:44:50.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.155+0000 7f30e37fe640 1 -- 172.21.15.97:0/2727322636 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f30f4003020 con 0x7f30fc09dfb0 2024-09-13T18:44:50.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.156+0000 7f30e37fe640 1 -- 172.21.15.97:0/2727322636 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f30f4042aa0 con 0x7f30fc09dfb0 2024-09-13T18:44:50.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.156+0000 7f310219d640 1 -- 172.21.15.97:0/2727322636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc064000 con 0x7f30fc09dfb0 2024-09-13T18:44:50.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.160+0000 7f30e37fe640 1 -- 172.21.15.97:0/2727322636 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f30f4018080 con 0x7f30fc09dfb0 2024-09-13T18:44:50.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.311+0000 7f310219d640 1 -- 172.21.15.97:0/2727322636 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30fc116c30 con 0x7f30e8031190 2024-09-13T18:44:50.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.317+0000 7f30e37fe640 1 -- 172.21.15.97:0/2727322636 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278600 (unknown 2965378022 0 451237910) 0x7f30fc116c30 con 0x7f30e8031190 2024-09-13T18:44:50.329 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:44:50.331 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:44:50.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.320+0000 7f310219d640 1 -- 172.21.15.97:0/2727322636 >> v1:172.21.15.97:6816/34603 conn(0x7f30e8031190 legacy=0x7f30e8033640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:50.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.320+0000 7f310219d640 1 -- 172.21.15.97:0/2727322636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30fc09dfb0 msgr2=0x7f30fc09d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:50.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.320+0000 7f310219d640 1 --2- 172.21.15.97:0/2727322636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30fc09dfb0 0x7f30fc09d3e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009f10 tx=0x7f30f400b040 comp rx=0 tx=0).stop 2024-09-13T18:44:50.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.320+0000 7f310219d640 1 -- 172.21.15.97:0/2727322636 shutdown_connections 2024-09-13T18:44:50.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.320+0000 7f310219d640 1 --2- 172.21.15.97:0/2727322636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30fc09dfb0 0x7f30fc09d3e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:50.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.320+0000 7f310219d640 1 --2- 172.21.15.97:0/2727322636 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f30fc097690 0x7f30fc09cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:50.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.320+0000 7f310219d640 1 --2- 172.21.15.97:0/2727322636 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f30fc0969d0 0x7f30fc12c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:50.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.320+0000 7f310219d640 1 -- 172.21.15.97:0/2727322636 >> 172.21.15.97:0/2727322636 conn(0x7f30fc09b200 msgr2=0x7f30fc09a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:50.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.320+0000 7f310219d640 1 -- 172.21.15.97:0/2727322636 shutdown_connections 2024-09-13T18:44:50.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:44:50.320+0000 7f310219d640 1 -- 172.21.15.97:0/2727322636 wait complete. 2024-09-13T18:44:50.337 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-09-13T18:44:49.428055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":789879,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":60,"num_read_kb":50,"num_write":9457,"num_write_kb":25167188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9950,"ondisk_log_size":9950,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1225080,"kb_used_data":2392,"kb_used_omap":6,"kb_used_meta":1222649,"kb_avail":376262280,"statfs":{"total":386547056640,"available":385292574720,"internally_reserved":0,"allocated":2449408,"data_stored":1851654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1251992928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003382"},"pg_stats":[{"pgid":"4.3f","version":"23'146","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:24.587458+0000","last_change":"2024-09-13T18:44:24.587416+0000","last_active":"2024-09-13T18:44:24.587458+0000","last_peered":"2024-09-13T18:44:24.587458+0000","last_clean":"2024-09-13T18:44:24.587458+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:44:24.587458+0000","last_undegraded":"2024-09-13T18:44:24.587458+0000","last_fullsized":"2024-09-13T18:44:24.587458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'146","last_scrub_stamp":"2024-09-13T18:44:24.587315+0000","last_deep_scrub":"23'146","last_deep_scrub_stamp":"2024-09-13T18:44:24.587315+0000","last_clean_scrub_stamp":"2024-09-13T18:44:24.587315+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:57.059776+0000","scrub_duration":0.0022202530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'130","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:33.528135+0000","last_change":"2024-09-13T18:44:33.528103+0000","last_active":"2024-09-13T18:44:33.528135+0000","last_peered":"2024-09-13T18:44:33.528135+0000","last_clean":"2024-09-13T18:44:33.528135+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:44:33.528135+0000","last_undegraded":"2024-09-13T18:44:33.528135+0000","last_fullsized":"2024-09-13T18:44:33.528135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'130","last_scrub_stamp":"2024-09-13T18:44:33.528004+0000","last_deep_scrub":"23'130","last_deep_scrub_stamp":"2024-09-13T18:44:33.528004+0000","last_clean_scrub_stamp":"2024-09-13T18:44:33.528004+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:33.058600+0000","scrub_duration":0.0020778960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'151","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:54.481559+0000","last_change":"2024-09-13T18:43:54.481533+0000","last_active":"2024-09-13T18:43:54.481559+0000","last_peered":"2024-09-13T18:43:54.481559+0000","last_clean":"2024-09-13T18:43:54.481559+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:43:54.481559+0000","last_undegraded":"2024-09-13T18:43:54.481559+0000","last_fullsized":"2024-09-13T18:43:54.481559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-09-13T18:43:54.481437+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-09-13T18:43:54.481437+0000","last_clean_scrub_stamp":"2024-09-13T18:43:54.481437+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:14.609499+0000","scrub_duration":0.0021815789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"23'173","reported_seq":186,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.733636+0000","last_change":"2024-09-13T18:39:14.583960+0000","last_active":"2024-09-13T18:43:38.733636+0000","last_peered":"2024-09-13T18:43:38.733636+0000","last_clean":"2024-09-13T18:43:38.733636+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:43:38.733636+0000","last_undegraded":"2024-09-13T18:43:38.733636+0000","last_fullsized":"2024-09-13T18:43:38.733636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"23'148","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737162+0000","last_change":"2024-09-13T18:39:14.577865+0000","last_active":"2024-09-13T18:43:38.737162+0000","last_peered":"2024-09-13T18:43:38.737162+0000","last_clean":"2024-09-13T18:43:38.737162+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:43:38.737162+0000","last_undegraded":"2024-09-13T18:43:38.737162+0000","last_fullsized":"2024-09-13T18:43:38.737162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'135","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.731955+0000","last_change":"2024-09-13T18:39:14.590785+0000","last_active":"2024-09-13T18:43:38.731955+0000","last_peered":"2024-09-13T18:43:38.731955+0000","last_clean":"2024-09-13T18:43:38.731955+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:43:38.731955+0000","last_undegraded":"2024-09-13T18:43:38.731955+0000","last_fullsized":"2024-09-13T18:43:38.731955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'164","reported_seq":177,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738539+0000","last_change":"2024-09-13T18:39:14.590893+0000","last_active":"2024-09-13T18:43:38.738539+0000","last_peered":"2024-09-13T18:43:38.738539+0000","last_clean":"2024-09-13T18:43:38.738539+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:43:38.738539+0000","last_undegraded":"2024-09-13T18:43:38.738539+0000","last_fullsized":"2024-09-13T18:43:38.738539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'186","reported_seq":199,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.717791+0000","last_change":"2024-09-13T18:39:14.595160+0000","last_active":"2024-09-13T18:43:38.717791+0000","last_peered":"2024-09-13T18:43:38.717791+0000","last_clean":"2024-09-13T18:43:38.717791+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:43:38.717791+0000","last_undegraded":"2024-09-13T18:43:38.717791+0000","last_fullsized":"2024-09-13T18:43:38.717791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"23'152","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:36.615924+0000","last_change":"2024-09-13T18:44:36.615881+0000","last_active":"2024-09-13T18:44:36.615924+0000","last_peered":"2024-09-13T18:44:36.615924+0000","last_clean":"2024-09-13T18:44:36.615924+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:44:36.615924+0000","last_undegraded":"2024-09-13T18:44:36.615924+0000","last_fullsized":"2024-09-13T18:44:36.615924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'152","last_scrub_stamp":"2024-09-13T18:44:36.615783+0000","last_deep_scrub":"23'152","last_deep_scrub_stamp":"2024-09-13T18:44:36.615783+0000","last_clean_scrub_stamp":"2024-09-13T18:44:36.615783+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.146380+0000","scrub_duration":0.0021429880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'156","reported_seq":179,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:40.390514+0000","last_change":"2024-09-13T18:44:40.390485+0000","last_active":"2024-09-13T18:44:40.390514+0000","last_peered":"2024-09-13T18:44:40.390514+0000","last_clean":"2024-09-13T18:44:40.390514+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:44:40.390514+0000","last_undegraded":"2024-09-13T18:44:40.390514+0000","last_fullsized":"2024-09-13T18:44:40.390514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'156","last_scrub_stamp":"2024-09-13T18:44:40.390396+0000","last_deep_scrub":"23'156","last_deep_scrub_stamp":"2024-09-13T18:44:40.390396+0000","last_clean_scrub_stamp":"2024-09-13T18:44:40.390396+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:39.920992+0000","scrub_duration":0.0022820470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"23'189","reported_seq":212,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:57.776603+0000","last_change":"2024-09-13T18:43:57.776571+0000","last_active":"2024-09-13T18:43:57.776603+0000","last_peered":"2024-09-13T18:43:57.776603+0000","last_clean":"2024-09-13T18:43:57.776603+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:43:57.776603+0000","last_undegraded":"2024-09-13T18:43:57.776603+0000","last_fullsized":"2024-09-13T18:43:57.776603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'189","last_scrub_stamp":"2024-09-13T18:43:57.776474+0000","last_deep_scrub":"23'189","last_deep_scrub_stamp":"2024-09-13T18:43:57.776474+0000","last_clean_scrub_stamp":"2024-09-13T18:43:57.776474+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:17.904536+0000","scrub_duration":0.0023429969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"23'142","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:29.606521+0000","last_change":"2024-09-13T18:44:29.606478+0000","last_active":"2024-09-13T18:44:29.606521+0000","last_peered":"2024-09-13T18:44:29.606521+0000","last_clean":"2024-09-13T18:44:29.606521+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:44:29.606521+0000","last_undegraded":"2024-09-13T18:44:29.606521+0000","last_fullsized":"2024-09-13T18:44:29.606521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'142","last_scrub_stamp":"2024-09-13T18:44:29.606363+0000","last_deep_scrub":"23'142","last_deep_scrub_stamp":"2024-09-13T18:44:29.606363+0000","last_clean_scrub_stamp":"2024-09-13T18:44:29.606363+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:36.187986+0000","scrub_duration":0.0021615219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'151","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:30.620123+0000","last_change":"2024-09-13T18:44:30.620101+0000","last_active":"2024-09-13T18:44:30.620123+0000","last_peered":"2024-09-13T18:44:30.620123+0000","last_clean":"2024-09-13T18:44:30.620123+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:44:30.620123+0000","last_undegraded":"2024-09-13T18:44:30.620123+0000","last_fullsized":"2024-09-13T18:44:30.620123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-09-13T18:44:30.620017+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-09-13T18:44:30.620017+0000","last_clean_scrub_stamp":"2024-09-13T18:44:30.620017+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:48.763614+0000","scrub_duration":0.001830124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'149","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.737073+0000","last_change":"2024-09-13T18:39:14.572267+0000","last_active":"2024-09-13T18:43:38.737073+0000","last_peered":"2024-09-13T18:43:38.737073+0000","last_clean":"2024-09-13T18:43:38.737073+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:43:38.737073+0000","last_undegraded":"2024-09-13T18:43:38.737073+0000","last_fullsized":"2024-09-13T18:43:38.737073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"23'151","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:52.482503+0000","last_change":"2024-09-13T18:43:52.482459+0000","last_active":"2024-09-13T18:43:52.482503+0000","last_peered":"2024-09-13T18:43:52.482503+0000","last_clean":"2024-09-13T18:43:52.482503+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:43:52.482503+0000","last_undegraded":"2024-09-13T18:43:52.482503+0000","last_fullsized":"2024-09-13T18:43:52.482503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-09-13T18:43:52.482365+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-09-13T18:43:52.482365+0000","last_clean_scrub_stamp":"2024-09-13T18:43:52.482365+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:01.098502+0000","scrub_duration":0.002317221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"23'147","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741591+0000","last_change":"2024-09-13T18:39:14.592378+0000","last_active":"2024-09-13T18:43:38.741591+0000","last_peered":"2024-09-13T18:43:38.741591+0000","last_clean":"2024-09-13T18:43:38.741591+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:43:38.741591+0000","last_undegraded":"2024-09-13T18:43:38.741591+0000","last_fullsized":"2024-09-13T18:43:38.741591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'146","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:02.509096+0000","last_change":"2024-09-13T18:44:02.509068+0000","last_active":"2024-09-13T18:44:02.509096+0000","last_peered":"2024-09-13T18:44:02.509096+0000","last_clean":"2024-09-13T18:44:02.509096+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:44:02.509096+0000","last_undegraded":"2024-09-13T18:44:02.509096+0000","last_fullsized":"2024-09-13T18:44:02.509096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'146","last_scrub_stamp":"2024-09-13T18:44:02.508957+0000","last_deep_scrub":"23'146","last_deep_scrub_stamp":"2024-09-13T18:44:02.508957+0000","last_clean_scrub_stamp":"2024-09-13T18:44:02.508957+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:56.954687+0000","scrub_duration":0.0021744939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'157","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740152+0000","last_change":"2024-09-13T18:39:14.587172+0000","last_active":"2024-09-13T18:43:38.740152+0000","last_peered":"2024-09-13T18:43:38.740152+0000","last_clean":"2024-09-13T18:43:38.740152+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:43:38.740152+0000","last_undegraded":"2024-09-13T18:43:38.740152+0000","last_fullsized":"2024-09-13T18:43:38.740152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"23'172","reported_seq":195,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:51.707972+0000","last_change":"2024-09-13T18:43:51.707927+0000","last_active":"2024-09-13T18:43:51.707972+0000","last_peered":"2024-09-13T18:43:51.707972+0000","last_clean":"2024-09-13T18:43:51.707972+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:43:51.707972+0000","last_undegraded":"2024-09-13T18:43:51.707972+0000","last_fullsized":"2024-09-13T18:43:51.707972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'172","last_scrub_stamp":"2024-09-13T18:43:51.707829+0000","last_deep_scrub":"23'172","last_deep_scrub_stamp":"2024-09-13T18:43:51.707829+0000","last_clean_scrub_stamp":"2024-09-13T18:43:51.707829+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:11.835892+0000","scrub_duration":0.002475564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'161","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739716+0000","last_change":"2024-09-13T18:39:14.585973+0000","last_active":"2024-09-13T18:43:38.739716+0000","last_peered":"2024-09-13T18:43:38.739716+0000","last_clean":"2024-09-13T18:43:38.739716+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:43:38.739716+0000","last_undegraded":"2024-09-13T18:43:38.739716+0000","last_fullsized":"2024-09-13T18:43:38.739716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"23'137","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:03.709035+0000","last_change":"2024-09-13T18:44:03.708966+0000","last_active":"2024-09-13T18:44:03.709035+0000","last_peered":"2024-09-13T18:44:03.709035+0000","last_clean":"2024-09-13T18:44:03.709035+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:44:03.709035+0000","last_undegraded":"2024-09-13T18:44:03.709035+0000","last_fullsized":"2024-09-13T18:44:03.709035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'137","last_scrub_stamp":"2024-09-13T18:44:03.708829+0000","last_deep_scrub":"23'137","last_deep_scrub_stamp":"2024-09-13T18:44:03.708829+0000","last_clean_scrub_stamp":"2024-09-13T18:44:03.708829+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.890108+0000","scrub_duration":0.0021117660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"23'166","reported_seq":189,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:48.471538+0000","last_change":"2024-09-13T18:43:48.471516+0000","last_active":"2024-09-13T18:43:48.471538+0000","last_peered":"2024-09-13T18:43:48.471538+0000","last_clean":"2024-09-13T18:43:48.471538+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:43:48.471538+0000","last_undegraded":"2024-09-13T18:43:48.471538+0000","last_fullsized":"2024-09-13T18:43:48.471538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'166","last_scrub_stamp":"2024-09-13T18:43:48.471441+0000","last_deep_scrub":"23'166","last_deep_scrub_stamp":"2024-09-13T18:43:48.471441+0000","last_clean_scrub_stamp":"2024-09-13T18:43:48.471441+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:13.500560+0000","scrub_duration":0.0020110710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'134","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.738567+0000","last_change":"2024-09-13T18:39:14.590724+0000","last_active":"2024-09-13T18:43:38.738567+0000","last_peered":"2024-09-13T18:43:38.738567+0000","last_clean":"2024-09-13T18:43:38.738567+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:43:38.738567+0000","last_undegraded":"2024-09-13T18:43:38.738567+0000","last_fullsized":"2024-09-13T18:43:38.738567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"23'180","reported_seq":203,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:38.380778+0000","last_change":"2024-09-13T18:44:38.380751+0000","last_active":"2024-09-13T18:44:38.380778+0000","last_peered":"2024-09-13T18:44:38.380778+0000","last_clean":"2024-09-13T18:44:38.380778+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:44:38.380778+0000","last_undegraded":"2024-09-13T18:44:38.380778+0000","last_fullsized":"2024-09-13T18:44:38.380778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'180","last_scrub_stamp":"2024-09-13T18:44:38.380652+0000","last_deep_scrub":"23'180","last_deep_scrub_stamp":"2024-09-13T18:44:38.380652+0000","last_clean_scrub_stamp":"2024-09-13T18:44:38.380652+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:39.982144+0000","scrub_duration":0.002474459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"23'134","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:04.699685+0000","last_change":"2024-09-13T18:44:04.699659+0000","last_active":"2024-09-13T18:44:04.699685+0000","last_peered":"2024-09-13T18:44:04.699685+0000","last_clean":"2024-09-13T18:44:04.699685+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:44:04.699685+0000","last_undegraded":"2024-09-13T18:44:04.699685+0000","last_fullsized":"2024-09-13T18:44:04.699685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'134","last_scrub_stamp":"2024-09-13T18:44:04.699563+0000","last_deep_scrub":"23'134","last_deep_scrub_stamp":"2024-09-13T18:44:04.699563+0000","last_clean_scrub_stamp":"2024-09-13T18:44:04.699563+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:01.099849+0000","scrub_duration":0.0021420480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'198","reported_seq":221,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:48.832232+0000","last_change":"2024-09-13T18:43:48.832211+0000","last_active":"2024-09-13T18:43:48.832232+0000","last_peered":"2024-09-13T18:43:48.832232+0000","last_clean":"2024-09-13T18:43:48.832232+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:43:48.832232+0000","last_undegraded":"2024-09-13T18:43:48.832232+0000","last_fullsized":"2024-09-13T18:43:48.832232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'198","last_scrub_stamp":"2024-09-13T18:43:48.832137+0000","last_deep_scrub":"23'198","last_deep_scrub_stamp":"2024-09-13T18:43:48.832137+0000","last_clean_scrub_stamp":"2024-09-13T18:43:48.832137+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:46.877580+0000","scrub_duration":0.00187283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'144","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.729145+0000","last_change":"2024-09-13T18:39:14.594222+0000","last_active":"2024-09-13T18:43:38.729145+0000","last_peered":"2024-09-13T18:43:38.729145+0000","last_clean":"2024-09-13T18:43:38.729145+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:43:38.729145+0000","last_undegraded":"2024-09-13T18:43:38.729145+0000","last_fullsized":"2024-09-13T18:43:38.729145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'133","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:01.731808+0000","last_change":"2024-09-13T18:44:01.731780+0000","last_active":"2024-09-13T18:44:01.731808+0000","last_peered":"2024-09-13T18:44:01.731808+0000","last_clean":"2024-09-13T18:44:01.731808+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:44:01.731808+0000","last_undegraded":"2024-09-13T18:44:01.731808+0000","last_fullsized":"2024-09-13T18:44:01.731808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'133","last_scrub_stamp":"2024-09-13T18:44:01.731680+0000","last_deep_scrub":"23'133","last_deep_scrub_stamp":"2024-09-13T18:44:01.731680+0000","last_clean_scrub_stamp":"2024-09-13T18:44:01.731680+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:51.427166+0000","scrub_duration":0.0020361139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"23'118","reported_seq":131,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.741177+0000","last_change":"2024-09-13T18:39:14.586374+0000","last_active":"2024-09-13T18:43:38.741177+0000","last_peered":"2024-09-13T18:43:38.741177+0000","last_clean":"2024-09-13T18:43:38.741177+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:43:38.741177+0000","last_undegraded":"2024-09-13T18:43:38.741177+0000","last_fullsized":"2024-09-13T18:43:38.741177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'131","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:58.440745+0000","last_change":"2024-09-13T18:43:58.440702+0000","last_active":"2024-09-13T18:43:58.440745+0000","last_peered":"2024-09-13T18:43:58.440745+0000","last_clean":"2024-09-13T18:43:58.440745+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:43:58.440745+0000","last_undegraded":"2024-09-13T18:43:58.440745+0000","last_fullsized":"2024-09-13T18:43:58.440745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-09-13T18:43:58.440608+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-09-13T18:43:58.440608+0000","last_clean_scrub_stamp":"2024-09-13T18:43:58.440608+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:48.136093+0000","scrub_duration":0.00209691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"23'135","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740554+0000","last_change":"2024-09-13T18:39:14.580898+0000","last_active":"2024-09-13T18:43:38.740554+0000","last_peered":"2024-09-13T18:43:38.740554+0000","last_clean":"2024-09-13T18:43:38.740554+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:43:38.740554+0000","last_undegraded":"2024-09-13T18:43:38.740554+0000","last_fullsized":"2024-09-13T18:43:38.740554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"23'150","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:37.428168+0000","last_change":"2024-09-13T18:44:37.428133+0000","last_active":"2024-09-13T18:44:37.428168+0000","last_peered":"2024-09-13T18:44:37.428168+0000","last_clean":"2024-09-13T18:44:37.428168+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:44:37.428168+0000","last_undegraded":"2024-09-13T18:44:37.428168+0000","last_fullsized":"2024-09-13T18:44:37.428168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'150","last_scrub_stamp":"2024-09-13T18:44:37.428037+0000","last_deep_scrub":"23'150","last_deep_scrub_stamp":"2024-09-13T18:44:37.428037+0000","last_clean_scrub_stamp":"2024-09-13T18:44:37.428037+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.571634+0000","scrub_duration":0.002198864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"23'149","reported_seq":172,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:26.755265+0000","last_change":"2024-09-13T18:44:26.755239+0000","last_active":"2024-09-13T18:44:26.755265+0000","last_peered":"2024-09-13T18:44:26.755265+0000","last_clean":"2024-09-13T18:44:26.755265+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:44:26.755265+0000","last_undegraded":"2024-09-13T18:44:26.755265+0000","last_fullsized":"2024-09-13T18:44:26.755265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'149","last_scrub_stamp":"2024-09-13T18:44:26.755134+0000","last_deep_scrub":"23'149","last_deep_scrub_stamp":"2024-09-13T18:44:26.755134+0000","last_clean_scrub_stamp":"2024-09-13T18:44:26.755134+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:26.285730+0000","scrub_duration":0.002146954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'4","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:17.657876+0000","last_change":"2024-09-13T18:44:17.657850+0000","last_active":"2024-09-13T18:44:17.657876+0000","last_peered":"2024-09-13T18:44:17.657876+0000","last_clean":"2024-09-13T18:44:17.657876+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:44:17.657876+0000","last_undegraded":"2024-09-13T18:44:17.657876+0000","last_fullsized":"2024-09-13T18:44:17.657876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-09-13T18:44:17.657744+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-09-13T18:44:17.657744+0000","last_clean_scrub_stamp":"2024-09-13T18:44:17.657744+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:50.130205+0000","scrub_duration":0.0032028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"23'150","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:50.732202+0000","last_change":"2024-09-13T18:43:50.732167+0000","last_active":"2024-09-13T18:43:50.732202+0000","last_peered":"2024-09-13T18:43:50.732202+0000","last_clean":"2024-09-13T18:43:50.732202+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:43:50.732202+0000","last_undegraded":"2024-09-13T18:43:50.732202+0000","last_fullsized":"2024-09-13T18:43:50.732202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'150","last_scrub_stamp":"2024-09-13T18:43:50.732031+0000","last_deep_scrub":"23'150","last_deep_scrub_stamp":"2024-09-13T18:43:50.732031+0000","last_clean_scrub_stamp":"2024-09-13T18:43:50.732031+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:46.913310+0000","scrub_duration":0.0023725059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:19.599404+0000","last_change":"2024-09-13T18:44:19.599375+0000","last_active":"2024-09-13T18:44:19.599404+0000","last_peered":"2024-09-13T18:44:19.599404+0000","last_clean":"2024-09-13T18:44:19.599404+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:44:19.599404+0000","last_undegraded":"2024-09-13T18:44:19.599404+0000","last_fullsized":"2024-09-13T18:44:19.599404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:19.599273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:19.599273+0000","last_clean_scrub_stamp":"2024-09-13T18:44:19.599273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:41.698763+0000","scrub_duration":0.001383612,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"23'229","reported_seq":251,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.740210+0000","last_change":"2024-09-13T18:39:54.668508+0000","last_active":"2024-09-13T18:43:38.740210+0000","last_peered":"2024-09-13T18:43:38.740210+0000","last_clean":"2024-09-13T18:43:38.740210+0000","last_became_active":"2024-09-13T18:39:54.668035+0000","last_became_peered":"2024-09-13T18:39:54.668035+0000","last_unstale":"2024-09-13T18:43:38.740210+0000","last_undegraded":"2024-09-13T18:43:38.740210+0000","last_fullsized":"2024-09-13T18:43:38.740210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:09.653407+0000","last_change":"2024-09-13T18:44:09.653388+0000","last_active":"2024-09-13T18:44:09.653407+0000","last_peered":"2024-09-13T18:44:09.653407+0000","last_clean":"2024-09-13T18:44:09.653407+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:44:09.653407+0000","last_undegraded":"2024-09-13T18:44:09.653407+0000","last_fullsized":"2024-09-13T18:44:09.653407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:09.653310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:09.653310+0000","last_clean_scrub_stamp":"2024-09-13T18:44:09.653310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:31.752800+0000","scrub_duration":0.001209353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'141","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:36.764297+0000","last_change":"2024-09-13T18:44:36.764258+0000","last_active":"2024-09-13T18:44:36.764297+0000","last_peered":"2024-09-13T18:44:36.764297+0000","last_clean":"2024-09-13T18:44:36.764297+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:44:36.764297+0000","last_undegraded":"2024-09-13T18:44:36.764297+0000","last_fullsized":"2024-09-13T18:44:36.764297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'141","last_scrub_stamp":"2024-09-13T18:44:36.764155+0000","last_deep_scrub":"23'141","last_deep_scrub_stamp":"2024-09-13T18:44:36.764155+0000","last_clean_scrub_stamp":"2024-09-13T18:44:36.764155+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:06.434398+0000","scrub_duration":0.002008995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'13","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:30.530461+0000","last_change":"2024-09-13T18:44:30.530441+0000","last_active":"2024-09-13T18:44:30.530461+0000","last_peered":"2024-09-13T18:44:30.530461+0000","last_clean":"2024-09-13T18:44:30.530461+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:44:30.530461+0000","last_undegraded":"2024-09-13T18:44:30.530461+0000","last_fullsized":"2024-09-13T18:44:30.530461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'13","last_scrub_stamp":"2024-09-13T18:44:30.530358+0000","last_deep_scrub":"23'13","last_deep_scrub_stamp":"2024-09-13T18:44:30.530358+0000","last_clean_scrub_stamp":"2024-09-13T18:44:30.530358+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:04.178379+0000","scrub_duration":0.0033496760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"23'2","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:18.588499+0000","last_change":"2024-09-13T18:44:18.588472+0000","last_active":"2024-09-13T18:44:18.588499+0000","last_peered":"2024-09-13T18:44:18.588499+0000","last_clean":"2024-09-13T18:44:18.588499+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:44:18.588499+0000","last_undegraded":"2024-09-13T18:44:18.588499+0000","last_fullsized":"2024-09-13T18:44:18.588499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-09-13T18:44:18.588351+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-09-13T18:44:18.588351+0000","last_clean_scrub_stamp":"2024-09-13T18:44:18.588351+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:44.506583+0000","scrub_duration":0.002819603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"23'153","reported_seq":185,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:15.675386+0000","last_change":"2024-09-13T18:44:15.675355+0000","last_active":"2024-09-13T18:44:15.675386+0000","last_peered":"2024-09-13T18:44:15.675386+0000","last_clean":"2024-09-13T18:44:15.675386+0000","last_became_active":"2024-09-13T18:39:54.668322+0000","last_became_peered":"2024-09-13T18:39:54.668322+0000","last_unstale":"2024-09-13T18:44:15.675386+0000","last_undegraded":"2024-09-13T18:44:15.675386+0000","last_fullsized":"2024-09-13T18:44:15.675386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'153","last_scrub_stamp":"2024-09-13T18:44:15.675257+0000","last_deep_scrub":"23'153","last_deep_scrub_stamp":"2024-09-13T18:44:15.675257+0000","last_clean_scrub_stamp":"2024-09-13T18:44:15.675257+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:47.380623+0000","scrub_duration":0.0021387390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"23'3","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:05.675395+0000","last_change":"2024-09-13T18:44:05.675363+0000","last_active":"2024-09-13T18:44:05.675395+0000","last_peered":"2024-09-13T18:44:05.675395+0000","last_clean":"2024-09-13T18:44:05.675395+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:44:05.675395+0000","last_undegraded":"2024-09-13T18:44:05.675395+0000","last_fullsized":"2024-09-13T18:44:05.675395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-13T18:44:05.675271+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-13T18:44:05.675271+0000","last_clean_scrub_stamp":"2024-09-13T18:44:05.675271+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:27.405880+0000","scrub_duration":0.0025755109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'134","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:52.779568+0000","last_change":"2024-09-13T18:43:52.779541+0000","last_active":"2024-09-13T18:43:52.779568+0000","last_peered":"2024-09-13T18:43:52.779568+0000","last_clean":"2024-09-13T18:43:52.779568+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:43:52.779568+0000","last_undegraded":"2024-09-13T18:43:52.779568+0000","last_fullsized":"2024-09-13T18:43:52.779568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'134","last_scrub_stamp":"2024-09-13T18:43:52.779447+0000","last_deep_scrub":"23'134","last_deep_scrub_stamp":"2024-09-13T18:43:52.779447+0000","last_clean_scrub_stamp":"2024-09-13T18:43:52.779447+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:10.283130+0000","scrub_duration":0.0020289090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:39:54.664406+0000","last_change":"2024-09-13T18:39:13.581627+0000","last_active":"2024-09-13T18:39:54.664406+0000","last_peered":"2024-09-13T18:39:54.664406+0000","last_clean":"2024-09-13T18:39:54.664406+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:39:54.664406+0000","last_undegraded":"2024-09-13T18:39:54.664406+0000","last_fullsized":"2024-09-13T18:39:54.664406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:12.536362+0000","last_clean_scrub_stamp":"2024-09-13T18:39:12.536362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'128","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:57.708932+0000","last_change":"2024-09-13T18:43:57.708904+0000","last_active":"2024-09-13T18:43:57.708932+0000","last_peered":"2024-09-13T18:43:57.708932+0000","last_clean":"2024-09-13T18:43:57.708932+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:43:57.708932+0000","last_undegraded":"2024-09-13T18:43:57.708932+0000","last_fullsized":"2024-09-13T18:43:57.708932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'128","last_scrub_stamp":"2024-09-13T18:43:57.708808+0000","last_deep_scrub":"23'128","last_deep_scrub_stamp":"2024-09-13T18:43:57.708808+0000","last_clean_scrub_stamp":"2024-09-13T18:43:57.708808+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:53.890087+0000","scrub_duration":0.0020534289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:25.625794+0000","last_change":"2024-09-13T18:44:25.625767+0000","last_active":"2024-09-13T18:44:25.625794+0000","last_peered":"2024-09-13T18:44:25.625794+0000","last_clean":"2024-09-13T18:44:25.625794+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:44:25.625794+0000","last_undegraded":"2024-09-13T18:44:25.625794+0000","last_fullsized":"2024-09-13T18:44:25.625794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:25.625670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:25.625670+0000","last_clean_scrub_stamp":"2024-09-13T18:44:25.625670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:48.259897+0000","scrub_duration":0.0012567520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"23'143","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:45.628989+0000","last_change":"2024-09-13T18:44:45.628952+0000","last_active":"2024-09-13T18:44:45.628989+0000","last_peered":"2024-09-13T18:44:45.628989+0000","last_clean":"2024-09-13T18:44:45.628989+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:44:45.628989+0000","last_undegraded":"2024-09-13T18:44:45.628989+0000","last_fullsized":"2024-09-13T18:44:45.628989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'143","last_scrub_stamp":"2024-09-13T18:44:45.628856+0000","last_deep_scrub":"23'143","last_deep_scrub_stamp":"2024-09-13T18:44:45.628856+0000","last_clean_scrub_stamp":"2024-09-13T18:44:45.628856+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:41.651078+0000","scrub_duration":0.002190521,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'4","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:44.711388+0000","last_change":"2024-09-13T18:44:44.711363+0000","last_active":"2024-09-13T18:44:44.711388+0000","last_peered":"2024-09-13T18:44:44.711388+0000","last_clean":"2024-09-13T18:44:44.711388+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:44:44.711388+0000","last_undegraded":"2024-09-13T18:44:44.711388+0000","last_fullsized":"2024-09-13T18:44:44.711388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-09-13T18:44:44.711281+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-09-13T18:44:44.711281+0000","last_clean_scrub_stamp":"2024-09-13T18:44:44.711281+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:31.432082+0000","scrub_duration":0.0023498310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'144","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:49.448761+0000","last_change":"2024-09-13T18:43:49.448742+0000","last_active":"2024-09-13T18:43:49.448761+0000","last_peered":"2024-09-13T18:43:49.448761+0000","last_clean":"2024-09-13T18:43:49.448761+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:43:49.448761+0000","last_undegraded":"2024-09-13T18:43:49.448761+0000","last_fullsized":"2024-09-13T18:43:49.448761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'144","last_scrub_stamp":"2024-09-13T18:43:49.448666+0000","last_deep_scrub":"23'144","last_deep_scrub_stamp":"2024-09-13T18:43:49.448666+0000","last_clean_scrub_stamp":"2024-09-13T18:43:49.448666+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:13.477250+0000","scrub_duration":0.0016535639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:53.634394+0000","last_change":"2024-09-13T18:43:53.634366+0000","last_active":"2024-09-13T18:43:53.634394+0000","last_peered":"2024-09-13T18:43:53.634394+0000","last_clean":"2024-09-13T18:43:53.634394+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:43:53.634394+0000","last_undegraded":"2024-09-13T18:43:53.634394+0000","last_fullsized":"2024-09-13T18:43:53.634394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:53.634259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:53.634259+0000","last_clean_scrub_stamp":"2024-09-13T18:43:53.634259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:48.079989+0000","scrub_duration":0.0013690830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'151","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734462+0000","last_change":"2024-09-13T18:39:14.584122+0000","last_active":"2024-09-13T18:43:38.734462+0000","last_peered":"2024-09-13T18:43:38.734462+0000","last_clean":"2024-09-13T18:43:38.734462+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:43:38.734462+0000","last_undegraded":"2024-09-13T18:43:38.734462+0000","last_fullsized":"2024-09-13T18:43:38.734462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:22.635091+0000","last_change":"2024-09-13T18:44:22.635064+0000","last_active":"2024-09-13T18:44:22.635091+0000","last_peered":"2024-09-13T18:44:22.635091+0000","last_clean":"2024-09-13T18:44:22.635091+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:44:22.635091+0000","last_undegraded":"2024-09-13T18:44:22.635091+0000","last_fullsized":"2024-09-13T18:44:22.635091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:22.634960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:22.634960+0000","last_clean_scrub_stamp":"2024-09-13T18:44:22.634960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:29.216584+0000","scrub_duration":0.0013088489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'146","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:31.587191+0000","last_change":"2024-09-13T18:44:31.587166+0000","last_active":"2024-09-13T18:44:31.587191+0000","last_peered":"2024-09-13T18:44:31.587191+0000","last_clean":"2024-09-13T18:44:31.587191+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:44:31.587191+0000","last_undegraded":"2024-09-13T18:44:31.587191+0000","last_fullsized":"2024-09-13T18:44:31.587191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'146","last_scrub_stamp":"2024-09-13T18:44:31.587066+0000","last_deep_scrub":"23'146","last_deep_scrub_stamp":"2024-09-13T18:44:31.587066+0000","last_clean_scrub_stamp":"2024-09-13T18:44:31.587066+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:33.188557+0000","scrub_duration":0.002156229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:56.691083+0000","last_change":"2024-09-13T18:43:56.691044+0000","last_active":"2024-09-13T18:43:56.691083+0000","last_peered":"2024-09-13T18:43:56.691083+0000","last_clean":"2024-09-13T18:43:56.691083+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:43:56.691083+0000","last_undegraded":"2024-09-13T18:43:56.691083+0000","last_fullsized":"2024-09-13T18:43:56.691083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:56.690932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:56.690932+0000","last_clean_scrub_stamp":"2024-09-13T18:43:56.690932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:08.734413+0000","scrub_duration":0.0015086730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'138","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:56.782349+0000","last_change":"2024-09-13T18:43:56.782319+0000","last_active":"2024-09-13T18:43:56.782349+0000","last_peered":"2024-09-13T18:43:56.782349+0000","last_clean":"2024-09-13T18:43:56.782349+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:43:56.782349+0000","last_undegraded":"2024-09-13T18:43:56.782349+0000","last_fullsized":"2024-09-13T18:43:56.782349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'138","last_scrub_stamp":"2024-09-13T18:43:56.782222+0000","last_deep_scrub":"23'138","last_deep_scrub_stamp":"2024-09-13T18:43:56.782222+0000","last_clean_scrub_stamp":"2024-09-13T18:43:56.782222+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.423073+0000","scrub_duration":0.001943909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"23'54","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:09.571937+0000","last_change":"2024-09-13T18:44:09.571904+0000","last_active":"2024-09-13T18:44:09.571937+0000","last_peered":"2024-09-13T18:44:09.571937+0000","last_clean":"2024-09-13T18:44:09.571937+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:44:09.571937+0000","last_undegraded":"2024-09-13T18:44:09.571937+0000","last_fullsized":"2024-09-13T18:44:09.571937+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'54","last_scrub_stamp":"2024-09-13T18:44:09.571788+0000","last_deep_scrub":"23'54","last_deep_scrub_stamp":"2024-09-13T18:44:09.571788+0000","last_clean_scrub_stamp":"2024-09-13T18:44:09.571788+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:21.615268+0000","scrub_duration":0.0065545229999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'2","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:41.652010+0000","last_change":"2024-09-13T18:44:41.651951+0000","last_active":"2024-09-13T18:44:41.652010+0000","last_peered":"2024-09-13T18:44:41.652010+0000","last_clean":"2024-09-13T18:44:41.652010+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:44:41.652010+0000","last_undegraded":"2024-09-13T18:44:41.652010+0000","last_fullsized":"2024-09-13T18:44:41.652010+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-09-13T18:44:41.651845+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-09-13T18:44:41.651845+0000","last_clean_scrub_stamp":"2024-09-13T18:44:41.651845+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:58.624229+0000","scrub_duration":0.0028101419999999998,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:02.713921+0000","last_change":"2024-09-13T18:44:02.713894+0000","last_active":"2024-09-13T18:44:02.713921+0000","last_peered":"2024-09-13T18:44:02.713921+0000","last_clean":"2024-09-13T18:44:02.713921+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:44:02.713921+0000","last_undegraded":"2024-09-13T18:44:02.713921+0000","last_fullsized":"2024-09-13T18:44:02.713921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:02.713794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:02.713794+0000","last_clean_scrub_stamp":"2024-09-13T18:44:02.713794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:39.673817+0000","scrub_duration":0.001383649,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'143","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:44.680039+0000","last_change":"2024-09-13T18:44:44.679998+0000","last_active":"2024-09-13T18:44:44.680039+0000","last_peered":"2024-09-13T18:44:44.680039+0000","last_clean":"2024-09-13T18:44:44.680039+0000","last_became_active":"2024-09-13T18:39:54.668177+0000","last_became_peered":"2024-09-13T18:39:54.668177+0000","last_unstale":"2024-09-13T18:44:44.680039+0000","last_undegraded":"2024-09-13T18:44:44.680039+0000","last_fullsized":"2024-09-13T18:44:44.680039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'143","last_scrub_stamp":"2024-09-13T18:44:44.679899+0000","last_deep_scrub":"23'143","last_deep_scrub_stamp":"2024-09-13T18:44:44.679899+0000","last_clean_scrub_stamp":"2024-09-13T18:44:44.679899+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:05.823493+0000","scrub_duration":0.0021408970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:40.685103+0000","last_change":"2024-09-13T18:44:40.685071+0000","last_active":"2024-09-13T18:44:40.685103+0000","last_peered":"2024-09-13T18:44:40.685103+0000","last_clean":"2024-09-13T18:44:40.685103+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:44:40.685103+0000","last_undegraded":"2024-09-13T18:44:40.685103+0000","last_fullsized":"2024-09-13T18:44:40.685103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:40.684959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:40.684959+0000","last_clean_scrub_stamp":"2024-09-13T18:44:40.684959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:32.397536+0000","scrub_duration":0.0013364449999999999,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'6","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:12.515506+0000","last_change":"2024-09-13T18:44:12.515479+0000","last_active":"2024-09-13T18:44:12.515506+0000","last_peered":"2024-09-13T18:44:12.515506+0000","last_clean":"2024-09-13T18:44:12.515506+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:44:12.515506+0000","last_undegraded":"2024-09-13T18:44:12.515506+0000","last_fullsized":"2024-09-13T18:44:12.515506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-09-13T18:44:12.515392+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-09-13T18:44:12.515392+0000","last_clean_scrub_stamp":"2024-09-13T18:44:12.515392+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:49.475414+0000","scrub_duration":0.0028074189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'163","reported_seq":186,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:00.482872+0000","last_change":"2024-09-13T18:44:00.482832+0000","last_active":"2024-09-13T18:44:00.482872+0000","last_peered":"2024-09-13T18:44:00.482872+0000","last_clean":"2024-09-13T18:44:00.482872+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:44:00.482872+0000","last_undegraded":"2024-09-13T18:44:00.482872+0000","last_fullsized":"2024-09-13T18:44:00.482872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'163","last_scrub_stamp":"2024-09-13T18:44:00.482724+0000","last_deep_scrub":"23'163","last_deep_scrub_stamp":"2024-09-13T18:44:00.482724+0000","last_clean_scrub_stamp":"2024-09-13T18:44:00.482724+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:56.664003+0000","scrub_duration":0.0023912109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:58.706954+0000","last_change":"2024-09-13T18:43:58.706931+0000","last_active":"2024-09-13T18:43:58.706954+0000","last_peered":"2024-09-13T18:43:58.706954+0000","last_clean":"2024-09-13T18:43:58.706954+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:43:58.706954+0000","last_undegraded":"2024-09-13T18:43:58.706954+0000","last_fullsized":"2024-09-13T18:43:58.706954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:58.706831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:58.706831+0000","last_clean_scrub_stamp":"2024-09-13T18:43:58.706831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:55.107117+0000","scrub_duration":0.001356496,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:21.577388+0000","last_change":"2024-09-13T18:44:21.577332+0000","last_active":"2024-09-13T18:44:21.577388+0000","last_peered":"2024-09-13T18:44:21.577388+0000","last_clean":"2024-09-13T18:44:21.577388+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:44:21.577388+0000","last_undegraded":"2024-09-13T18:44:21.577388+0000","last_fullsized":"2024-09-13T18:44:21.577388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:21.577179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:21.577179+0000","last_clean_scrub_stamp":"2024-09-13T18:44:21.577179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:50.889934+0000","scrub_duration":0.001424418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'143","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:50.837495+0000","last_change":"2024-09-13T18:43:50.837457+0000","last_active":"2024-09-13T18:43:50.837495+0000","last_peered":"2024-09-13T18:43:50.837495+0000","last_clean":"2024-09-13T18:43:50.837495+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:43:50.837495+0000","last_undegraded":"2024-09-13T18:43:50.837495+0000","last_fullsized":"2024-09-13T18:43:50.837495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'143","last_scrub_stamp":"2024-09-13T18:43:50.837363+0000","last_deep_scrub":"23'143","last_deep_scrub_stamp":"2024-09-13T18:43:50.837363+0000","last_clean_scrub_stamp":"2024-09-13T18:43:50.837363+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:24.539015+0000","scrub_duration":0.002064204,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'3","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:38.752692+0000","last_change":"2024-09-13T18:44:38.752656+0000","last_active":"2024-09-13T18:44:38.752692+0000","last_peered":"2024-09-13T18:44:38.752692+0000","last_clean":"2024-09-13T18:44:38.752692+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:44:38.752692+0000","last_undegraded":"2024-09-13T18:44:38.752692+0000","last_fullsized":"2024-09-13T18:44:38.752692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-13T18:44:38.752572+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-13T18:44:38.752572+0000","last_clean_scrub_stamp":"2024-09-13T18:44:38.752572+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:09.259753+0000","scrub_duration":0.002800903,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:27.554325+0000","last_change":"2024-09-13T18:44:27.554281+0000","last_active":"2024-09-13T18:44:27.554325+0000","last_peered":"2024-09-13T18:44:27.554325+0000","last_clean":"2024-09-13T18:44:27.554325+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:44:27.554325+0000","last_undegraded":"2024-09-13T18:44:27.554325+0000","last_fullsized":"2024-09-13T18:44:27.554325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:27.554178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:27.554178+0000","last_clean_scrub_stamp":"2024-09-13T18:44:27.554178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:01.202199+0000","scrub_duration":0.001456045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"23'144","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.739562+0000","last_change":"2024-09-13T18:39:14.579779+0000","last_active":"2024-09-13T18:43:38.739562+0000","last_peered":"2024-09-13T18:43:38.739562+0000","last_clean":"2024-09-13T18:43:38.739562+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:43:38.739562+0000","last_undegraded":"2024-09-13T18:43:38.739562+0000","last_fullsized":"2024-09-13T18:43:38.739562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:59.744352+0000","last_change":"2024-09-13T18:43:59.744323+0000","last_active":"2024-09-13T18:43:59.744352+0000","last_peered":"2024-09-13T18:43:59.744352+0000","last_clean":"2024-09-13T18:43:59.744352+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:43:59.744352+0000","last_undegraded":"2024-09-13T18:43:59.744352+0000","last_fullsized":"2024-09-13T18:43:59.744352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:59.744215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:59.744215+0000","last_clean_scrub_stamp":"2024-09-13T18:43:59.744215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:54.189945+0000","scrub_duration":0.0013975039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:11.635078+0000","last_change":"2024-09-13T18:44:11.635054+0000","last_active":"2024-09-13T18:44:11.635078+0000","last_peered":"2024-09-13T18:44:11.635078+0000","last_clean":"2024-09-13T18:44:11.635078+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:44:11.635078+0000","last_undegraded":"2024-09-13T18:44:11.635078+0000","last_fullsized":"2024-09-13T18:44:11.635078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:11.634944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:11.634944+0000","last_clean_scrub_stamp":"2024-09-13T18:44:11.634944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:00.831573+0000","scrub_duration":0.0014013980000000001,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"23'158","reported_seq":181,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:36.458964+0000","last_change":"2024-09-13T18:44:36.458922+0000","last_active":"2024-09-13T18:44:36.458964+0000","last_peered":"2024-09-13T18:44:36.458964+0000","last_clean":"2024-09-13T18:44:36.458964+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:44:36.458964+0000","last_undegraded":"2024-09-13T18:44:36.458964+0000","last_fullsized":"2024-09-13T18:44:36.458964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'158","last_scrub_stamp":"2024-09-13T18:44:36.458779+0000","last_deep_scrub":"23'158","last_deep_scrub_stamp":"2024-09-13T18:44:36.458779+0000","last_clean_scrub_stamp":"2024-09-13T18:44:36.458779+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:43.040402+0000","scrub_duration":0.0024238329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:28.491518+0000","last_change":"2024-09-13T18:44:28.491493+0000","last_active":"2024-09-13T18:44:28.491518+0000","last_peered":"2024-09-13T18:44:28.491518+0000","last_clean":"2024-09-13T18:44:28.491518+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:44:28.491518+0000","last_undegraded":"2024-09-13T18:44:28.491518+0000","last_fullsized":"2024-09-13T18:44:28.491518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:28.491398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:28.491398+0000","last_clean_scrub_stamp":"2024-09-13T18:44:28.491398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:51.125625+0000","scrub_duration":0.0014534820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:42.654462+0000","last_change":"2024-09-13T18:44:42.654438+0000","last_active":"2024-09-13T18:44:42.654462+0000","last_peered":"2024-09-13T18:44:42.654462+0000","last_clean":"2024-09-13T18:44:42.654462+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:44:42.654462+0000","last_undegraded":"2024-09-13T18:44:42.654462+0000","last_fullsized":"2024-09-13T18:44:42.654462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:42.654350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:42.654350+0000","last_clean_scrub_stamp":"2024-09-13T18:44:42.654350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.901142+0000","scrub_duration":0.00121572,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"23'145","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:34.544044+0000","last_change":"2024-09-13T18:44:34.544011+0000","last_active":"2024-09-13T18:44:34.544044+0000","last_peered":"2024-09-13T18:44:34.544044+0000","last_clean":"2024-09-13T18:44:34.544044+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:44:34.544044+0000","last_undegraded":"2024-09-13T18:44:34.544044+0000","last_fullsized":"2024-09-13T18:44:34.544044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'145","last_scrub_stamp":"2024-09-13T18:44:34.543897+0000","last_deep_scrub":"23'145","last_deep_scrub_stamp":"2024-09-13T18:44:34.543897+0000","last_clean_scrub_stamp":"2024-09-13T18:44:34.543897+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:36.145389+0000","scrub_duration":0.0023018470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'4","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:43.688802+0000","last_change":"2024-09-13T18:44:43.688761+0000","last_active":"2024-09-13T18:44:43.688802+0000","last_peered":"2024-09-13T18:44:43.688802+0000","last_clean":"2024-09-13T18:44:43.688802+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:44:43.688802+0000","last_undegraded":"2024-09-13T18:44:43.688802+0000","last_fullsized":"2024-09-13T18:44:43.688802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-09-13T18:44:43.688664+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-09-13T18:44:43.688664+0000","last_clean_scrub_stamp":"2024-09-13T18:44:43.688664+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:46.903589+0000","scrub_duration":0.0024956409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:15.614716+0000","last_change":"2024-09-13T18:44:15.614677+0000","last_active":"2024-09-13T18:44:15.614716+0000","last_peered":"2024-09-13T18:44:15.614716+0000","last_clean":"2024-09-13T18:44:15.614716+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:44:15.614716+0000","last_undegraded":"2024-09-13T18:44:15.614716+0000","last_fullsized":"2024-09-13T18:44:15.614716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:15.614585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:15.614585+0000","last_clean_scrub_stamp":"2024-09-13T18:44:15.614585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:52.574608+0000","scrub_duration":0.0015675750000000001,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"23'131","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:08.623912+0000","last_change":"2024-09-13T18:44:08.623882+0000","last_active":"2024-09-13T18:44:08.623912+0000","last_peered":"2024-09-13T18:44:08.623912+0000","last_clean":"2024-09-13T18:44:08.623912+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:44:08.623912+0000","last_undegraded":"2024-09-13T18:44:08.623912+0000","last_fullsized":"2024-09-13T18:44:08.623912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-09-13T18:44:08.623773+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-09-13T18:44:08.623773+0000","last_clean_scrub_stamp":"2024-09-13T18:44:08.623773+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:37.936529+0000","scrub_duration":0.0019630450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'11","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:32.575344+0000","last_change":"2024-09-13T18:44:32.575316+0000","last_active":"2024-09-13T18:44:32.575344+0000","last_peered":"2024-09-13T18:44:32.575344+0000","last_clean":"2024-09-13T18:44:32.575344+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:44:32.575344+0000","last_undegraded":"2024-09-13T18:44:32.575344+0000","last_fullsized":"2024-09-13T18:44:32.575344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-09-13T18:44:32.575209+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-09-13T18:44:32.575209+0000","last_clean_scrub_stamp":"2024-09-13T18:44:32.575209+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:39.156832+0000","scrub_duration":0.0024253859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:39.726748+0000","last_change":"2024-09-13T18:44:39.726722+0000","last_active":"2024-09-13T18:44:39.726748+0000","last_peered":"2024-09-13T18:44:39.726748+0000","last_clean":"2024-09-13T18:44:39.726748+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:44:39.726748+0000","last_undegraded":"2024-09-13T18:44:39.726748+0000","last_fullsized":"2024-09-13T18:44:39.726748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:39.726611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:39.726611+0000","last_clean_scrub_stamp":"2024-09-13T18:44:39.726611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:24.857585+0000","scrub_duration":0.0015396240000000001,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"23'131","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:49.688601+0000","last_change":"2024-09-13T18:43:49.688580+0000","last_active":"2024-09-13T18:43:49.688601+0000","last_peered":"2024-09-13T18:43:49.688601+0000","last_clean":"2024-09-13T18:43:49.688601+0000","last_became_active":"2024-09-13T18:39:54.667244+0000","last_became_peered":"2024-09-13T18:39:54.667244+0000","last_unstale":"2024-09-13T18:43:49.688601+0000","last_undegraded":"2024-09-13T18:43:49.688601+0000","last_fullsized":"2024-09-13T18:43:49.688601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-09-13T18:43:49.688505+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-09-13T18:43:49.688505+0000","last_clean_scrub_stamp":"2024-09-13T18:43:49.688505+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:54.329356+0000","scrub_duration":0.00167341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"23'171","reported_seq":194,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:15.679276+0000","last_change":"2024-09-13T18:44:15.679246+0000","last_active":"2024-09-13T18:44:15.679276+0000","last_peered":"2024-09-13T18:44:15.679276+0000","last_clean":"2024-09-13T18:44:15.679276+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:44:15.679276+0000","last_undegraded":"2024-09-13T18:44:15.679276+0000","last_fullsized":"2024-09-13T18:44:15.679276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'171","last_scrub_stamp":"2024-09-13T18:44:15.679145+0000","last_deep_scrub":"23'171","last_deep_scrub_stamp":"2024-09-13T18:44:15.679145+0000","last_clean_scrub_stamp":"2024-09-13T18:44:15.679145+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:41.597377+0000","scrub_duration":0.002087616,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"23'99","reported_seq":123,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:24.727856+0000","last_change":"2024-09-13T18:44:24.727829+0000","last_active":"2024-09-13T18:44:24.727856+0000","last_peered":"2024-09-13T18:44:24.727856+0000","last_clean":"2024-09-13T18:44:24.727856+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:44:24.727856+0000","last_undegraded":"2024-09-13T18:44:24.727856+0000","last_fullsized":"2024-09-13T18:44:24.727856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'99","last_scrub_stamp":"2024-09-13T18:44:24.727735+0000","last_deep_scrub":"23'99","last_deep_scrub_stamp":"2024-09-13T18:44:24.727735+0000","last_clean_scrub_stamp":"2024-09-13T18:44:24.727735+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:26.329227+0000","scrub_duration":0.0056265730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198201,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"23'157","reported_seq":180,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:55.780613+0000","last_change":"2024-09-13T18:43:55.780577+0000","last_active":"2024-09-13T18:43:55.780613+0000","last_peered":"2024-09-13T18:43:55.780613+0000","last_clean":"2024-09-13T18:43:55.780613+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:43:55.780613+0000","last_undegraded":"2024-09-13T18:43:55.780613+0000","last_fullsized":"2024-09-13T18:43:55.780613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'157","last_scrub_stamp":"2024-09-13T18:43:55.780470+0000","last_deep_scrub":"23'157","last_deep_scrub_stamp":"2024-09-13T18:43:55.780470+0000","last_clean_scrub_stamp":"2024-09-13T18:43:55.780470+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:19.819546+0000","scrub_duration":0.0021443629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'10","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:28.523474+0000","last_change":"2024-09-13T18:44:28.523440+0000","last_active":"2024-09-13T18:44:28.523474+0000","last_peered":"2024-09-13T18:44:28.523474+0000","last_clean":"2024-09-13T18:44:28.523474+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:44:28.523474+0000","last_undegraded":"2024-09-13T18:44:28.523474+0000","last_fullsized":"2024-09-13T18:44:28.523474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-09-13T18:44:28.523349+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-09-13T18:44:28.523349+0000","last_clean_scrub_stamp":"2024-09-13T18:44:28.523349+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:23.345989+0000","scrub_duration":0.0033572989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:09.738028+0000","last_change":"2024-09-13T18:44:09.738008+0000","last_active":"2024-09-13T18:44:09.738028+0000","last_peered":"2024-09-13T18:44:09.738028+0000","last_clean":"2024-09-13T18:44:09.738028+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:44:09.738028+0000","last_undegraded":"2024-09-13T18:44:09.738028+0000","last_fullsized":"2024-09-13T18:44:09.738028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:09.737921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:09.737921+0000","last_clean_scrub_stamp":"2024-09-13T18:44:09.737921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:46.697943+0000","scrub_duration":0.001162988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'189","reported_seq":212,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:23.686400+0000","last_change":"2024-09-13T18:44:23.686366+0000","last_active":"2024-09-13T18:44:23.686400+0000","last_peered":"2024-09-13T18:44:23.686400+0000","last_clean":"2024-09-13T18:44:23.686400+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:44:23.686400+0000","last_undegraded":"2024-09-13T18:44:23.686400+0000","last_fullsized":"2024-09-13T18:44:23.686400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'189","last_scrub_stamp":"2024-09-13T18:44:23.686241+0000","last_deep_scrub":"23'189","last_deep_scrub_stamp":"2024-09-13T18:44:23.686241+0000","last_clean_scrub_stamp":"2024-09-13T18:44:23.686241+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:41.829839+0000","scrub_duration":0.002437472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:08.569034+0000","last_change":"2024-09-13T18:44:08.569010+0000","last_active":"2024-09-13T18:44:08.569034+0000","last_peered":"2024-09-13T18:44:08.569034+0000","last_clean":"2024-09-13T18:44:08.569034+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:44:08.569034+0000","last_undegraded":"2024-09-13T18:44:08.569034+0000","last_fullsized":"2024-09-13T18:44:08.569034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-09-13T18:44:08.568898+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-09-13T18:44:08.568898+0000","last_clean_scrub_stamp":"2024-09-13T18:44:08.568898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:30.299507+0000","scrub_duration":0.00140011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'165","reported_seq":188,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:18.646199+0000","last_change":"2024-09-13T18:44:18.646173+0000","last_active":"2024-09-13T18:44:18.646199+0000","last_peered":"2024-09-13T18:44:18.646199+0000","last_clean":"2024-09-13T18:44:18.646199+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:44:18.646199+0000","last_undegraded":"2024-09-13T18:44:18.646199+0000","last_fullsized":"2024-09-13T18:44:18.646199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'165","last_scrub_stamp":"2024-09-13T18:44:18.646081+0000","last_deep_scrub":"23'165","last_deep_scrub_stamp":"2024-09-13T18:44:18.646081+0000","last_clean_scrub_stamp":"2024-09-13T18:44:18.646081+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:13.468721+0000","scrub_duration":0.0021880950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'135","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:42.589014+0000","last_change":"2024-09-13T18:44:42.588971+0000","last_active":"2024-09-13T18:44:42.589014+0000","last_peered":"2024-09-13T18:44:42.589014+0000","last_clean":"2024-09-13T18:44:42.589014+0000","last_became_active":"2024-09-13T18:39:54.667809+0000","last_became_peered":"2024-09-13T18:39:54.667809+0000","last_unstale":"2024-09-13T18:44:42.589014+0000","last_undegraded":"2024-09-13T18:44:42.589014+0000","last_fullsized":"2024-09-13T18:44:42.589014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'135","last_scrub_stamp":"2024-09-13T18:44:42.588850+0000","last_deep_scrub":"23'135","last_deep_scrub_stamp":"2024-09-13T18:44:42.588850+0000","last_clean_scrub_stamp":"2024-09-13T18:44:42.588850+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:38.611073+0000","scrub_duration":0.0020869019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:58.697793+0000","last_change":"2024-09-13T18:43:58.697767+0000","last_active":"2024-09-13T18:43:58.697793+0000","last_peered":"2024-09-13T18:43:58.697793+0000","last_clean":"2024-09-13T18:43:58.697793+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:43:58.697793+0000","last_undegraded":"2024-09-13T18:43:58.697793+0000","last_fullsized":"2024-09-13T18:43:58.697793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:58.697674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:58.697674+0000","last_clean_scrub_stamp":"2024-09-13T18:43:58.697674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:47.894303+0000","scrub_duration":0.0013764059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"23'152","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:38.734778+0000","last_change":"2024-09-13T18:39:14.586848+0000","last_active":"2024-09-13T18:43:38.734778+0000","last_peered":"2024-09-13T18:43:38.734778+0000","last_clean":"2024-09-13T18:43:38.734778+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:43:38.734778+0000","last_undegraded":"2024-09-13T18:43:38.734778+0000","last_fullsized":"2024-09-13T18:43:38.734778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:13.543076+0000","last_clean_scrub_stamp":"2024-09-13T18:39:13.543076+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:22.538801+0000","last_change":"2024-09-13T18:44:22.538766+0000","last_active":"2024-09-13T18:44:22.538801+0000","last_peered":"2024-09-13T18:44:22.538801+0000","last_clean":"2024-09-13T18:44:22.538801+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:44:22.538801+0000","last_undegraded":"2024-09-13T18:44:22.538801+0000","last_fullsized":"2024-09-13T18:44:22.538801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:22.538665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:22.538665+0000","last_clean_scrub_stamp":"2024-09-13T18:44:22.538665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:44.638156+0000","scrub_duration":0.0014664400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"23'183","reported_seq":203,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:43.632578+0000","last_change":"2024-09-13T18:44:43.632547+0000","last_active":"2024-09-13T18:44:43.632578+0000","last_peered":"2024-09-13T18:44:43.632578+0000","last_clean":"2024-09-13T18:44:43.632578+0000","last_became_active":"2024-09-13T18:39:54.668613+0000","last_became_peered":"2024-09-13T18:39:54.668613+0000","last_unstale":"2024-09-13T18:44:43.632578+0000","last_undegraded":"2024-09-13T18:44:43.632578+0000","last_fullsized":"2024-09-13T18:44:43.632578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'183","last_scrub_stamp":"2024-09-13T18:44:43.632454+0000","last_deep_scrub":"23'183","last_deep_scrub_stamp":"2024-09-13T18:44:43.632454+0000","last_clean_scrub_stamp":"2024-09-13T18:44:43.632454+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:13.302697+0000","scrub_duration":0.002143023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:06.658725+0000","last_change":"2024-09-13T18:44:06.658686+0000","last_active":"2024-09-13T18:44:06.658725+0000","last_peered":"2024-09-13T18:44:06.658725+0000","last_clean":"2024-09-13T18:44:06.658725+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:44:06.658725+0000","last_undegraded":"2024-09-13T18:44:06.658725+0000","last_fullsized":"2024-09-13T18:44:06.658725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:44:06.658584+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:44:06.658584+0000","last_clean_scrub_stamp":"2024-09-13T18:44:06.658584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:01.104314+0000","scrub_duration":0.0014171240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"23'141","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:22.638805+0000","last_change":"2024-09-13T18:44:22.638773+0000","last_active":"2024-09-13T18:44:22.638805+0000","last_peered":"2024-09-13T18:44:22.638805+0000","last_clean":"2024-09-13T18:44:22.638805+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:44:22.638805+0000","last_undegraded":"2024-09-13T18:44:22.638805+0000","last_fullsized":"2024-09-13T18:44:22.638805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'141","last_scrub_stamp":"2024-09-13T18:44:22.638683+0000","last_deep_scrub":"23'141","last_deep_scrub_stamp":"2024-09-13T18:44:22.638683+0000","last_clean_scrub_stamp":"2024-09-13T18:44:22.638683+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:54.344049+0000","scrub_duration":0.0020241450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:33.553093+0000","last_change":"2024-09-13T18:44:33.553058+0000","last_active":"2024-09-13T18:44:33.553093+0000","last_peered":"2024-09-13T18:44:33.553093+0000","last_clean":"2024-09-13T18:44:33.553093+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:44:33.553093+0000","last_undegraded":"2024-09-13T18:44:33.553093+0000","last_fullsized":"2024-09-13T18:44:33.553093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:44:33.552934+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:44:33.552934+0000","last_clean_scrub_stamp":"2024-09-13T18:44:33.552934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:51.696532+0000","scrub_duration":0.001422319,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"23'137","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:25.605839+0000","last_change":"2024-09-13T18:44:25.605809+0000","last_active":"2024-09-13T18:44:25.605839+0000","last_peered":"2024-09-13T18:44:25.605839+0000","last_clean":"2024-09-13T18:44:25.605839+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:44:25.605839+0000","last_undegraded":"2024-09-13T18:44:25.605839+0000","last_fullsized":"2024-09-13T18:44:25.605839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'137","last_scrub_stamp":"2024-09-13T18:44:25.605695+0000","last_deep_scrub":"23'137","last_deep_scrub_stamp":"2024-09-13T18:44:25.605695+0000","last_clean_scrub_stamp":"2024-09-13T18:44:25.605695+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:20.428335+0000","scrub_duration":0.0021889399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'3","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:32.507770+0000","last_change":"2024-09-13T18:44:32.507734+0000","last_active":"2024-09-13T18:44:32.507770+0000","last_peered":"2024-09-13T18:44:32.507770+0000","last_clean":"2024-09-13T18:44:32.507770+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:44:32.507770+0000","last_undegraded":"2024-09-13T18:44:32.507770+0000","last_fullsized":"2024-09-13T18:44:32.507770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-13T18:44:32.507647+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-13T18:44:32.507647+0000","last_clean_scrub_stamp":"2024-09-13T18:44:32.507647+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:27.330287+0000","scrub_duration":0.0024407769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"23'130","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:55.721042+0000","last_change":"2024-09-13T18:43:55.721011+0000","last_active":"2024-09-13T18:43:55.721042+0000","last_peered":"2024-09-13T18:43:55.721042+0000","last_clean":"2024-09-13T18:43:55.721042+0000","last_became_active":"2024-09-13T18:39:54.667188+0000","last_became_peered":"2024-09-13T18:39:54.667188+0000","last_unstale":"2024-09-13T18:43:55.721042+0000","last_undegraded":"2024-09-13T18:43:55.721042+0000","last_fullsized":"2024-09-13T18:43:55.721042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'130","last_scrub_stamp":"2024-09-13T18:43:55.720852+0000","last_deep_scrub":"23'130","last_deep_scrub_stamp":"2024-09-13T18:43:55.720852+0000","last_clean_scrub_stamp":"2024-09-13T18:43:55.720852+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:45.416337+0000","scrub_duration":0.002372299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'4","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:35.754807+0000","last_change":"2024-09-13T18:44:35.754782+0000","last_active":"2024-09-13T18:44:35.754807+0000","last_peered":"2024-09-13T18:44:35.754807+0000","last_clean":"2024-09-13T18:44:35.754807+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:44:35.754807+0000","last_undegraded":"2024-09-13T18:44:35.754807+0000","last_fullsized":"2024-09-13T18:44:35.754807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-09-13T18:44:35.754687+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-09-13T18:44:35.754687+0000","last_clean_scrub_stamp":"2024-09-13T18:44:35.754687+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:31.776910+0000","scrub_duration":0.0024488629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'157","reported_seq":180,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:51.713030+0000","last_change":"2024-09-13T18:43:51.713001+0000","last_active":"2024-09-13T18:43:51.713030+0000","last_peered":"2024-09-13T18:43:51.713030+0000","last_clean":"2024-09-13T18:43:51.713030+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:43:51.713030+0000","last_undegraded":"2024-09-13T18:43:51.713030+0000","last_fullsized":"2024-09-13T18:43:51.713030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'157","last_scrub_stamp":"2024-09-13T18:43:51.712881+0000","last_deep_scrub":"23'157","last_deep_scrub_stamp":"2024-09-13T18:43:51.712881+0000","last_clean_scrub_stamp":"2024-09-13T18:43:51.712881+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:48.113167+0000","scrub_duration":0.002119082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:37.738171+0000","last_change":"2024-09-13T18:44:37.738127+0000","last_active":"2024-09-13T18:44:37.738171+0000","last_peered":"2024-09-13T18:44:37.738171+0000","last_clean":"2024-09-13T18:44:37.738171+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:44:37.738171+0000","last_undegraded":"2024-09-13T18:44:37.738171+0000","last_fullsized":"2024-09-13T18:44:37.738171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:44:37.738010+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:44:37.738010+0000","last_clean_scrub_stamp":"2024-09-13T18:44:37.738010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:58.881605+0000","scrub_duration":0.0014234600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"23'170","reported_seq":193,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:16.668173+0000","last_change":"2024-09-13T18:44:16.668146+0000","last_active":"2024-09-13T18:44:16.668173+0000","last_peered":"2024-09-13T18:44:16.668173+0000","last_clean":"2024-09-13T18:44:16.668173+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:44:16.668173+0000","last_undegraded":"2024-09-13T18:44:16.668173+0000","last_fullsized":"2024-09-13T18:44:16.668173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'170","last_scrub_stamp":"2024-09-13T18:44:16.668031+0000","last_deep_scrub":"23'170","last_deep_scrub_stamp":"2024-09-13T18:44:16.668031+0000","last_clean_scrub_stamp":"2024-09-13T18:44:16.668031+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:38.767522+0000","scrub_duration":0.002367409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"23'6","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:01.483853+0000","last_change":"2024-09-13T18:44:01.483824+0000","last_active":"2024-09-13T18:44:01.483853+0000","last_peered":"2024-09-13T18:44:01.483853+0000","last_clean":"2024-09-13T18:44:01.483853+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:44:01.483853+0000","last_undegraded":"2024-09-13T18:44:01.483853+0000","last_fullsized":"2024-09-13T18:44:01.483853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-09-13T18:44:01.483735+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-09-13T18:44:01.483735+0000","last_clean_scrub_stamp":"2024-09-13T18:44:01.483735+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:57.884021+0000","scrub_duration":0.0032014309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":199492,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":160,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":398984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":174,"ondisk_log_size":174,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705737,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306084,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065756,"statfs":{"total":96636764160,"available":96323334144,"internally_reserved":0,"allocated":421888,"data_stored":266388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.33900000000000002,"15min":0.32100000000000001},"min":{"1min":0.17299999999999999,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.48399999999999999,"5min":4.5049999999999999,"15min":4.5049999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.22600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.1679999999999999,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.35999999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.375,"15min":0.34899999999999998},"min":{"1min":0.251,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.94599999999999995,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.37,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.187,"15min":0.187},"max":{"1min":0.98399999999999999,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.33500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.96899999999999997,"5min":3,"15min":3},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.39000000000000001,"15min":0.37},"min":{"1min":0.245,"5min":0.22,"15min":0.22},"max":{"1min":0.84899999999999998,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":0.34699999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705738,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306072,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065768,"statfs":{"total":96636764160,"available":96323346432,"internally_reserved":0,"allocated":409600,"data_stored":266680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:44:10 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.21199999999999999,"5min":0.151,"15min":0.151},"max":{"1min":0.42399999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.31,"5min":0.33000000000000002,"15min":0.33100000000000002},"min":{"1min":0.20200000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.41999999999999998,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:44:10 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.215,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.40699999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.379},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34000000000000002,"15min":0.34300000000000003},"min":{"1min":0.23000000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.44700000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:44:10 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34799999999999998,"15min":0.34499999999999997},"min":{"1min":0.23999999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.51300000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.373,"15min":0.373},"min":{"1min":0.249,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46300000000000002,"5min":1.47,"15min":1.47},"last":0.41099999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705736,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306460,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065380,"statfs":{"total":96636764160,"available":96322949120,"internally_reserved":0,"allocated":806912,"data_stored":659023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35699999999999998,"15min":0.31900000000000001},"min":{"1min":0.224,"5min":0.159,"15min":0.159},"max":{"1min":0.75,"5min":1.849,"15min":1.849},"last":0.442},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.33800000000000002},"min":{"1min":0.22600000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40600000000000003,"15min":0.35599999999999998},"min":{"1min":0.19500000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.71899999999999997,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.38200000000000001,"15min":0.35399999999999998},"min":{"1min":0.26700000000000002,"5min":0.192,"15min":0.192},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.38800000000000001,"15min":0.35799999999999998},"min":{"1min":0.25900000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.45500000000000002,"15min":0.38900000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":2.9430000000000001,"5min":6.468,"15min":6.468},"last":0.52500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306464,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065376,"statfs":{"total":96636764160,"available":96322945024,"internally_reserved":0,"allocated":811008,"data_stored":659563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:44:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":0.48499999999999999,"15min":0.36699999999999999},"min":{"1min":0.19,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":20.393000000000001,"5min":20.393000000000001,"15min":20.393000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.41599999999999998,"15min":0.36199999999999999},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":9.7189999999999994,"5min":9.7189999999999994,"15min":9.7189999999999994},"last":0.435}]},{"osd":2,"last update":"Fri Sep 13 18:44:08 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.20499999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.44400000000000001,"15min":0.374},"min":{"1min":0.222,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":11.726000000000001,"5min":11.726000000000001,"15min":11.726000000000001},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:44:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":0.51000000000000001,"15min":0.40999999999999998},"min":{"1min":0.248,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":16.503,"5min":16.503,"15min":16.503},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.34699999999999998,"15min":0.35499999999999998},"min":{"1min":0.21099999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.47699999999999998,"5min":0.496,"15min":0.496},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":198706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":198395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:44:50.348 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.349 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.349 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.349 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.349 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.349 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.349 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.350 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.350 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.350 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.350 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.350 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.350 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.350 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.351 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:39:12.536362+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.351 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.351 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.351 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T18:39:13.543076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=39, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=43, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:44:50.352 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:45:10.353 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:10.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.455+0000 7fa94f95d640 1 Processor -- start 2024-09-13T18:45:10.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.455+0000 7fa94f95d640 1 -- start start 2024-09-13T18:45:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94f95d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa94809dfb0 0x7fa948096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94f95d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa9480969d0 0x7fa9480974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94f95d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94806a190 con 0x7fa94812bf70 2024-09-13T18:45:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94f95d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94809e380 con 0x7fa9480969d0 2024-09-13T18:45:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94f95d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa948098870 con 0x7fa94809dfb0 2024-09-13T18:45:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94cef8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa9480969d0 0x7fa9480974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94d6f9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa94809dfb0 0x7fa948096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94defa640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa94812bf70 0x7fa94812c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35428/0 (socket says 172.21.15.97:35428) 2024-09-13T18:45:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94cef8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa9480969d0 0x7fa9480974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60920/0 (socket says 172.21.15.97:60920) 2024-09-13T18:45:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94d6f9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa94809dfb0 0x7fa948096f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:57712/0 (socket says 172.21.15.97:57712) 2024-09-13T18:45:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94defa640 1 -- 172.21.15.97:0/116042232 learned_addr learned my addr 172.21.15.97:0/116042232 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:45:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94d6f9640 1 -- 172.21.15.97:0/116042232 >> v2:172.21.15.97:3300/0 conn(0x7fa9480969d0 msgr2=0x7fa9480974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94d6f9640 1 --2- 172.21.15.97:0/116042232 >> v2:172.21.15.97:3300/0 conn(0x7fa9480969d0 0x7fa9480974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94d6f9640 1 -- 172.21.15.97:0/116042232 >> v1:172.21.15.97:6789/0 conn(0x7fa94812bf70 legacy=0x7fa94812c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa93ffff640 1 -- 172.21.15.97:0/116042232 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577042432 0 0) 0x7fa94806a190 con 0x7fa94812bf70 2024-09-13T18:45:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94d6f9640 1 -- 172.21.15.97:0/116042232 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa948098e10 con 0x7fa94809dfb0 2024-09-13T18:45:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.456+0000 7fa94cef8640 1 --2- 172.21.15.97:0/116042232 >> v2:172.21.15.97:3300/0 conn(0x7fa9480969d0 0x7fa9480974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.457+0000 7fa94d6f9640 1 --2- 172.21.15.97:0/116042232 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa94809dfb0 0x7fa948096f80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa9440098b0 tx=0x7fa9440090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd266261d173658a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.457+0000 7fa93ffff640 1 -- 172.21.15.97:0/116042232 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94402ad20 con 0x7fa94809dfb0 2024-09-13T18:45:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.457+0000 7fa93ffff640 1 -- 172.21.15.97:0/116042232 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94402ae80 con 0x7fa94809dfb0 2024-09-13T18:45:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.457+0000 7fa93ffff640 1 -- 172.21.15.97:0/116042232 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944032670 con 0x7fa94809dfb0 2024-09-13T18:45:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.458+0000 7fa94f95d640 1 -- 172.21.15.97:0/116042232 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa94809dfb0 msgr2=0x7fa948096f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.458+0000 7fa94f95d640 1 --2- 172.21.15.97:0/116042232 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa94809dfb0 0x7fa948096f80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa9440098b0 tx=0x7fa9440090f0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.458+0000 7fa94f95d640 1 -- 172.21.15.97:0/116042232 shutdown_connections 2024-09-13T18:45:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.458+0000 7fa94f95d640 1 --2- 172.21.15.97:0/116042232 >> v2:172.21.15.97:3300/0 conn(0x7fa9480969d0 0x7fa9480974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.458+0000 7fa94f95d640 1 --2- 172.21.15.97:0/116042232 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa94809dfb0 0x7fa948096f80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.458+0000 7fa94f95d640 1 -- 172.21.15.97:0/116042232 >> 172.21.15.97:0/116042232 conn(0x7fa94809b200 msgr2=0x7fa94809b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.458+0000 7fa94f95d640 1 -- 172.21.15.97:0/116042232 shutdown_connections 2024-09-13T18:45:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.458+0000 7fa94f95d640 1 -- 172.21.15.97:0/116042232 wait complete. 2024-09-13T18:45:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.458+0000 7fa94f95d640 1 Processor -- start 2024-09-13T18:45:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.459+0000 7fa94f95d640 1 -- start start 2024-09-13T18:45:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.459+0000 7fa94f95d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9480969d0 0x7fa948131b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.459+0000 7fa94f95d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa94809dfb0 0x7fa948132040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.459+0000 7fa94f95d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa94812bf70 0x7fa948132580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:10.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.459+0000 7fa94f95d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94811ae20 con 0x7fa94809dfb0 2024-09-13T18:45:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.459+0000 7fa94f95d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa948097e10 con 0x7fa9480969d0 2024-09-13T18:45:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.459+0000 7fa94f95d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa948099590 con 0x7fa94812bf70 2024-09-13T18:45:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.459+0000 7fa94d6f9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9480969d0 0x7fa948131b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.459+0000 7fa94d6f9640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9480969d0 0x7fa948131b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:57716/0 (socket says 172.21.15.97:57716) 2024-09-13T18:45:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.459+0000 7fa94d6f9640 1 -- 172.21.15.97:0/640256994 learned_addr learned my addr 172.21.15.97:0/640256994 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.459+0000 7fa94defa640 1 --2- 172.21.15.97:0/640256994 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa94812bf70 0x7fa948132580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.459+0000 7fa94cef8640 1 --2- 172.21.15.97:0/640256994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa94809dfb0 0x7fa948132040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.460+0000 7fa94d6f9640 1 -- 172.21.15.97:0/640256994 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa94812bf70 msgr2=0x7fa948132580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.460+0000 7fa94d6f9640 1 --2- 172.21.15.97:0/640256994 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa94812bf70 0x7fa948132580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.460+0000 7fa94d6f9640 1 -- 172.21.15.97:0/640256994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa94809dfb0 msgr2=0x7fa948132040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.460+0000 7fa94d6f9640 1 --2- 172.21.15.97:0/640256994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa94809dfb0 0x7fa948132040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.460+0000 7fa94d6f9640 1 -- 172.21.15.97:0/640256994 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa938009390 con 0x7fa9480969d0 2024-09-13T18:45:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.460+0000 7fa94cef8640 1 --2- 172.21.15.97:0/640256994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa94809dfb0 0x7fa948132040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.460+0000 7fa94d6f9640 1 --2- 172.21.15.97:0/640256994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9480969d0 0x7fa948131b00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa9440098b0 tx=0x7fa944032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.460+0000 7fa93d7fa640 1 -- 172.21.15.97:0/640256994 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94403c750 con 0x7fa9480969d0 2024-09-13T18:45:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.460+0000 7fa93d7fa640 1 -- 172.21.15.97:0/640256994 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94403c8b0 con 0x7fa9480969d0 2024-09-13T18:45:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.460+0000 7fa94f95d640 1 -- 172.21.15.97:0/640256994 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa944009390 con 0x7fa9480969d0 2024-09-13T18:45:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.460+0000 7fa93d7fa640 1 -- 172.21.15.97:0/640256994 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94403cc30 con 0x7fa9480969d0 2024-09-13T18:45:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.460+0000 7fa94f95d640 1 -- 172.21.15.97:0/640256994 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94811a9f0 con 0x7fa9480969d0 2024-09-13T18:45:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.461+0000 7fa93d7fa640 1 -- 172.21.15.97:0/640256994 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fa944039040 con 0x7fa9480969d0 2024-09-13T18:45:10.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.461+0000 7fa93d7fa640 1 -- 172.21.15.97:0/640256994 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fa944042030 con 0x7fa9480969d0 2024-09-13T18:45:10.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.461+0000 7fa94f95d640 1 -- 172.21.15.97:0/640256994 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa948064000 con 0x7fa9480969d0 2024-09-13T18:45:10.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.466+0000 7fa93d7fa640 1 -- 172.21.15.97:0/640256994 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fa944037080 con 0x7fa9480969d0 2024-09-13T18:45:10.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.618+0000 7fa94f95d640 1 -- 172.21.15.97:0/640256994 --> v1:172.21.15.97:6816/34603 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa94806e390 con 0x7fa92c031160 2024-09-13T18:45:10.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.624+0000 7fa93d7fa640 1 -- 172.21.15.97:0/640256994 <== mgr.4107 v1:172.21.15.97:6816/34603 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279649 (unknown 2965378022 0 3540738613) 0x7fa94806e390 con 0x7fa92c031160 2024-09-13T18:45:10.631 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:45:10.632 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-13T18:45:10.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.627+0000 7fa94f95d640 1 -- 172.21.15.97:0/640256994 >> v1:172.21.15.97:6816/34603 conn(0x7fa92c031160 legacy=0x7fa92c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:10.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.627+0000 7fa94f95d640 1 -- 172.21.15.97:0/640256994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9480969d0 msgr2=0x7fa948131b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:10.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.627+0000 7fa94f95d640 1 --2- 172.21.15.97:0/640256994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9480969d0 0x7fa948131b00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa9440098b0 tx=0x7fa944032000 comp rx=0 tx=0).stop 2024-09-13T18:45:10.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.627+0000 7fa94f95d640 1 -- 172.21.15.97:0/640256994 shutdown_connections 2024-09-13T18:45:10.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.627+0000 7fa94f95d640 1 --2- 172.21.15.97:0/640256994 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fa94812bf70 0x7fa948132580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.627+0000 7fa94f95d640 1 --2- 172.21.15.97:0/640256994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa94809dfb0 0x7fa948132040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.627+0000 7fa94f95d640 1 --2- 172.21.15.97:0/640256994 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fa9480969d0 0x7fa948131b00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.627+0000 7fa94f95d640 1 -- 172.21.15.97:0/640256994 >> 172.21.15.97:0/640256994 conn(0x7fa94809b200 msgr2=0x7fa94809cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:10.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.627+0000 7fa94f95d640 1 -- 172.21.15.97:0/640256994 shutdown_connections 2024-09-13T18:45:10.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.627+0000 7fa94f95d640 1 -- 172.21.15.97:0/640256994 wait complete. 2024-09-13T18:45:10.641 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-13T18:45:09.433652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":789879,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":60,"num_read_kb":50,"num_write":9457,"num_write_kb":25167188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9951,"ondisk_log_size":9951,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1225080,"kb_used_data":2392,"kb_used_omap":6,"kb_used_meta":1222649,"kb_avail":376262280,"statfs":{"total":386547056640,"available":385292574720,"internally_reserved":0,"allocated":2449408,"data_stored":1851654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6816,"internal_metadata":1251992928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003578"},"pg_stats":[{"pgid":"4.3f","version":"23'146","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:24.587458+0000","last_change":"2024-09-13T18:44:24.587416+0000","last_active":"2024-09-13T18:44:24.587458+0000","last_peered":"2024-09-13T18:44:24.587458+0000","last_clean":"2024-09-13T18:44:24.587458+0000","last_became_active":"2024-09-13T18:39:14.592493+0000","last_became_peered":"2024-09-13T18:39:14.592493+0000","last_unstale":"2024-09-13T18:44:24.587458+0000","last_undegraded":"2024-09-13T18:44:24.587458+0000","last_fullsized":"2024-09-13T18:44:24.587458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'146","last_scrub_stamp":"2024-09-13T18:44:24.587315+0000","last_deep_scrub":"23'146","last_deep_scrub_stamp":"2024-09-13T18:44:24.587315+0000","last_clean_scrub_stamp":"2024-09-13T18:44:24.587315+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:57.059776+0000","scrub_duration":0.0022202530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"23'130","reported_seq":153,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:33.528135+0000","last_change":"2024-09-13T18:44:33.528103+0000","last_active":"2024-09-13T18:44:33.528135+0000","last_peered":"2024-09-13T18:44:33.528135+0000","last_clean":"2024-09-13T18:44:33.528135+0000","last_became_active":"2024-09-13T18:39:14.581004+0000","last_became_peered":"2024-09-13T18:39:14.581004+0000","last_unstale":"2024-09-13T18:44:33.528135+0000","last_undegraded":"2024-09-13T18:44:33.528135+0000","last_fullsized":"2024-09-13T18:44:33.528135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'130","last_scrub_stamp":"2024-09-13T18:44:33.528004+0000","last_deep_scrub":"23'130","last_deep_scrub_stamp":"2024-09-13T18:44:33.528004+0000","last_clean_scrub_stamp":"2024-09-13T18:44:33.528004+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:33.058600+0000","scrub_duration":0.0020778960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'151","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:54.481559+0000","last_change":"2024-09-13T18:43:54.481533+0000","last_active":"2024-09-13T18:43:54.481559+0000","last_peered":"2024-09-13T18:43:54.481559+0000","last_clean":"2024-09-13T18:43:54.481559+0000","last_became_active":"2024-09-13T18:39:14.585903+0000","last_became_peered":"2024-09-13T18:39:14.585903+0000","last_unstale":"2024-09-13T18:43:54.481559+0000","last_undegraded":"2024-09-13T18:43:54.481559+0000","last_fullsized":"2024-09-13T18:43:54.481559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-09-13T18:43:54.481437+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-09-13T18:43:54.481437+0000","last_clean_scrub_stamp":"2024-09-13T18:43:54.481437+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:14.609499+0000","scrub_duration":0.0021815789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"23'173","reported_seq":196,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:47.593075+0000","last_change":"2024-09-13T18:44:47.593032+0000","last_active":"2024-09-13T18:44:47.593075+0000","last_peered":"2024-09-13T18:44:47.593075+0000","last_clean":"2024-09-13T18:44:47.593075+0000","last_became_active":"2024-09-13T18:39:14.583627+0000","last_became_peered":"2024-09-13T18:39:14.583627+0000","last_unstale":"2024-09-13T18:44:47.593075+0000","last_undegraded":"2024-09-13T18:44:47.593075+0000","last_fullsized":"2024-09-13T18:44:47.593075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'173","last_scrub_stamp":"2024-09-13T18:44:47.592916+0000","last_deep_scrub":"23'173","last_deep_scrub_stamp":"2024-09-13T18:44:47.592916+0000","last_clean_scrub_stamp":"2024-09-13T18:44:47.592916+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:08.736511+0000","scrub_duration":0.0025295000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"23'148","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:46.609128+0000","last_change":"2024-09-13T18:44:46.609102+0000","last_active":"2024-09-13T18:44:46.609128+0000","last_peered":"2024-09-13T18:44:46.609128+0000","last_clean":"2024-09-13T18:44:46.609128+0000","last_became_active":"2024-09-13T18:39:14.577630+0000","last_became_peered":"2024-09-13T18:39:14.577630+0000","last_unstale":"2024-09-13T18:44:46.609128+0000","last_undegraded":"2024-09-13T18:44:46.609128+0000","last_fullsized":"2024-09-13T18:44:46.609128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'148","last_scrub_stamp":"2024-09-13T18:44:46.609007+0000","last_deep_scrub":"23'148","last_deep_scrub_stamp":"2024-09-13T18:44:46.609007+0000","last_clean_scrub_stamp":"2024-09-13T18:44:46.609007+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:16.279250+0000","scrub_duration":0.0021789420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'135","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:50.746882+0000","last_change":"2024-09-13T18:44:50.746855+0000","last_active":"2024-09-13T18:44:50.746882+0000","last_peered":"2024-09-13T18:44:50.746882+0000","last_clean":"2024-09-13T18:44:50.746882+0000","last_became_active":"2024-09-13T18:39:14.590557+0000","last_became_peered":"2024-09-13T18:39:14.590557+0000","last_unstale":"2024-09-13T18:44:50.746882+0000","last_undegraded":"2024-09-13T18:44:50.746882+0000","last_fullsized":"2024-09-13T18:44:50.746882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'135","last_scrub_stamp":"2024-09-13T18:44:50.746776+0000","last_deep_scrub":"23'135","last_deep_scrub_stamp":"2024-09-13T18:44:50.746776+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.746776+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:39.541888+0000","scrub_duration":0.0015824680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'164","reported_seq":187,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:45:03.903881+0000","last_change":"2024-09-13T18:45:03.903825+0000","last_active":"2024-09-13T18:45:03.903881+0000","last_peered":"2024-09-13T18:45:03.903881+0000","last_clean":"2024-09-13T18:45:03.903881+0000","last_became_active":"2024-09-13T18:39:14.590502+0000","last_became_peered":"2024-09-13T18:39:14.590502+0000","last_unstale":"2024-09-13T18:45:03.903881+0000","last_undegraded":"2024-09-13T18:45:03.903881+0000","last_fullsized":"2024-09-13T18:45:03.903881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'164","last_scrub_stamp":"2024-09-13T18:45:03.903718+0000","last_deep_scrub":"23'164","last_deep_scrub_stamp":"2024-09-13T18:45:03.903718+0000","last_clean_scrub_stamp":"2024-09-13T18:45:03.903718+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:31.343146+0000","scrub_duration":0.0023781919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'186","reported_seq":209,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:49.379818+0000","last_change":"2024-09-13T18:44:49.379772+0000","last_active":"2024-09-13T18:44:49.379818+0000","last_peered":"2024-09-13T18:44:49.379818+0000","last_clean":"2024-09-13T18:44:49.379818+0000","last_became_active":"2024-09-13T18:39:14.594891+0000","last_became_peered":"2024-09-13T18:39:14.594891+0000","last_unstale":"2024-09-13T18:44:49.379818+0000","last_undegraded":"2024-09-13T18:44:49.379818+0000","last_fullsized":"2024-09-13T18:44:49.379818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'186","last_scrub_stamp":"2024-09-13T18:44:49.379668+0000","last_deep_scrub":"23'186","last_deep_scrub_stamp":"2024-09-13T18:44:49.379668+0000","last_clean_scrub_stamp":"2024-09-13T18:44:49.379668+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:45.401891+0000","scrub_duration":0.0022339759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"23'152","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:36.615924+0000","last_change":"2024-09-13T18:44:36.615881+0000","last_active":"2024-09-13T18:44:36.615924+0000","last_peered":"2024-09-13T18:44:36.615924+0000","last_clean":"2024-09-13T18:44:36.615924+0000","last_became_active":"2024-09-13T18:39:14.585209+0000","last_became_peered":"2024-09-13T18:39:14.585209+0000","last_unstale":"2024-09-13T18:44:36.615924+0000","last_undegraded":"2024-09-13T18:44:36.615924+0000","last_fullsized":"2024-09-13T18:44:36.615924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'152","last_scrub_stamp":"2024-09-13T18:44:36.615783+0000","last_deep_scrub":"23'152","last_deep_scrub_stamp":"2024-09-13T18:44:36.615783+0000","last_clean_scrub_stamp":"2024-09-13T18:44:36.615783+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.146380+0000","scrub_duration":0.0021429880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'156","reported_seq":179,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:40.390514+0000","last_change":"2024-09-13T18:44:40.390485+0000","last_active":"2024-09-13T18:44:40.390514+0000","last_peered":"2024-09-13T18:44:40.390514+0000","last_clean":"2024-09-13T18:44:40.390514+0000","last_became_active":"2024-09-13T18:39:14.590792+0000","last_became_peered":"2024-09-13T18:39:14.590792+0000","last_unstale":"2024-09-13T18:44:40.390514+0000","last_undegraded":"2024-09-13T18:44:40.390514+0000","last_fullsized":"2024-09-13T18:44:40.390514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'156","last_scrub_stamp":"2024-09-13T18:44:40.390396+0000","last_deep_scrub":"23'156","last_deep_scrub_stamp":"2024-09-13T18:44:40.390396+0000","last_clean_scrub_stamp":"2024-09-13T18:44:40.390396+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:39.920992+0000","scrub_duration":0.0022820470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"23'189","reported_seq":212,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:57.776603+0000","last_change":"2024-09-13T18:43:57.776571+0000","last_active":"2024-09-13T18:43:57.776603+0000","last_peered":"2024-09-13T18:43:57.776603+0000","last_clean":"2024-09-13T18:43:57.776603+0000","last_became_active":"2024-09-13T18:39:14.588379+0000","last_became_peered":"2024-09-13T18:39:14.588379+0000","last_unstale":"2024-09-13T18:43:57.776603+0000","last_undegraded":"2024-09-13T18:43:57.776603+0000","last_fullsized":"2024-09-13T18:43:57.776603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'189","last_scrub_stamp":"2024-09-13T18:43:57.776474+0000","last_deep_scrub":"23'189","last_deep_scrub_stamp":"2024-09-13T18:43:57.776474+0000","last_clean_scrub_stamp":"2024-09-13T18:43:57.776474+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:17.904536+0000","scrub_duration":0.0023429969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"23'142","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:29.606521+0000","last_change":"2024-09-13T18:44:29.606478+0000","last_active":"2024-09-13T18:44:29.606521+0000","last_peered":"2024-09-13T18:44:29.606521+0000","last_clean":"2024-09-13T18:44:29.606521+0000","last_became_active":"2024-09-13T18:39:14.592357+0000","last_became_peered":"2024-09-13T18:39:14.592357+0000","last_unstale":"2024-09-13T18:44:29.606521+0000","last_undegraded":"2024-09-13T18:44:29.606521+0000","last_fullsized":"2024-09-13T18:44:29.606521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'142","last_scrub_stamp":"2024-09-13T18:44:29.606363+0000","last_deep_scrub":"23'142","last_deep_scrub_stamp":"2024-09-13T18:44:29.606363+0000","last_clean_scrub_stamp":"2024-09-13T18:44:29.606363+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:36.187986+0000","scrub_duration":0.0021615219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"23'151","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:30.620123+0000","last_change":"2024-09-13T18:44:30.620101+0000","last_active":"2024-09-13T18:44:30.620123+0000","last_peered":"2024-09-13T18:44:30.620123+0000","last_clean":"2024-09-13T18:44:30.620123+0000","last_became_active":"2024-09-13T18:39:14.596560+0000","last_became_peered":"2024-09-13T18:39:14.596560+0000","last_unstale":"2024-09-13T18:44:30.620123+0000","last_undegraded":"2024-09-13T18:44:30.620123+0000","last_fullsized":"2024-09-13T18:44:30.620123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-09-13T18:44:30.620017+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-09-13T18:44:30.620017+0000","last_clean_scrub_stamp":"2024-09-13T18:44:30.620017+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:48.763614+0000","scrub_duration":0.001830124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"23'149","reported_seq":172,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:52.386879+0000","last_change":"2024-09-13T18:44:52.386849+0000","last_active":"2024-09-13T18:44:52.386879+0000","last_peered":"2024-09-13T18:44:52.386879+0000","last_clean":"2024-09-13T18:44:52.386879+0000","last_became_active":"2024-09-13T18:39:14.572116+0000","last_became_peered":"2024-09-13T18:39:14.572116+0000","last_unstale":"2024-09-13T18:44:52.386879+0000","last_undegraded":"2024-09-13T18:44:52.386879+0000","last_fullsized":"2024-09-13T18:44:52.386879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'149","last_scrub_stamp":"2024-09-13T18:44:52.386748+0000","last_deep_scrub":"23'149","last_deep_scrub_stamp":"2024-09-13T18:44:52.386748+0000","last_clean_scrub_stamp":"2024-09-13T18:44:52.386748+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:22.893929+0000","scrub_duration":0.002235117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"23'151","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:52.482503+0000","last_change":"2024-09-13T18:43:52.482459+0000","last_active":"2024-09-13T18:43:52.482503+0000","last_peered":"2024-09-13T18:43:52.482503+0000","last_clean":"2024-09-13T18:43:52.482503+0000","last_became_active":"2024-09-13T18:39:14.582947+0000","last_became_peered":"2024-09-13T18:39:14.582947+0000","last_unstale":"2024-09-13T18:43:52.482503+0000","last_undegraded":"2024-09-13T18:43:52.482503+0000","last_fullsized":"2024-09-13T18:43:52.482503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-09-13T18:43:52.482365+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-09-13T18:43:52.482365+0000","last_clean_scrub_stamp":"2024-09-13T18:43:52.482365+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:01.098502+0000","scrub_duration":0.002317221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"23'147","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:58.843207+0000","last_change":"2024-09-13T18:44:58.843177+0000","last_active":"2024-09-13T18:44:58.843207+0000","last_peered":"2024-09-13T18:44:58.843207+0000","last_clean":"2024-09-13T18:44:58.843207+0000","last_became_active":"2024-09-13T18:39:14.592118+0000","last_became_peered":"2024-09-13T18:39:14.592118+0000","last_unstale":"2024-09-13T18:44:58.843207+0000","last_undegraded":"2024-09-13T18:44:58.843207+0000","last_fullsized":"2024-09-13T18:44:58.843207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'147","last_scrub_stamp":"2024-09-13T18:44:58.843067+0000","last_deep_scrub":"23'147","last_deep_scrub_stamp":"2024-09-13T18:44:58.843067+0000","last_clean_scrub_stamp":"2024-09-13T18:44:58.843067+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:46.089125+0000","scrub_duration":0.0021303369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'146","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:02.509096+0000","last_change":"2024-09-13T18:44:02.509068+0000","last_active":"2024-09-13T18:44:02.509096+0000","last_peered":"2024-09-13T18:44:02.509096+0000","last_clean":"2024-09-13T18:44:02.509096+0000","last_became_active":"2024-09-13T18:39:14.586565+0000","last_became_peered":"2024-09-13T18:39:14.586565+0000","last_unstale":"2024-09-13T18:44:02.509096+0000","last_undegraded":"2024-09-13T18:44:02.509096+0000","last_fullsized":"2024-09-13T18:44:02.509096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'146","last_scrub_stamp":"2024-09-13T18:44:02.508957+0000","last_deep_scrub":"23'146","last_deep_scrub_stamp":"2024-09-13T18:44:02.508957+0000","last_clean_scrub_stamp":"2024-09-13T18:44:02.508957+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:56.954687+0000","scrub_duration":0.0021744939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'157","reported_seq":180,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:50.578989+0000","last_change":"2024-09-13T18:44:50.578958+0000","last_active":"2024-09-13T18:44:50.578989+0000","last_peered":"2024-09-13T18:44:50.578989+0000","last_clean":"2024-09-13T18:44:50.578989+0000","last_became_active":"2024-09-13T18:39:14.586598+0000","last_became_peered":"2024-09-13T18:39:14.586598+0000","last_unstale":"2024-09-13T18:44:50.578989+0000","last_undegraded":"2024-09-13T18:44:50.578989+0000","last_fullsized":"2024-09-13T18:44:50.578989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'157","last_scrub_stamp":"2024-09-13T18:44:50.578879+0000","last_deep_scrub":"23'157","last_deep_scrub_stamp":"2024-09-13T18:44:50.578879+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.578879+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:42.291456+0000","scrub_duration":0.0017750470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"23'172","reported_seq":195,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:51.707972+0000","last_change":"2024-09-13T18:43:51.707927+0000","last_active":"2024-09-13T18:43:51.707972+0000","last_peered":"2024-09-13T18:43:51.707972+0000","last_clean":"2024-09-13T18:43:51.707972+0000","last_became_active":"2024-09-13T18:39:14.594069+0000","last_became_peered":"2024-09-13T18:39:14.594069+0000","last_unstale":"2024-09-13T18:43:51.707972+0000","last_undegraded":"2024-09-13T18:43:51.707972+0000","last_fullsized":"2024-09-13T18:43:51.707972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'172","last_scrub_stamp":"2024-09-13T18:43:51.707829+0000","last_deep_scrub":"23'172","last_deep_scrub_stamp":"2024-09-13T18:43:51.707829+0000","last_clean_scrub_stamp":"2024-09-13T18:43:51.707829+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:11.835892+0000","scrub_duration":0.002475564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"23'161","reported_seq":184,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:51.377432+0000","last_change":"2024-09-13T18:44:51.377387+0000","last_active":"2024-09-13T18:44:51.377432+0000","last_peered":"2024-09-13T18:44:51.377432+0000","last_clean":"2024-09-13T18:44:51.377432+0000","last_became_active":"2024-09-13T18:39:14.585692+0000","last_became_peered":"2024-09-13T18:39:14.585692+0000","last_unstale":"2024-09-13T18:44:51.377432+0000","last_undegraded":"2024-09-13T18:44:51.377432+0000","last_fullsized":"2024-09-13T18:44:51.377432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'161","last_scrub_stamp":"2024-09-13T18:44:51.377278+0000","last_deep_scrub":"23'161","last_deep_scrub_stamp":"2024-09-13T18:44:51.377278+0000","last_clean_scrub_stamp":"2024-09-13T18:44:51.377278+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:12.520872+0000","scrub_duration":0.0020656030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"23'137","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:03.709035+0000","last_change":"2024-09-13T18:44:03.708966+0000","last_active":"2024-09-13T18:44:03.709035+0000","last_peered":"2024-09-13T18:44:03.709035+0000","last_clean":"2024-09-13T18:44:03.709035+0000","last_became_active":"2024-09-13T18:39:14.595204+0000","last_became_peered":"2024-09-13T18:39:14.595204+0000","last_unstale":"2024-09-13T18:44:03.709035+0000","last_undegraded":"2024-09-13T18:44:03.709035+0000","last_fullsized":"2024-09-13T18:44:03.709035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'137","last_scrub_stamp":"2024-09-13T18:44:03.708829+0000","last_deep_scrub":"23'137","last_deep_scrub_stamp":"2024-09-13T18:44:03.708829+0000","last_clean_scrub_stamp":"2024-09-13T18:44:03.708829+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.890108+0000","scrub_duration":0.0021117660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"23'166","reported_seq":189,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:48.471538+0000","last_change":"2024-09-13T18:43:48.471516+0000","last_active":"2024-09-13T18:43:48.471538+0000","last_peered":"2024-09-13T18:43:48.471538+0000","last_clean":"2024-09-13T18:43:48.471538+0000","last_became_active":"2024-09-13T18:39:14.583331+0000","last_became_peered":"2024-09-13T18:39:14.583331+0000","last_unstale":"2024-09-13T18:43:48.471538+0000","last_undegraded":"2024-09-13T18:43:48.471538+0000","last_fullsized":"2024-09-13T18:43:48.471538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'166","last_scrub_stamp":"2024-09-13T18:43:48.471441+0000","last_deep_scrub":"23'166","last_deep_scrub_stamp":"2024-09-13T18:43:48.471441+0000","last_clean_scrub_stamp":"2024-09-13T18:43:48.471441+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:13.500560+0000","scrub_duration":0.0020110710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'134","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:57.837178+0000","last_change":"2024-09-13T18:44:57.837151+0000","last_active":"2024-09-13T18:44:57.837178+0000","last_peered":"2024-09-13T18:44:57.837178+0000","last_clean":"2024-09-13T18:44:57.837178+0000","last_became_active":"2024-09-13T18:39:14.586834+0000","last_became_peered":"2024-09-13T18:39:14.586834+0000","last_unstale":"2024-09-13T18:44:57.837178+0000","last_undegraded":"2024-09-13T18:44:57.837178+0000","last_fullsized":"2024-09-13T18:44:57.837178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'134","last_scrub_stamp":"2024-09-13T18:44:57.837057+0000","last_deep_scrub":"23'134","last_deep_scrub_stamp":"2024-09-13T18:44:57.837057+0000","last_clean_scrub_stamp":"2024-09-13T18:44:57.837057+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:13.094001+0000","scrub_duration":0.002323033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"23'180","reported_seq":203,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:38.380778+0000","last_change":"2024-09-13T18:44:38.380751+0000","last_active":"2024-09-13T18:44:38.380778+0000","last_peered":"2024-09-13T18:44:38.380778+0000","last_clean":"2024-09-13T18:44:38.380778+0000","last_became_active":"2024-09-13T18:39:14.577373+0000","last_became_peered":"2024-09-13T18:39:14.577373+0000","last_unstale":"2024-09-13T18:44:38.380778+0000","last_undegraded":"2024-09-13T18:44:38.380778+0000","last_fullsized":"2024-09-13T18:44:38.380778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'180","last_scrub_stamp":"2024-09-13T18:44:38.380652+0000","last_deep_scrub":"23'180","last_deep_scrub_stamp":"2024-09-13T18:44:38.380652+0000","last_clean_scrub_stamp":"2024-09-13T18:44:38.380652+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:39.982144+0000","scrub_duration":0.002474459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"23'134","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:04.699685+0000","last_change":"2024-09-13T18:44:04.699659+0000","last_active":"2024-09-13T18:44:04.699685+0000","last_peered":"2024-09-13T18:44:04.699685+0000","last_clean":"2024-09-13T18:44:04.699685+0000","last_became_active":"2024-09-13T18:39:14.592188+0000","last_became_peered":"2024-09-13T18:39:14.592188+0000","last_unstale":"2024-09-13T18:44:04.699685+0000","last_undegraded":"2024-09-13T18:44:04.699685+0000","last_fullsized":"2024-09-13T18:44:04.699685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'134","last_scrub_stamp":"2024-09-13T18:44:04.699563+0000","last_deep_scrub":"23'134","last_deep_scrub_stamp":"2024-09-13T18:44:04.699563+0000","last_clean_scrub_stamp":"2024-09-13T18:44:04.699563+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:01.099849+0000","scrub_duration":0.0021420480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'198","reported_seq":221,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:48.832232+0000","last_change":"2024-09-13T18:43:48.832211+0000","last_active":"2024-09-13T18:43:48.832232+0000","last_peered":"2024-09-13T18:43:48.832232+0000","last_clean":"2024-09-13T18:43:48.832232+0000","last_became_active":"2024-09-13T18:39:14.571663+0000","last_became_peered":"2024-09-13T18:39:14.571663+0000","last_unstale":"2024-09-13T18:43:48.832232+0000","last_undegraded":"2024-09-13T18:43:48.832232+0000","last_fullsized":"2024-09-13T18:43:48.832232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'198","last_scrub_stamp":"2024-09-13T18:43:48.832137+0000","last_deep_scrub":"23'198","last_deep_scrub_stamp":"2024-09-13T18:43:48.832137+0000","last_clean_scrub_stamp":"2024-09-13T18:43:48.832137+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:46.877580+0000","scrub_duration":0.00187283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'144","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:59.857408+0000","last_change":"2024-09-13T18:44:59.857381+0000","last_active":"2024-09-13T18:44:59.857408+0000","last_peered":"2024-09-13T18:44:59.857408+0000","last_clean":"2024-09-13T18:44:59.857408+0000","last_became_active":"2024-09-13T18:39:14.593040+0000","last_became_peered":"2024-09-13T18:39:14.593040+0000","last_unstale":"2024-09-13T18:44:59.857408+0000","last_undegraded":"2024-09-13T18:44:59.857408+0000","last_fullsized":"2024-09-13T18:44:59.857408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'144","last_scrub_stamp":"2024-09-13T18:44:59.857288+0000","last_deep_scrub":"23'144","last_deep_scrub_stamp":"2024-09-13T18:44:59.857288+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.857288+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:34.293550+0000","scrub_duration":0.002186679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"23'133","reported_seq":156,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:01.731808+0000","last_change":"2024-09-13T18:44:01.731780+0000","last_active":"2024-09-13T18:44:01.731808+0000","last_peered":"2024-09-13T18:44:01.731808+0000","last_clean":"2024-09-13T18:44:01.731808+0000","last_became_active":"2024-09-13T18:39:14.575904+0000","last_became_peered":"2024-09-13T18:39:14.575904+0000","last_unstale":"2024-09-13T18:44:01.731808+0000","last_undegraded":"2024-09-13T18:44:01.731808+0000","last_fullsized":"2024-09-13T18:44:01.731808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'133","last_scrub_stamp":"2024-09-13T18:44:01.731680+0000","last_deep_scrub":"23'133","last_deep_scrub_stamp":"2024-09-13T18:44:01.731680+0000","last_clean_scrub_stamp":"2024-09-13T18:44:01.731680+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:51.427166+0000","scrub_duration":0.0020361139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"23'118","reported_seq":141,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:48.813373+0000","last_change":"2024-09-13T18:44:48.813345+0000","last_active":"2024-09-13T18:44:48.813373+0000","last_peered":"2024-09-13T18:44:48.813373+0000","last_clean":"2024-09-13T18:44:48.813373+0000","last_became_active":"2024-09-13T18:39:14.586133+0000","last_became_peered":"2024-09-13T18:39:14.586133+0000","last_unstale":"2024-09-13T18:44:48.813373+0000","last_undegraded":"2024-09-13T18:44:48.813373+0000","last_fullsized":"2024-09-13T18:44:48.813373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'118","last_scrub_stamp":"2024-09-13T18:44:48.813220+0000","last_deep_scrub":"23'118","last_deep_scrub_stamp":"2024-09-13T18:44:48.813220+0000","last_clean_scrub_stamp":"2024-09-13T18:44:48.813220+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:21.964599+0000","scrub_duration":0.0019559349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"23'131","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:58.440745+0000","last_change":"2024-09-13T18:43:58.440702+0000","last_active":"2024-09-13T18:43:58.440745+0000","last_peered":"2024-09-13T18:43:58.440745+0000","last_clean":"2024-09-13T18:43:58.440745+0000","last_became_active":"2024-09-13T18:39:14.577126+0000","last_became_peered":"2024-09-13T18:39:14.577126+0000","last_unstale":"2024-09-13T18:43:58.440745+0000","last_undegraded":"2024-09-13T18:43:58.440745+0000","last_fullsized":"2024-09-13T18:43:58.440745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-09-13T18:43:58.440608+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-09-13T18:43:58.440608+0000","last_clean_scrub_stamp":"2024-09-13T18:43:58.440608+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:48.136093+0000","scrub_duration":0.00209691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"23'135","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:49.773261+0000","last_change":"2024-09-13T18:44:49.773238+0000","last_active":"2024-09-13T18:44:49.773261+0000","last_peered":"2024-09-13T18:44:49.773261+0000","last_clean":"2024-09-13T18:44:49.773261+0000","last_became_active":"2024-09-13T18:39:14.580435+0000","last_became_peered":"2024-09-13T18:39:14.580435+0000","last_unstale":"2024-09-13T18:44:49.773261+0000","last_undegraded":"2024-09-13T18:44:49.773261+0000","last_fullsized":"2024-09-13T18:44:49.773261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'135","last_scrub_stamp":"2024-09-13T18:44:49.773148+0000","last_deep_scrub":"23'135","last_deep_scrub_stamp":"2024-09-13T18:44:49.773148+0000","last_clean_scrub_stamp":"2024-09-13T18:44:49.773148+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:34.023456+0000","scrub_duration":0.0019025260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"23'150","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:37.428168+0000","last_change":"2024-09-13T18:44:37.428133+0000","last_active":"2024-09-13T18:44:37.428168+0000","last_peered":"2024-09-13T18:44:37.428168+0000","last_clean":"2024-09-13T18:44:37.428168+0000","last_became_active":"2024-09-13T18:39:14.574544+0000","last_became_peered":"2024-09-13T18:39:14.574544+0000","last_unstale":"2024-09-13T18:44:37.428168+0000","last_undegraded":"2024-09-13T18:44:37.428168+0000","last_fullsized":"2024-09-13T18:44:37.428168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'150","last_scrub_stamp":"2024-09-13T18:44:37.428037+0000","last_deep_scrub":"23'150","last_deep_scrub_stamp":"2024-09-13T18:44:37.428037+0000","last_clean_scrub_stamp":"2024-09-13T18:44:37.428037+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.571634+0000","scrub_duration":0.002198864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"23'149","reported_seq":172,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:26.755265+0000","last_change":"2024-09-13T18:44:26.755239+0000","last_active":"2024-09-13T18:44:26.755265+0000","last_peered":"2024-09-13T18:44:26.755265+0000","last_clean":"2024-09-13T18:44:26.755265+0000","last_became_active":"2024-09-13T18:39:14.579127+0000","last_became_peered":"2024-09-13T18:39:14.579127+0000","last_unstale":"2024-09-13T18:44:26.755265+0000","last_undegraded":"2024-09-13T18:44:26.755265+0000","last_fullsized":"2024-09-13T18:44:26.755265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'149","last_scrub_stamp":"2024-09-13T18:44:26.755134+0000","last_deep_scrub":"23'149","last_deep_scrub_stamp":"2024-09-13T18:44:26.755134+0000","last_clean_scrub_stamp":"2024-09-13T18:44:26.755134+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:26.285730+0000","scrub_duration":0.002146954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'4","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:17.657876+0000","last_change":"2024-09-13T18:44:17.657850+0000","last_active":"2024-09-13T18:44:17.657876+0000","last_peered":"2024-09-13T18:44:17.657876+0000","last_clean":"2024-09-13T18:44:17.657876+0000","last_became_active":"2024-09-13T18:39:13.574009+0000","last_became_peered":"2024-09-13T18:39:13.574009+0000","last_unstale":"2024-09-13T18:44:17.657876+0000","last_undegraded":"2024-09-13T18:44:17.657876+0000","last_fullsized":"2024-09-13T18:44:17.657876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-09-13T18:44:17.657744+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-09-13T18:44:17.657744+0000","last_clean_scrub_stamp":"2024-09-13T18:44:17.657744+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:50.130205+0000","scrub_duration":0.0032028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"23'150","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:50.732202+0000","last_change":"2024-09-13T18:43:50.732167+0000","last_active":"2024-09-13T18:43:50.732202+0000","last_peered":"2024-09-13T18:43:50.732202+0000","last_clean":"2024-09-13T18:43:50.732202+0000","last_became_active":"2024-09-13T18:39:14.591785+0000","last_became_peered":"2024-09-13T18:39:14.591785+0000","last_unstale":"2024-09-13T18:43:50.732202+0000","last_undegraded":"2024-09-13T18:43:50.732202+0000","last_fullsized":"2024-09-13T18:43:50.732202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'150","last_scrub_stamp":"2024-09-13T18:43:50.732031+0000","last_deep_scrub":"23'150","last_deep_scrub_stamp":"2024-09-13T18:43:50.732031+0000","last_clean_scrub_stamp":"2024-09-13T18:43:50.732031+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:46.913310+0000","scrub_duration":0.0023725059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:19.599404+0000","last_change":"2024-09-13T18:44:19.599375+0000","last_active":"2024-09-13T18:44:19.599404+0000","last_peered":"2024-09-13T18:44:19.599404+0000","last_clean":"2024-09-13T18:44:19.599404+0000","last_became_active":"2024-09-13T18:39:13.570483+0000","last_became_peered":"2024-09-13T18:39:13.570483+0000","last_unstale":"2024-09-13T18:44:19.599404+0000","last_undegraded":"2024-09-13T18:44:19.599404+0000","last_fullsized":"2024-09-13T18:44:19.599404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:19.599273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:19.599273+0000","last_clean_scrub_stamp":"2024-09-13T18:44:19.599273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:41.698763+0000","scrub_duration":0.001383612,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"23'229","reported_seq":261,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:48.580299+0000","last_change":"2024-09-13T18:44:48.580258+0000","last_active":"2024-09-13T18:44:48.580299+0000","last_peered":"2024-09-13T18:44:48.580299+0000","last_clean":"2024-09-13T18:44:48.580299+0000","last_became_active":"2024-09-13T18:39:54.668035+0000","last_became_peered":"2024-09-13T18:39:54.668035+0000","last_unstale":"2024-09-13T18:44:48.580299+0000","last_undegraded":"2024-09-13T18:44:48.580299+0000","last_fullsized":"2024-09-13T18:44:48.580299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'229","last_scrub_stamp":"2024-09-13T18:44:48.580156+0000","last_deep_scrub":"23'229","last_deep_scrub_stamp":"2024-09-13T18:44:48.580156+0000","last_clean_scrub_stamp":"2024-09-13T18:44:48.580156+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:19.087338+0000","scrub_duration":0.002453387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:09.653407+0000","last_change":"2024-09-13T18:44:09.653388+0000","last_active":"2024-09-13T18:44:09.653407+0000","last_peered":"2024-09-13T18:44:09.653407+0000","last_clean":"2024-09-13T18:44:09.653407+0000","last_became_active":"2024-09-13T18:39:13.574645+0000","last_became_peered":"2024-09-13T18:39:13.574645+0000","last_unstale":"2024-09-13T18:44:09.653407+0000","last_undegraded":"2024-09-13T18:44:09.653407+0000","last_fullsized":"2024-09-13T18:44:09.653407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:09.653310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:09.653310+0000","last_clean_scrub_stamp":"2024-09-13T18:44:09.653310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:31.752800+0000","scrub_duration":0.001209353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'141","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:36.764297+0000","last_change":"2024-09-13T18:44:36.764258+0000","last_active":"2024-09-13T18:44:36.764297+0000","last_peered":"2024-09-13T18:44:36.764297+0000","last_clean":"2024-09-13T18:44:36.764297+0000","last_became_active":"2024-09-13T18:39:14.584365+0000","last_became_peered":"2024-09-13T18:39:14.584365+0000","last_unstale":"2024-09-13T18:44:36.764297+0000","last_undegraded":"2024-09-13T18:44:36.764297+0000","last_fullsized":"2024-09-13T18:44:36.764297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'141","last_scrub_stamp":"2024-09-13T18:44:36.764155+0000","last_deep_scrub":"23'141","last_deep_scrub_stamp":"2024-09-13T18:44:36.764155+0000","last_clean_scrub_stamp":"2024-09-13T18:44:36.764155+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:06.434398+0000","scrub_duration":0.002008995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'13","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:30.530461+0000","last_change":"2024-09-13T18:44:30.530441+0000","last_active":"2024-09-13T18:44:30.530461+0000","last_peered":"2024-09-13T18:44:30.530461+0000","last_clean":"2024-09-13T18:44:30.530461+0000","last_became_active":"2024-09-13T18:39:13.578436+0000","last_became_peered":"2024-09-13T18:39:13.578436+0000","last_unstale":"2024-09-13T18:44:30.530461+0000","last_undegraded":"2024-09-13T18:44:30.530461+0000","last_fullsized":"2024-09-13T18:44:30.530461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'13","last_scrub_stamp":"2024-09-13T18:44:30.530358+0000","last_deep_scrub":"23'13","last_deep_scrub_stamp":"2024-09-13T18:44:30.530358+0000","last_clean_scrub_stamp":"2024-09-13T18:44:30.530358+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:04.178379+0000","scrub_duration":0.0033496760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"23'2","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:18.588499+0000","last_change":"2024-09-13T18:44:18.588472+0000","last_active":"2024-09-13T18:44:18.588499+0000","last_peered":"2024-09-13T18:44:18.588499+0000","last_clean":"2024-09-13T18:44:18.588499+0000","last_became_active":"2024-09-13T18:39:13.582886+0000","last_became_peered":"2024-09-13T18:39:13.582886+0000","last_unstale":"2024-09-13T18:44:18.588499+0000","last_undegraded":"2024-09-13T18:44:18.588499+0000","last_fullsized":"2024-09-13T18:44:18.588499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-09-13T18:44:18.588351+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-09-13T18:44:18.588351+0000","last_clean_scrub_stamp":"2024-09-13T18:44:18.588351+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:44.506583+0000","scrub_duration":0.002819603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"23'153","reported_seq":185,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:15.675386+0000","last_change":"2024-09-13T18:44:15.675355+0000","last_active":"2024-09-13T18:44:15.675386+0000","last_peered":"2024-09-13T18:44:15.675386+0000","last_clean":"2024-09-13T18:44:15.675386+0000","last_became_active":"2024-09-13T18:39:54.668322+0000","last_became_peered":"2024-09-13T18:39:54.668322+0000","last_unstale":"2024-09-13T18:44:15.675386+0000","last_undegraded":"2024-09-13T18:44:15.675386+0000","last_fullsized":"2024-09-13T18:44:15.675386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'153","last_scrub_stamp":"2024-09-13T18:44:15.675257+0000","last_deep_scrub":"23'153","last_deep_scrub_stamp":"2024-09-13T18:44:15.675257+0000","last_clean_scrub_stamp":"2024-09-13T18:44:15.675257+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:47.380623+0000","scrub_duration":0.0021387390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"23'3","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:05.675395+0000","last_change":"2024-09-13T18:44:05.675363+0000","last_active":"2024-09-13T18:44:05.675395+0000","last_peered":"2024-09-13T18:44:05.675395+0000","last_clean":"2024-09-13T18:44:05.675395+0000","last_became_active":"2024-09-13T18:39:13.569713+0000","last_became_peered":"2024-09-13T18:39:13.569713+0000","last_unstale":"2024-09-13T18:44:05.675395+0000","last_undegraded":"2024-09-13T18:44:05.675395+0000","last_fullsized":"2024-09-13T18:44:05.675395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-13T18:44:05.675271+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-13T18:44:05.675271+0000","last_clean_scrub_stamp":"2024-09-13T18:44:05.675271+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:27.405880+0000","scrub_duration":0.0025755109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'134","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:52.779568+0000","last_change":"2024-09-13T18:43:52.779541+0000","last_active":"2024-09-13T18:43:52.779568+0000","last_peered":"2024-09-13T18:43:52.779568+0000","last_clean":"2024-09-13T18:43:52.779568+0000","last_became_active":"2024-09-13T18:39:14.576895+0000","last_became_peered":"2024-09-13T18:39:14.576895+0000","last_unstale":"2024-09-13T18:43:52.779568+0000","last_undegraded":"2024-09-13T18:43:52.779568+0000","last_fullsized":"2024-09-13T18:43:52.779568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'134","last_scrub_stamp":"2024-09-13T18:43:52.779447+0000","last_deep_scrub":"23'134","last_deep_scrub_stamp":"2024-09-13T18:43:52.779447+0000","last_clean_scrub_stamp":"2024-09-13T18:43:52.779447+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:10.283130+0000","scrub_duration":0.0020289090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"23'2","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:46.799612+0000","last_change":"2024-09-13T18:44:46.799576+0000","last_active":"2024-09-13T18:44:46.799612+0000","last_peered":"2024-09-13T18:44:46.799612+0000","last_clean":"2024-09-13T18:44:46.799612+0000","last_became_active":"2024-09-13T18:39:13.581381+0000","last_became_peered":"2024-09-13T18:39:13.581381+0000","last_unstale":"2024-09-13T18:44:46.799612+0000","last_undegraded":"2024-09-13T18:44:46.799612+0000","last_fullsized":"2024-09-13T18:44:46.799612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-09-13T18:44:46.799477+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-09-13T18:44:46.799477+0000","last_clean_scrub_stamp":"2024-09-13T18:44:46.799477+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:41.416130+0000","scrub_duration":0.0028906769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'128","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:57.708932+0000","last_change":"2024-09-13T18:43:57.708904+0000","last_active":"2024-09-13T18:43:57.708932+0000","last_peered":"2024-09-13T18:43:57.708932+0000","last_clean":"2024-09-13T18:43:57.708932+0000","last_became_active":"2024-09-13T18:39:14.594577+0000","last_became_peered":"2024-09-13T18:39:14.594577+0000","last_unstale":"2024-09-13T18:43:57.708932+0000","last_undegraded":"2024-09-13T18:43:57.708932+0000","last_fullsized":"2024-09-13T18:43:57.708932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'128","last_scrub_stamp":"2024-09-13T18:43:57.708808+0000","last_deep_scrub":"23'128","last_deep_scrub_stamp":"2024-09-13T18:43:57.708808+0000","last_clean_scrub_stamp":"2024-09-13T18:43:57.708808+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:53.890087+0000","scrub_duration":0.0020534289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:25.625794+0000","last_change":"2024-09-13T18:44:25.625767+0000","last_active":"2024-09-13T18:44:25.625794+0000","last_peered":"2024-09-13T18:44:25.625794+0000","last_clean":"2024-09-13T18:44:25.625794+0000","last_became_active":"2024-09-13T18:39:13.569862+0000","last_became_peered":"2024-09-13T18:39:13.569862+0000","last_unstale":"2024-09-13T18:44:25.625794+0000","last_undegraded":"2024-09-13T18:44:25.625794+0000","last_fullsized":"2024-09-13T18:44:25.625794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:25.625670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:25.625670+0000","last_clean_scrub_stamp":"2024-09-13T18:44:25.625670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:48.259897+0000","scrub_duration":0.0012567520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"23'143","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:45.628989+0000","last_change":"2024-09-13T18:44:45.628952+0000","last_active":"2024-09-13T18:44:45.628989+0000","last_peered":"2024-09-13T18:44:45.628989+0000","last_clean":"2024-09-13T18:44:45.628989+0000","last_became_active":"2024-09-13T18:39:14.584179+0000","last_became_peered":"2024-09-13T18:39:14.584179+0000","last_unstale":"2024-09-13T18:44:45.628989+0000","last_undegraded":"2024-09-13T18:44:45.628989+0000","last_fullsized":"2024-09-13T18:44:45.628989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'143","last_scrub_stamp":"2024-09-13T18:44:45.628856+0000","last_deep_scrub":"23'143","last_deep_scrub_stamp":"2024-09-13T18:44:45.628856+0000","last_clean_scrub_stamp":"2024-09-13T18:44:45.628856+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:41.651078+0000","scrub_duration":0.002190521,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'4","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:44.711388+0000","last_change":"2024-09-13T18:44:44.711363+0000","last_active":"2024-09-13T18:44:44.711388+0000","last_peered":"2024-09-13T18:44:44.711388+0000","last_clean":"2024-09-13T18:44:44.711388+0000","last_became_active":"2024-09-13T18:39:13.575446+0000","last_became_peered":"2024-09-13T18:39:13.575446+0000","last_unstale":"2024-09-13T18:44:44.711388+0000","last_undegraded":"2024-09-13T18:44:44.711388+0000","last_fullsized":"2024-09-13T18:44:44.711388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-09-13T18:44:44.711281+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-09-13T18:44:44.711281+0000","last_clean_scrub_stamp":"2024-09-13T18:44:44.711281+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:31.432082+0000","scrub_duration":0.0023498310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"23'144","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:49.448761+0000","last_change":"2024-09-13T18:43:49.448742+0000","last_active":"2024-09-13T18:43:49.448761+0000","last_peered":"2024-09-13T18:43:49.448761+0000","last_clean":"2024-09-13T18:43:49.448761+0000","last_became_active":"2024-09-13T18:39:14.576880+0000","last_became_peered":"2024-09-13T18:39:14.576880+0000","last_unstale":"2024-09-13T18:43:49.448761+0000","last_undegraded":"2024-09-13T18:43:49.448761+0000","last_fullsized":"2024-09-13T18:43:49.448761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'144","last_scrub_stamp":"2024-09-13T18:43:49.448666+0000","last_deep_scrub":"23'144","last_deep_scrub_stamp":"2024-09-13T18:43:49.448666+0000","last_clean_scrub_stamp":"2024-09-13T18:43:49.448666+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:13.477250+0000","scrub_duration":0.0016535639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:53.634394+0000","last_change":"2024-09-13T18:43:53.634366+0000","last_active":"2024-09-13T18:43:53.634394+0000","last_peered":"2024-09-13T18:43:53.634394+0000","last_clean":"2024-09-13T18:43:53.634394+0000","last_became_active":"2024-09-13T18:39:13.581159+0000","last_became_peered":"2024-09-13T18:39:13.581159+0000","last_unstale":"2024-09-13T18:43:53.634394+0000","last_undegraded":"2024-09-13T18:43:53.634394+0000","last_fullsized":"2024-09-13T18:43:53.634394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:53.634259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:53.634259+0000","last_clean_scrub_stamp":"2024-09-13T18:43:53.634259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:48.079989+0000","scrub_duration":0.0013690830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'151","reported_seq":174,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:47.783286+0000","last_change":"2024-09-13T18:44:47.783259+0000","last_active":"2024-09-13T18:44:47.783286+0000","last_peered":"2024-09-13T18:44:47.783286+0000","last_clean":"2024-09-13T18:44:47.783286+0000","last_became_active":"2024-09-13T18:39:14.582954+0000","last_became_peered":"2024-09-13T18:39:14.582954+0000","last_unstale":"2024-09-13T18:44:47.783286+0000","last_undegraded":"2024-09-13T18:44:47.783286+0000","last_fullsized":"2024-09-13T18:44:47.783286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'151","last_scrub_stamp":"2024-09-13T18:44:47.783160+0000","last_deep_scrub":"23'151","last_deep_scrub_stamp":"2024-09-13T18:44:47.783160+0000","last_clean_scrub_stamp":"2024-09-13T18:44:47.783160+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:51.883837+0000","scrub_duration":0.0022046230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:22.635091+0000","last_change":"2024-09-13T18:44:22.635064+0000","last_active":"2024-09-13T18:44:22.635091+0000","last_peered":"2024-09-13T18:44:22.635091+0000","last_clean":"2024-09-13T18:44:22.635091+0000","last_became_active":"2024-09-13T18:39:13.574956+0000","last_became_peered":"2024-09-13T18:39:13.574956+0000","last_unstale":"2024-09-13T18:44:22.635091+0000","last_undegraded":"2024-09-13T18:44:22.635091+0000","last_fullsized":"2024-09-13T18:44:22.635091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:22.634960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:22.634960+0000","last_clean_scrub_stamp":"2024-09-13T18:44:22.634960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:29.216584+0000","scrub_duration":0.0013088489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'146","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:31.587191+0000","last_change":"2024-09-13T18:44:31.587166+0000","last_active":"2024-09-13T18:44:31.587191+0000","last_peered":"2024-09-13T18:44:31.587191+0000","last_clean":"2024-09-13T18:44:31.587191+0000","last_became_active":"2024-09-13T18:39:14.592804+0000","last_became_peered":"2024-09-13T18:39:14.592804+0000","last_unstale":"2024-09-13T18:44:31.587191+0000","last_undegraded":"2024-09-13T18:44:31.587191+0000","last_fullsized":"2024-09-13T18:44:31.587191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'146","last_scrub_stamp":"2024-09-13T18:44:31.587066+0000","last_deep_scrub":"23'146","last_deep_scrub_stamp":"2024-09-13T18:44:31.587066+0000","last_clean_scrub_stamp":"2024-09-13T18:44:31.587066+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:33.188557+0000","scrub_duration":0.002156229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:56.691083+0000","last_change":"2024-09-13T18:43:56.691044+0000","last_active":"2024-09-13T18:43:56.691083+0000","last_peered":"2024-09-13T18:43:56.691083+0000","last_clean":"2024-09-13T18:43:56.691083+0000","last_became_active":"2024-09-13T18:39:13.580876+0000","last_became_peered":"2024-09-13T18:39:13.580876+0000","last_unstale":"2024-09-13T18:43:56.691083+0000","last_undegraded":"2024-09-13T18:43:56.691083+0000","last_fullsized":"2024-09-13T18:43:56.691083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:56.690932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:56.690932+0000","last_clean_scrub_stamp":"2024-09-13T18:43:56.690932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:08.734413+0000","scrub_duration":0.0015086730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"23'138","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:56.782349+0000","last_change":"2024-09-13T18:43:56.782319+0000","last_active":"2024-09-13T18:43:56.782349+0000","last_peered":"2024-09-13T18:43:56.782349+0000","last_clean":"2024-09-13T18:43:56.782349+0000","last_became_active":"2024-09-13T18:39:14.595877+0000","last_became_peered":"2024-09-13T18:39:14.595877+0000","last_unstale":"2024-09-13T18:43:56.782349+0000","last_undegraded":"2024-09-13T18:43:56.782349+0000","last_fullsized":"2024-09-13T18:43:56.782349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'138","last_scrub_stamp":"2024-09-13T18:43:56.782222+0000","last_deep_scrub":"23'138","last_deep_scrub_stamp":"2024-09-13T18:43:56.782222+0000","last_clean_scrub_stamp":"2024-09-13T18:43:56.782222+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.423073+0000","scrub_duration":0.001943909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"23'54","reported_seq":100,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:09.571937+0000","last_change":"2024-09-13T18:44:09.571904+0000","last_active":"2024-09-13T18:44:09.571937+0000","last_peered":"2024-09-13T18:44:09.571937+0000","last_clean":"2024-09-13T18:44:09.571937+0000","last_became_active":"2024-09-13T18:39:03.412532+0000","last_became_peered":"2024-09-13T18:39:03.412532+0000","last_unstale":"2024-09-13T18:44:09.571937+0000","last_undegraded":"2024-09-13T18:44:09.571937+0000","last_fullsized":"2024-09-13T18:44:09.571937+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'54","last_scrub_stamp":"2024-09-13T18:44:09.571788+0000","last_deep_scrub":"23'54","last_deep_scrub_stamp":"2024-09-13T18:44:09.571788+0000","last_clean_scrub_stamp":"2024-09-13T18:44:09.571788+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:21.615268+0000","scrub_duration":0.0065545229999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"23'2","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:41.652010+0000","last_change":"2024-09-13T18:44:41.651951+0000","last_active":"2024-09-13T18:44:41.652010+0000","last_peered":"2024-09-13T18:44:41.652010+0000","last_clean":"2024-09-13T18:44:41.652010+0000","last_became_active":"2024-09-13T18:39:07.522839+0000","last_became_peered":"2024-09-13T18:39:07.522839+0000","last_unstale":"2024-09-13T18:44:41.652010+0000","last_undegraded":"2024-09-13T18:44:41.652010+0000","last_fullsized":"2024-09-13T18:44:41.652010+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-09-13T18:44:41.651845+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-09-13T18:44:41.651845+0000","last_clean_scrub_stamp":"2024-09-13T18:44:41.651845+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:58.624229+0000","scrub_duration":0.0028101419999999998,"objects_trimmed":0,"snaptrim_duration":0.00087920499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:02.713921+0000","last_change":"2024-09-13T18:44:02.713894+0000","last_active":"2024-09-13T18:44:02.713921+0000","last_peered":"2024-09-13T18:44:02.713921+0000","last_clean":"2024-09-13T18:44:02.713921+0000","last_became_active":"2024-09-13T18:39:13.575683+0000","last_became_peered":"2024-09-13T18:39:13.575683+0000","last_unstale":"2024-09-13T18:44:02.713921+0000","last_undegraded":"2024-09-13T18:44:02.713921+0000","last_fullsized":"2024-09-13T18:44:02.713921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:02.713794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:02.713794+0000","last_clean_scrub_stamp":"2024-09-13T18:44:02.713794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:39.673817+0000","scrub_duration":0.001383649,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"23'143","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:44.680039+0000","last_change":"2024-09-13T18:44:44.679998+0000","last_active":"2024-09-13T18:44:44.680039+0000","last_peered":"2024-09-13T18:44:44.680039+0000","last_clean":"2024-09-13T18:44:44.680039+0000","last_became_active":"2024-09-13T18:39:54.668177+0000","last_became_peered":"2024-09-13T18:39:54.668177+0000","last_unstale":"2024-09-13T18:44:44.680039+0000","last_undegraded":"2024-09-13T18:44:44.680039+0000","last_fullsized":"2024-09-13T18:44:44.680039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'143","last_scrub_stamp":"2024-09-13T18:44:44.679899+0000","last_deep_scrub":"23'143","last_deep_scrub_stamp":"2024-09-13T18:44:44.679899+0000","last_clean_scrub_stamp":"2024-09-13T18:44:44.679899+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:05.823493+0000","scrub_duration":0.0021408970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:40.685103+0000","last_change":"2024-09-13T18:44:40.685071+0000","last_active":"2024-09-13T18:44:40.685103+0000","last_peered":"2024-09-13T18:44:40.685103+0000","last_clean":"2024-09-13T18:44:40.685103+0000","last_became_active":"2024-09-13T18:39:07.522918+0000","last_became_peered":"2024-09-13T18:39:07.522918+0000","last_unstale":"2024-09-13T18:44:40.685103+0000","last_undegraded":"2024-09-13T18:44:40.685103+0000","last_fullsized":"2024-09-13T18:44:40.685103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:40.684959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:40.684959+0000","last_clean_scrub_stamp":"2024-09-13T18:44:40.684959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:32.397536+0000","scrub_duration":0.0013364449999999999,"objects_trimmed":0,"snaptrim_duration":0.00050631600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'6","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:12.515506+0000","last_change":"2024-09-13T18:44:12.515479+0000","last_active":"2024-09-13T18:44:12.515506+0000","last_peered":"2024-09-13T18:44:12.515506+0000","last_clean":"2024-09-13T18:44:12.515506+0000","last_became_active":"2024-09-13T18:39:13.563303+0000","last_became_peered":"2024-09-13T18:39:13.563303+0000","last_unstale":"2024-09-13T18:44:12.515506+0000","last_undegraded":"2024-09-13T18:44:12.515506+0000","last_fullsized":"2024-09-13T18:44:12.515506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-09-13T18:44:12.515392+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-09-13T18:44:12.515392+0000","last_clean_scrub_stamp":"2024-09-13T18:44:12.515392+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:49.475414+0000","scrub_duration":0.0028074189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'163","reported_seq":186,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:00.482872+0000","last_change":"2024-09-13T18:44:00.482832+0000","last_active":"2024-09-13T18:44:00.482872+0000","last_peered":"2024-09-13T18:44:00.482872+0000","last_clean":"2024-09-13T18:44:00.482872+0000","last_became_active":"2024-09-13T18:39:14.586350+0000","last_became_peered":"2024-09-13T18:39:14.586350+0000","last_unstale":"2024-09-13T18:44:00.482872+0000","last_undegraded":"2024-09-13T18:44:00.482872+0000","last_fullsized":"2024-09-13T18:44:00.482872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'163","last_scrub_stamp":"2024-09-13T18:44:00.482724+0000","last_deep_scrub":"23'163","last_deep_scrub_stamp":"2024-09-13T18:44:00.482724+0000","last_clean_scrub_stamp":"2024-09-13T18:44:00.482724+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:56.664003+0000","scrub_duration":0.0023912109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:58.706954+0000","last_change":"2024-09-13T18:43:58.706931+0000","last_active":"2024-09-13T18:43:58.706954+0000","last_peered":"2024-09-13T18:43:58.706954+0000","last_clean":"2024-09-13T18:43:58.706954+0000","last_became_active":"2024-09-13T18:39:07.521264+0000","last_became_peered":"2024-09-13T18:39:07.521264+0000","last_unstale":"2024-09-13T18:43:58.706954+0000","last_undegraded":"2024-09-13T18:43:58.706954+0000","last_fullsized":"2024-09-13T18:43:58.706954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:58.706831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:58.706831+0000","last_clean_scrub_stamp":"2024-09-13T18:43:58.706831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:55.107117+0000","scrub_duration":0.001356496,"objects_trimmed":0,"snaptrim_duration":0.00036413599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:21.577388+0000","last_change":"2024-09-13T18:44:21.577332+0000","last_active":"2024-09-13T18:44:21.577388+0000","last_peered":"2024-09-13T18:44:21.577388+0000","last_clean":"2024-09-13T18:44:21.577388+0000","last_became_active":"2024-09-13T18:39:13.578568+0000","last_became_peered":"2024-09-13T18:39:13.578568+0000","last_unstale":"2024-09-13T18:44:21.577388+0000","last_undegraded":"2024-09-13T18:44:21.577388+0000","last_fullsized":"2024-09-13T18:44:21.577388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:21.577179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:21.577179+0000","last_clean_scrub_stamp":"2024-09-13T18:44:21.577179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:50.889934+0000","scrub_duration":0.001424418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'143","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:50.837495+0000","last_change":"2024-09-13T18:43:50.837457+0000","last_active":"2024-09-13T18:43:50.837495+0000","last_peered":"2024-09-13T18:43:50.837495+0000","last_clean":"2024-09-13T18:43:50.837495+0000","last_became_active":"2024-09-13T18:39:14.589431+0000","last_became_peered":"2024-09-13T18:39:14.589431+0000","last_unstale":"2024-09-13T18:43:50.837495+0000","last_undegraded":"2024-09-13T18:43:50.837495+0000","last_fullsized":"2024-09-13T18:43:50.837495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'143","last_scrub_stamp":"2024-09-13T18:43:50.837363+0000","last_deep_scrub":"23'143","last_deep_scrub_stamp":"2024-09-13T18:43:50.837363+0000","last_clean_scrub_stamp":"2024-09-13T18:43:50.837363+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:24.539015+0000","scrub_duration":0.002064204,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'3","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:38.752692+0000","last_change":"2024-09-13T18:44:38.752656+0000","last_active":"2024-09-13T18:44:38.752692+0000","last_peered":"2024-09-13T18:44:38.752692+0000","last_clean":"2024-09-13T18:44:38.752692+0000","last_became_active":"2024-09-13T18:39:07.522906+0000","last_became_peered":"2024-09-13T18:39:07.522906+0000","last_unstale":"2024-09-13T18:44:38.752692+0000","last_undegraded":"2024-09-13T18:44:38.752692+0000","last_fullsized":"2024-09-13T18:44:38.752692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-13T18:44:38.752572+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-13T18:44:38.752572+0000","last_clean_scrub_stamp":"2024-09-13T18:44:38.752572+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:09.259753+0000","scrub_duration":0.002800903,"objects_trimmed":0,"snaptrim_duration":0.0011479400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:27.554325+0000","last_change":"2024-09-13T18:44:27.554281+0000","last_active":"2024-09-13T18:44:27.554325+0000","last_peered":"2024-09-13T18:44:27.554325+0000","last_clean":"2024-09-13T18:44:27.554325+0000","last_became_active":"2024-09-13T18:39:13.571264+0000","last_became_peered":"2024-09-13T18:39:13.571264+0000","last_unstale":"2024-09-13T18:44:27.554325+0000","last_undegraded":"2024-09-13T18:44:27.554325+0000","last_fullsized":"2024-09-13T18:44:27.554325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:27.554178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:27.554178+0000","last_clean_scrub_stamp":"2024-09-13T18:44:27.554178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:01.202199+0000","scrub_duration":0.001456045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"23'144","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:50.408474+0000","last_change":"2024-09-13T18:44:50.408452+0000","last_active":"2024-09-13T18:44:50.408474+0000","last_peered":"2024-09-13T18:44:50.408474+0000","last_clean":"2024-09-13T18:44:50.408474+0000","last_became_active":"2024-09-13T18:39:14.579560+0000","last_became_peered":"2024-09-13T18:39:14.579560+0000","last_unstale":"2024-09-13T18:44:50.408474+0000","last_undegraded":"2024-09-13T18:44:50.408474+0000","last_fullsized":"2024-09-13T18:44:50.408474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'144","last_scrub_stamp":"2024-09-13T18:44:50.408376+0000","last_deep_scrub":"23'144","last_deep_scrub_stamp":"2024-09-13T18:44:50.408376+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.408376+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:20.078619+0000","scrub_duration":0.001901886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:59.744352+0000","last_change":"2024-09-13T18:43:59.744323+0000","last_active":"2024-09-13T18:43:59.744352+0000","last_peered":"2024-09-13T18:43:59.744352+0000","last_clean":"2024-09-13T18:43:59.744352+0000","last_became_active":"2024-09-13T18:39:13.577606+0000","last_became_peered":"2024-09-13T18:39:13.577606+0000","last_unstale":"2024-09-13T18:43:59.744352+0000","last_undegraded":"2024-09-13T18:43:59.744352+0000","last_fullsized":"2024-09-13T18:43:59.744352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:59.744215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:59.744215+0000","last_clean_scrub_stamp":"2024-09-13T18:43:59.744215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:54.189945+0000","scrub_duration":0.0013975039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:11.635078+0000","last_change":"2024-09-13T18:44:11.635054+0000","last_active":"2024-09-13T18:44:11.635078+0000","last_peered":"2024-09-13T18:44:11.635078+0000","last_clean":"2024-09-13T18:44:11.635078+0000","last_became_active":"2024-09-13T18:39:07.529169+0000","last_became_peered":"2024-09-13T18:39:07.529169+0000","last_unstale":"2024-09-13T18:44:11.635078+0000","last_undegraded":"2024-09-13T18:44:11.635078+0000","last_fullsized":"2024-09-13T18:44:11.635078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:11.634944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:11.634944+0000","last_clean_scrub_stamp":"2024-09-13T18:44:11.634944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:00.831573+0000","scrub_duration":0.0014013980000000001,"objects_trimmed":0,"snaptrim_duration":0.00048736500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"23'158","reported_seq":181,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:36.458964+0000","last_change":"2024-09-13T18:44:36.458922+0000","last_active":"2024-09-13T18:44:36.458964+0000","last_peered":"2024-09-13T18:44:36.458964+0000","last_clean":"2024-09-13T18:44:36.458964+0000","last_became_active":"2024-09-13T18:39:14.597009+0000","last_became_peered":"2024-09-13T18:39:14.597009+0000","last_unstale":"2024-09-13T18:44:36.458964+0000","last_undegraded":"2024-09-13T18:44:36.458964+0000","last_fullsized":"2024-09-13T18:44:36.458964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'158","last_scrub_stamp":"2024-09-13T18:44:36.458779+0000","last_deep_scrub":"23'158","last_deep_scrub_stamp":"2024-09-13T18:44:36.458779+0000","last_clean_scrub_stamp":"2024-09-13T18:44:36.458779+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:43.040402+0000","scrub_duration":0.0024238329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:28.491518+0000","last_change":"2024-09-13T18:44:28.491493+0000","last_active":"2024-09-13T18:44:28.491518+0000","last_peered":"2024-09-13T18:44:28.491518+0000","last_clean":"2024-09-13T18:44:28.491518+0000","last_became_active":"2024-09-13T18:39:13.582829+0000","last_became_peered":"2024-09-13T18:39:13.582829+0000","last_unstale":"2024-09-13T18:44:28.491518+0000","last_undegraded":"2024-09-13T18:44:28.491518+0000","last_fullsized":"2024-09-13T18:44:28.491518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:28.491398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:28.491398+0000","last_clean_scrub_stamp":"2024-09-13T18:44:28.491398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:51.125625+0000","scrub_duration":0.0014534820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:42.654462+0000","last_change":"2024-09-13T18:44:42.654438+0000","last_active":"2024-09-13T18:44:42.654462+0000","last_peered":"2024-09-13T18:44:42.654462+0000","last_clean":"2024-09-13T18:44:42.654462+0000","last_became_active":"2024-09-13T18:39:07.529293+0000","last_became_peered":"2024-09-13T18:39:07.529293+0000","last_unstale":"2024-09-13T18:44:42.654462+0000","last_undegraded":"2024-09-13T18:44:42.654462+0000","last_fullsized":"2024-09-13T18:44:42.654462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:42.654350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:42.654350+0000","last_clean_scrub_stamp":"2024-09-13T18:44:42.654350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.901142+0000","scrub_duration":0.00121572,"objects_trimmed":0,"snaptrim_duration":0.00081390499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"23'145","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:34.544044+0000","last_change":"2024-09-13T18:44:34.544011+0000","last_active":"2024-09-13T18:44:34.544044+0000","last_peered":"2024-09-13T18:44:34.544044+0000","last_clean":"2024-09-13T18:44:34.544044+0000","last_became_active":"2024-09-13T18:39:14.583902+0000","last_became_peered":"2024-09-13T18:39:14.583902+0000","last_unstale":"2024-09-13T18:44:34.544044+0000","last_undegraded":"2024-09-13T18:44:34.544044+0000","last_fullsized":"2024-09-13T18:44:34.544044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'145","last_scrub_stamp":"2024-09-13T18:44:34.543897+0000","last_deep_scrub":"23'145","last_deep_scrub_stamp":"2024-09-13T18:44:34.543897+0000","last_clean_scrub_stamp":"2024-09-13T18:44:34.543897+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:36.145389+0000","scrub_duration":0.0023018470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'4","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:43.688802+0000","last_change":"2024-09-13T18:44:43.688761+0000","last_active":"2024-09-13T18:44:43.688802+0000","last_peered":"2024-09-13T18:44:43.688802+0000","last_clean":"2024-09-13T18:44:43.688802+0000","last_became_active":"2024-09-13T18:39:13.583599+0000","last_became_peered":"2024-09-13T18:39:13.583599+0000","last_unstale":"2024-09-13T18:44:43.688802+0000","last_undegraded":"2024-09-13T18:44:43.688802+0000","last_fullsized":"2024-09-13T18:44:43.688802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-09-13T18:44:43.688664+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-09-13T18:44:43.688664+0000","last_clean_scrub_stamp":"2024-09-13T18:44:43.688664+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:46.903589+0000","scrub_duration":0.0024956409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:15.614716+0000","last_change":"2024-09-13T18:44:15.614677+0000","last_active":"2024-09-13T18:44:15.614716+0000","last_peered":"2024-09-13T18:44:15.614716+0000","last_clean":"2024-09-13T18:44:15.614716+0000","last_became_active":"2024-09-13T18:39:07.529241+0000","last_became_peered":"2024-09-13T18:39:07.529241+0000","last_unstale":"2024-09-13T18:44:15.614716+0000","last_undegraded":"2024-09-13T18:44:15.614716+0000","last_fullsized":"2024-09-13T18:44:15.614716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:15.614585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:15.614585+0000","last_clean_scrub_stamp":"2024-09-13T18:44:15.614585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:52.574608+0000","scrub_duration":0.0015675750000000001,"objects_trimmed":0,"snaptrim_duration":0.00049952899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"23'131","reported_seq":154,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:08.623912+0000","last_change":"2024-09-13T18:44:08.623882+0000","last_active":"2024-09-13T18:44:08.623912+0000","last_peered":"2024-09-13T18:44:08.623912+0000","last_clean":"2024-09-13T18:44:08.623912+0000","last_became_active":"2024-09-13T18:39:14.581938+0000","last_became_peered":"2024-09-13T18:39:14.581938+0000","last_unstale":"2024-09-13T18:44:08.623912+0000","last_undegraded":"2024-09-13T18:44:08.623912+0000","last_fullsized":"2024-09-13T18:44:08.623912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-09-13T18:44:08.623773+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-09-13T18:44:08.623773+0000","last_clean_scrub_stamp":"2024-09-13T18:44:08.623773+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:37.936529+0000","scrub_duration":0.0019630450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'11","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:32.575344+0000","last_change":"2024-09-13T18:44:32.575316+0000","last_active":"2024-09-13T18:44:32.575344+0000","last_peered":"2024-09-13T18:44:32.575344+0000","last_clean":"2024-09-13T18:44:32.575344+0000","last_became_active":"2024-09-13T18:39:13.583378+0000","last_became_peered":"2024-09-13T18:39:13.583378+0000","last_unstale":"2024-09-13T18:44:32.575344+0000","last_undegraded":"2024-09-13T18:44:32.575344+0000","last_fullsized":"2024-09-13T18:44:32.575344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-09-13T18:44:32.575209+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-09-13T18:44:32.575209+0000","last_clean_scrub_stamp":"2024-09-13T18:44:32.575209+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:39.156832+0000","scrub_duration":0.0024253859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:39.726748+0000","last_change":"2024-09-13T18:44:39.726722+0000","last_active":"2024-09-13T18:44:39.726748+0000","last_peered":"2024-09-13T18:44:39.726748+0000","last_clean":"2024-09-13T18:44:39.726748+0000","last_became_active":"2024-09-13T18:39:07.529427+0000","last_became_peered":"2024-09-13T18:39:07.529427+0000","last_unstale":"2024-09-13T18:44:39.726748+0000","last_undegraded":"2024-09-13T18:44:39.726748+0000","last_fullsized":"2024-09-13T18:44:39.726748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:39.726611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:39.726611+0000","last_clean_scrub_stamp":"2024-09-13T18:44:39.726611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:24.857585+0000","scrub_duration":0.0015396240000000001,"objects_trimmed":0,"snaptrim_duration":0.00060990299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"23'131","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:49.688601+0000","last_change":"2024-09-13T18:43:49.688580+0000","last_active":"2024-09-13T18:43:49.688601+0000","last_peered":"2024-09-13T18:43:49.688601+0000","last_clean":"2024-09-13T18:43:49.688601+0000","last_became_active":"2024-09-13T18:39:54.667244+0000","last_became_peered":"2024-09-13T18:39:54.667244+0000","last_unstale":"2024-09-13T18:43:49.688601+0000","last_undegraded":"2024-09-13T18:43:49.688601+0000","last_fullsized":"2024-09-13T18:43:49.688601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'131","last_scrub_stamp":"2024-09-13T18:43:49.688505+0000","last_deep_scrub":"23'131","last_deep_scrub_stamp":"2024-09-13T18:43:49.688505+0000","last_clean_scrub_stamp":"2024-09-13T18:43:49.688505+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:54.329356+0000","scrub_duration":0.00167341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"23'171","reported_seq":194,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:15.679276+0000","last_change":"2024-09-13T18:44:15.679246+0000","last_active":"2024-09-13T18:44:15.679276+0000","last_peered":"2024-09-13T18:44:15.679276+0000","last_clean":"2024-09-13T18:44:15.679276+0000","last_became_active":"2024-09-13T18:39:14.593533+0000","last_became_peered":"2024-09-13T18:39:14.593533+0000","last_unstale":"2024-09-13T18:44:15.679276+0000","last_undegraded":"2024-09-13T18:44:15.679276+0000","last_fullsized":"2024-09-13T18:44:15.679276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'171","last_scrub_stamp":"2024-09-13T18:44:15.679145+0000","last_deep_scrub":"23'171","last_deep_scrub_stamp":"2024-09-13T18:44:15.679145+0000","last_clean_scrub_stamp":"2024-09-13T18:44:15.679145+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:41.597377+0000","scrub_duration":0.002087616,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"23'99","reported_seq":123,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:24.727856+0000","last_change":"2024-09-13T18:44:24.727829+0000","last_active":"2024-09-13T18:44:24.727856+0000","last_peered":"2024-09-13T18:44:24.727856+0000","last_clean":"2024-09-13T18:44:24.727856+0000","last_became_active":"2024-09-13T18:39:13.574695+0000","last_became_peered":"2024-09-13T18:39:13.574695+0000","last_unstale":"2024-09-13T18:44:24.727856+0000","last_undegraded":"2024-09-13T18:44:24.727856+0000","last_fullsized":"2024-09-13T18:44:24.727856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'99","last_scrub_stamp":"2024-09-13T18:44:24.727735+0000","last_deep_scrub":"23'99","last_deep_scrub_stamp":"2024-09-13T18:44:24.727735+0000","last_clean_scrub_stamp":"2024-09-13T18:44:24.727735+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:26.329227+0000","scrub_duration":0.0056265730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198201,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"23'157","reported_seq":180,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:55.780613+0000","last_change":"2024-09-13T18:43:55.780577+0000","last_active":"2024-09-13T18:43:55.780613+0000","last_peered":"2024-09-13T18:43:55.780613+0000","last_clean":"2024-09-13T18:43:55.780613+0000","last_became_active":"2024-09-13T18:39:14.597926+0000","last_became_peered":"2024-09-13T18:39:14.597926+0000","last_unstale":"2024-09-13T18:43:55.780613+0000","last_undegraded":"2024-09-13T18:43:55.780613+0000","last_fullsized":"2024-09-13T18:43:55.780613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'157","last_scrub_stamp":"2024-09-13T18:43:55.780470+0000","last_deep_scrub":"23'157","last_deep_scrub_stamp":"2024-09-13T18:43:55.780470+0000","last_clean_scrub_stamp":"2024-09-13T18:43:55.780470+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:19.819546+0000","scrub_duration":0.0021443629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'10","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:28.523474+0000","last_change":"2024-09-13T18:44:28.523440+0000","last_active":"2024-09-13T18:44:28.523474+0000","last_peered":"2024-09-13T18:44:28.523474+0000","last_clean":"2024-09-13T18:44:28.523474+0000","last_became_active":"2024-09-13T18:39:13.571766+0000","last_became_peered":"2024-09-13T18:39:13.571766+0000","last_unstale":"2024-09-13T18:44:28.523474+0000","last_undegraded":"2024-09-13T18:44:28.523474+0000","last_fullsized":"2024-09-13T18:44:28.523474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-09-13T18:44:28.523349+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-09-13T18:44:28.523349+0000","last_clean_scrub_stamp":"2024-09-13T18:44:28.523349+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:23.345989+0000","scrub_duration":0.0033572989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:09.738028+0000","last_change":"2024-09-13T18:44:09.738008+0000","last_active":"2024-09-13T18:44:09.738028+0000","last_peered":"2024-09-13T18:44:09.738028+0000","last_clean":"2024-09-13T18:44:09.738028+0000","last_became_active":"2024-09-13T18:39:13.571369+0000","last_became_peered":"2024-09-13T18:39:13.571369+0000","last_unstale":"2024-09-13T18:44:09.738028+0000","last_undegraded":"2024-09-13T18:44:09.738028+0000","last_fullsized":"2024-09-13T18:44:09.738028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:09.737921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:09.737921+0000","last_clean_scrub_stamp":"2024-09-13T18:44:09.737921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:46.697943+0000","scrub_duration":0.001162988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'189","reported_seq":212,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:23.686400+0000","last_change":"2024-09-13T18:44:23.686366+0000","last_active":"2024-09-13T18:44:23.686400+0000","last_peered":"2024-09-13T18:44:23.686400+0000","last_clean":"2024-09-13T18:44:23.686400+0000","last_became_active":"2024-09-13T18:39:14.588427+0000","last_became_peered":"2024-09-13T18:39:14.588427+0000","last_unstale":"2024-09-13T18:44:23.686400+0000","last_undegraded":"2024-09-13T18:44:23.686400+0000","last_fullsized":"2024-09-13T18:44:23.686400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'189","last_scrub_stamp":"2024-09-13T18:44:23.686241+0000","last_deep_scrub":"23'189","last_deep_scrub_stamp":"2024-09-13T18:44:23.686241+0000","last_clean_scrub_stamp":"2024-09-13T18:44:23.686241+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:41.829839+0000","scrub_duration":0.002437472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"23'1","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:08.569034+0000","last_change":"2024-09-13T18:44:08.569010+0000","last_active":"2024-09-13T18:44:08.569034+0000","last_peered":"2024-09-13T18:44:08.569034+0000","last_clean":"2024-09-13T18:44:08.569034+0000","last_became_active":"2024-09-13T18:39:13.569628+0000","last_became_peered":"2024-09-13T18:39:13.569628+0000","last_unstale":"2024-09-13T18:44:08.569034+0000","last_undegraded":"2024-09-13T18:44:08.569034+0000","last_fullsized":"2024-09-13T18:44:08.569034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-09-13T18:44:08.568898+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-09-13T18:44:08.568898+0000","last_clean_scrub_stamp":"2024-09-13T18:44:08.568898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:30.299507+0000","scrub_duration":0.00140011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'165","reported_seq":188,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:18.646199+0000","last_change":"2024-09-13T18:44:18.646173+0000","last_active":"2024-09-13T18:44:18.646199+0000","last_peered":"2024-09-13T18:44:18.646199+0000","last_clean":"2024-09-13T18:44:18.646199+0000","last_became_active":"2024-09-13T18:39:14.581316+0000","last_became_peered":"2024-09-13T18:39:14.581316+0000","last_unstale":"2024-09-13T18:44:18.646199+0000","last_undegraded":"2024-09-13T18:44:18.646199+0000","last_fullsized":"2024-09-13T18:44:18.646199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'165","last_scrub_stamp":"2024-09-13T18:44:18.646081+0000","last_deep_scrub":"23'165","last_deep_scrub_stamp":"2024-09-13T18:44:18.646081+0000","last_clean_scrub_stamp":"2024-09-13T18:44:18.646081+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:13.468721+0000","scrub_duration":0.0021880950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"23'135","reported_seq":155,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:42.589014+0000","last_change":"2024-09-13T18:44:42.588971+0000","last_active":"2024-09-13T18:44:42.589014+0000","last_peered":"2024-09-13T18:44:42.589014+0000","last_clean":"2024-09-13T18:44:42.589014+0000","last_became_active":"2024-09-13T18:39:54.667809+0000","last_became_peered":"2024-09-13T18:39:54.667809+0000","last_unstale":"2024-09-13T18:44:42.589014+0000","last_undegraded":"2024-09-13T18:44:42.589014+0000","last_fullsized":"2024-09-13T18:44:42.589014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'135","last_scrub_stamp":"2024-09-13T18:44:42.588850+0000","last_deep_scrub":"23'135","last_deep_scrub_stamp":"2024-09-13T18:44:42.588850+0000","last_clean_scrub_stamp":"2024-09-13T18:44:42.588850+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:38.611073+0000","scrub_duration":0.0020869019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:58.697793+0000","last_change":"2024-09-13T18:43:58.697767+0000","last_active":"2024-09-13T18:43:58.697793+0000","last_peered":"2024-09-13T18:43:58.697793+0000","last_clean":"2024-09-13T18:43:58.697793+0000","last_became_active":"2024-09-13T18:39:13.573532+0000","last_became_peered":"2024-09-13T18:39:13.573532+0000","last_unstale":"2024-09-13T18:43:58.697793+0000","last_undegraded":"2024-09-13T18:43:58.697793+0000","last_fullsized":"2024-09-13T18:43:58.697793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:58.697674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:58.697674+0000","last_clean_scrub_stamp":"2024-09-13T18:43:58.697674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:47.894303+0000","scrub_duration":0.0013764059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"23'152","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:49.621598+0000","last_change":"2024-09-13T18:44:49.621568+0000","last_active":"2024-09-13T18:44:49.621598+0000","last_peered":"2024-09-13T18:44:49.621598+0000","last_clean":"2024-09-13T18:44:49.621598+0000","last_became_active":"2024-09-13T18:39:14.586041+0000","last_became_peered":"2024-09-13T18:39:14.586041+0000","last_unstale":"2024-09-13T18:44:49.621598+0000","last_undegraded":"2024-09-13T18:44:49.621598+0000","last_fullsized":"2024-09-13T18:44:49.621598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'152","last_scrub_stamp":"2024-09-13T18:44:49.621463+0000","last_deep_scrub":"23'152","last_deep_scrub_stamp":"2024-09-13T18:44:49.621463+0000","last_clean_scrub_stamp":"2024-09-13T18:44:49.621463+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:34.752436+0000","scrub_duration":0.0021307040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:22.538801+0000","last_change":"2024-09-13T18:44:22.538766+0000","last_active":"2024-09-13T18:44:22.538801+0000","last_peered":"2024-09-13T18:44:22.538801+0000","last_clean":"2024-09-13T18:44:22.538801+0000","last_became_active":"2024-09-13T18:39:13.585845+0000","last_became_peered":"2024-09-13T18:39:13.585845+0000","last_unstale":"2024-09-13T18:44:22.538801+0000","last_undegraded":"2024-09-13T18:44:22.538801+0000","last_fullsized":"2024-09-13T18:44:22.538801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:22.538665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:22.538665+0000","last_clean_scrub_stamp":"2024-09-13T18:44:22.538665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:44.638156+0000","scrub_duration":0.0014664400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"23'183","reported_seq":203,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:43.632578+0000","last_change":"2024-09-13T18:44:43.632547+0000","last_active":"2024-09-13T18:44:43.632578+0000","last_peered":"2024-09-13T18:44:43.632578+0000","last_clean":"2024-09-13T18:44:43.632578+0000","last_became_active":"2024-09-13T18:39:54.668613+0000","last_became_peered":"2024-09-13T18:39:54.668613+0000","last_unstale":"2024-09-13T18:44:43.632578+0000","last_undegraded":"2024-09-13T18:44:43.632578+0000","last_fullsized":"2024-09-13T18:44:43.632578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'183","last_scrub_stamp":"2024-09-13T18:44:43.632454+0000","last_deep_scrub":"23'183","last_deep_scrub_stamp":"2024-09-13T18:44:43.632454+0000","last_clean_scrub_stamp":"2024-09-13T18:44:43.632454+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:13.302697+0000","scrub_duration":0.002143023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:06.658725+0000","last_change":"2024-09-13T18:44:06.658686+0000","last_active":"2024-09-13T18:44:06.658725+0000","last_peered":"2024-09-13T18:44:06.658725+0000","last_clean":"2024-09-13T18:44:06.658725+0000","last_became_active":"2024-09-13T18:39:13.575172+0000","last_became_peered":"2024-09-13T18:39:13.575172+0000","last_unstale":"2024-09-13T18:44:06.658725+0000","last_undegraded":"2024-09-13T18:44:06.658725+0000","last_fullsized":"2024-09-13T18:44:06.658725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:44:06.658584+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:44:06.658584+0000","last_clean_scrub_stamp":"2024-09-13T18:44:06.658584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:01.104314+0000","scrub_duration":0.0014171240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"23'141","reported_seq":164,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:22.638805+0000","last_change":"2024-09-13T18:44:22.638773+0000","last_active":"2024-09-13T18:44:22.638805+0000","last_peered":"2024-09-13T18:44:22.638805+0000","last_clean":"2024-09-13T18:44:22.638805+0000","last_became_active":"2024-09-13T18:39:14.580349+0000","last_became_peered":"2024-09-13T18:39:14.580349+0000","last_unstale":"2024-09-13T18:44:22.638805+0000","last_undegraded":"2024-09-13T18:44:22.638805+0000","last_fullsized":"2024-09-13T18:44:22.638805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'141","last_scrub_stamp":"2024-09-13T18:44:22.638683+0000","last_deep_scrub":"23'141","last_deep_scrub_stamp":"2024-09-13T18:44:22.638683+0000","last_clean_scrub_stamp":"2024-09-13T18:44:22.638683+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:54.344049+0000","scrub_duration":0.0020241450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:33.553093+0000","last_change":"2024-09-13T18:44:33.553058+0000","last_active":"2024-09-13T18:44:33.553093+0000","last_peered":"2024-09-13T18:44:33.553093+0000","last_clean":"2024-09-13T18:44:33.553093+0000","last_became_active":"2024-09-13T18:39:13.570683+0000","last_became_peered":"2024-09-13T18:39:13.570683+0000","last_unstale":"2024-09-13T18:44:33.553093+0000","last_undegraded":"2024-09-13T18:44:33.553093+0000","last_fullsized":"2024-09-13T18:44:33.553093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:44:33.552934+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:44:33.552934+0000","last_clean_scrub_stamp":"2024-09-13T18:44:33.552934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:51.696532+0000","scrub_duration":0.001422319,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"23'137","reported_seq":160,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:25.605839+0000","last_change":"2024-09-13T18:44:25.605809+0000","last_active":"2024-09-13T18:44:25.605839+0000","last_peered":"2024-09-13T18:44:25.605839+0000","last_clean":"2024-09-13T18:44:25.605839+0000","last_became_active":"2024-09-13T18:39:14.593049+0000","last_became_peered":"2024-09-13T18:39:14.593049+0000","last_unstale":"2024-09-13T18:44:25.605839+0000","last_undegraded":"2024-09-13T18:44:25.605839+0000","last_fullsized":"2024-09-13T18:44:25.605839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'137","last_scrub_stamp":"2024-09-13T18:44:25.605695+0000","last_deep_scrub":"23'137","last_deep_scrub_stamp":"2024-09-13T18:44:25.605695+0000","last_clean_scrub_stamp":"2024-09-13T18:44:25.605695+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:20.428335+0000","scrub_duration":0.0021889399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'3","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:32.507770+0000","last_change":"2024-09-13T18:44:32.507734+0000","last_active":"2024-09-13T18:44:32.507770+0000","last_peered":"2024-09-13T18:44:32.507770+0000","last_clean":"2024-09-13T18:44:32.507770+0000","last_became_active":"2024-09-13T18:39:13.584624+0000","last_became_peered":"2024-09-13T18:39:13.584624+0000","last_unstale":"2024-09-13T18:44:32.507770+0000","last_undegraded":"2024-09-13T18:44:32.507770+0000","last_fullsized":"2024-09-13T18:44:32.507770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-13T18:44:32.507647+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-13T18:44:32.507647+0000","last_clean_scrub_stamp":"2024-09-13T18:44:32.507647+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:27.330287+0000","scrub_duration":0.0024407769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"23'130","reported_seq":162,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:55.721042+0000","last_change":"2024-09-13T18:43:55.721011+0000","last_active":"2024-09-13T18:43:55.721042+0000","last_peered":"2024-09-13T18:43:55.721042+0000","last_clean":"2024-09-13T18:43:55.721042+0000","last_became_active":"2024-09-13T18:39:54.667188+0000","last_became_peered":"2024-09-13T18:39:54.667188+0000","last_unstale":"2024-09-13T18:43:55.721042+0000","last_undegraded":"2024-09-13T18:43:55.721042+0000","last_fullsized":"2024-09-13T18:43:55.721042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'130","last_scrub_stamp":"2024-09-13T18:43:55.720852+0000","last_deep_scrub":"23'130","last_deep_scrub_stamp":"2024-09-13T18:43:55.720852+0000","last_clean_scrub_stamp":"2024-09-13T18:43:55.720852+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:45.416337+0000","scrub_duration":0.002372299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'4","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:35.754807+0000","last_change":"2024-09-13T18:44:35.754782+0000","last_active":"2024-09-13T18:44:35.754807+0000","last_peered":"2024-09-13T18:44:35.754807+0000","last_clean":"2024-09-13T18:44:35.754807+0000","last_became_active":"2024-09-13T18:39:13.573744+0000","last_became_peered":"2024-09-13T18:39:13.573744+0000","last_unstale":"2024-09-13T18:44:35.754807+0000","last_undegraded":"2024-09-13T18:44:35.754807+0000","last_fullsized":"2024-09-13T18:44:35.754807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-09-13T18:44:35.754687+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-09-13T18:44:35.754687+0000","last_clean_scrub_stamp":"2024-09-13T18:44:35.754687+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:31.776910+0000","scrub_duration":0.0024488629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"23'157","reported_seq":180,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:43:51.713030+0000","last_change":"2024-09-13T18:43:51.713001+0000","last_active":"2024-09-13T18:43:51.713030+0000","last_peered":"2024-09-13T18:43:51.713030+0000","last_clean":"2024-09-13T18:43:51.713030+0000","last_became_active":"2024-09-13T18:39:14.591135+0000","last_became_peered":"2024-09-13T18:39:14.591135+0000","last_unstale":"2024-09-13T18:43:51.713030+0000","last_undegraded":"2024-09-13T18:43:51.713030+0000","last_fullsized":"2024-09-13T18:43:51.713030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'157","last_scrub_stamp":"2024-09-13T18:43:51.712881+0000","last_deep_scrub":"23'157","last_deep_scrub_stamp":"2024-09-13T18:43:51.712881+0000","last_clean_scrub_stamp":"2024-09-13T18:43:51.712881+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:48.113167+0000","scrub_duration":0.002119082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:37.738171+0000","last_change":"2024-09-13T18:44:37.738127+0000","last_active":"2024-09-13T18:44:37.738171+0000","last_peered":"2024-09-13T18:44:37.738171+0000","last_clean":"2024-09-13T18:44:37.738171+0000","last_became_active":"2024-09-13T18:39:13.574971+0000","last_became_peered":"2024-09-13T18:39:13.574971+0000","last_unstale":"2024-09-13T18:44:37.738171+0000","last_undegraded":"2024-09-13T18:44:37.738171+0000","last_fullsized":"2024-09-13T18:44:37.738171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-09-13T18:44:37.738010+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-09-13T18:44:37.738010+0000","last_clean_scrub_stamp":"2024-09-13T18:44:37.738010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:58.881605+0000","scrub_duration":0.0014234600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"23'170","reported_seq":193,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:16.668173+0000","last_change":"2024-09-13T18:44:16.668146+0000","last_active":"2024-09-13T18:44:16.668173+0000","last_peered":"2024-09-13T18:44:16.668173+0000","last_clean":"2024-09-13T18:44:16.668173+0000","last_became_active":"2024-09-13T18:39:14.580477+0000","last_became_peered":"2024-09-13T18:39:14.580477+0000","last_unstale":"2024-09-13T18:44:16.668173+0000","last_undegraded":"2024-09-13T18:44:16.668173+0000","last_fullsized":"2024-09-13T18:44:16.668173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'170","last_scrub_stamp":"2024-09-13T18:44:16.668031+0000","last_deep_scrub":"23'170","last_deep_scrub_stamp":"2024-09-13T18:44:16.668031+0000","last_clean_scrub_stamp":"2024-09-13T18:44:16.668031+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:38.767522+0000","scrub_duration":0.002367409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"23'6","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:44:01.483853+0000","last_change":"2024-09-13T18:44:01.483824+0000","last_active":"2024-09-13T18:44:01.483853+0000","last_peered":"2024-09-13T18:44:01.483853+0000","last_clean":"2024-09-13T18:44:01.483853+0000","last_became_active":"2024-09-13T18:39:13.582905+0000","last_became_peered":"2024-09-13T18:39:13.582905+0000","last_unstale":"2024-09-13T18:44:01.483853+0000","last_undegraded":"2024-09-13T18:44:01.483853+0000","last_fullsized":"2024-09-13T18:44:01.483853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-09-13T18:44:01.483735+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-09-13T18:44:01.483735+0000","last_clean_scrub_stamp":"2024-09-13T18:44:01.483735+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:57.884021+0000","scrub_duration":0.0032014309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":199492,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":160,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":398984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":175,"ondisk_log_size":175,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705741,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306084,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065756,"statfs":{"total":96636764160,"available":96323334144,"internally_reserved":0,"allocated":421888,"data_stored":266388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.33900000000000002,"15min":0.32100000000000001},"min":{"1min":0.17299999999999999,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.48399999999999999,"5min":4.5049999999999999,"15min":4.5049999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.22600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.1679999999999999,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.375,"15min":0.34899999999999998},"min":{"1min":0.251,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.94599999999999995,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.38},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.37,"15min":0.34200000000000003},"min":{"1min":0.248,"5min":0.187,"15min":0.187},"max":{"1min":0.98399999999999999,"5min":2.9660000000000002,"15min":2.9660000000000002},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.96899999999999997,"5min":3,"15min":3},"last":0.44},{"interface":"front","average":{"1min":0.374,"5min":0.39000000000000001,"15min":0.37},"min":{"1min":0.245,"5min":0.22,"15min":0.22},"max":{"1min":0.84899999999999998,"5min":4.5590000000000002,"15min":4.5590000000000002},"last":0.42399999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705742,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306072,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065768,"statfs":{"total":96636764160,"available":96323346432,"internally_reserved":0,"allocated":409600,"data_stored":266680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:44:10 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.21199999999999999,"5min":0.151,"15min":0.151},"max":{"1min":0.42399999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.31,"5min":0.33000000000000002,"15min":0.33100000000000002},"min":{"1min":0.20200000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.41999999999999998,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.497}]},{"osd":1,"last update":"Fri Sep 13 18:44:10 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.215,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.40699999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34000000000000002,"15min":0.34300000000000003},"min":{"1min":0.23000000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.44700000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:44:10 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34799999999999998,"15min":0.34499999999999997},"min":{"1min":0.23999999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.51300000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.373,"15min":0.373},"min":{"1min":0.249,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46300000000000002,"5min":1.47,"15min":1.47},"last":0.54600000000000004}]}]},{"osd":1,"up_from":9,"seq":38654705740,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306460,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065380,"statfs":{"total":96636764160,"available":96322949120,"internally_reserved":0,"allocated":806912,"data_stored":659023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35699999999999998,"15min":0.31900000000000001},"min":{"1min":0.224,"5min":0.159,"15min":0.159},"max":{"1min":0.75,"5min":1.849,"15min":1.849},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.33800000000000002},"min":{"1min":0.22600000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40600000000000003,"15min":0.35599999999999998},"min":{"1min":0.19500000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.71899999999999997,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.38200000000000001,"15min":0.35399999999999998},"min":{"1min":0.26700000000000002,"5min":0.192,"15min":0.192},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.38}]},{"osd":3,"last update":"Fri Sep 13 18:44:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.38800000000000001,"15min":0.35799999999999998},"min":{"1min":0.25900000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":0.443},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.45500000000000002,"15min":0.38900000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":2.9430000000000001,"5min":6.468,"15min":6.468},"last":0.46400000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705741,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306464,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":94065376,"statfs":{"total":96636764160,"available":96322945024,"internally_reserved":0,"allocated":811008,"data_stored":659563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:44:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":0.48499999999999999,"15min":0.36699999999999999},"min":{"1min":0.19,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":20.393000000000001,"5min":20.393000000000001,"15min":20.393000000000001},"last":0.315},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.41599999999999998,"15min":0.36199999999999999},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":9.7189999999999994,"5min":9.7189999999999994,"15min":9.7189999999999994},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:44:08 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.20499999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.44400000000000001,"15min":0.374},"min":{"1min":0.222,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":11.726000000000001,"5min":11.726000000000001,"15min":11.726000000000001},"last":0.39500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:44:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":0.51000000000000001,"15min":0.40999999999999998},"min":{"1min":0.248,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":16.503,"5min":16.503,"15min":16.503},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.34699999999999998,"15min":0.35499999999999998},"min":{"1min":0.21099999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.47699999999999998,"5min":0.496,"15min":0.496},"last":0.38600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":198706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":198395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:45:10.649 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T18:45:10.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.771+0000 7fb43f846640 1 Processor -- start 2024-09-13T18:45:10.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.771+0000 7fb43f846640 1 -- start start 2024-09-13T18:45:10.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43f846640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb438067110 0x7fb43809a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:10.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43f846640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb43809af50 0x7fb43812fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:10.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43f846640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb438067b30 con 0x7fb43809ab50 2024-09-13T18:45:10.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43f846640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4380674e0 con 0x7fb438067110 2024-09-13T18:45:10.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43f846640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43809b640 con 0x7fb43809af50 2024-09-13T18:45:10.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43d5e2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb438067110 0x7fb43809a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:10.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43dde3640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb43809af50 0x7fb43812fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:10.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43d5e2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb438067110 0x7fb43809a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60938/0 (socket says 172.21.15.97:60938) 2024-09-13T18:45:10.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43cde1640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb43809ab50 0x7fb43812f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35440/0 (socket says 172.21.15.97:35440) 2024-09-13T18:45:10.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43d5e2640 1 -- 172.21.15.97:0/3522734845 learned_addr learned my addr 172.21.15.97:0/3522734845 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:10.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43dde3640 1 -- 172.21.15.97:0/3522734845 >> v2:172.21.15.97:3300/0 conn(0x7fb438067110 msgr2=0x7fb43809a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43dde3640 1 --2- 172.21.15.97:0/3522734845 >> v2:172.21.15.97:3300/0 conn(0x7fb438067110 0x7fb43809a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43dde3640 1 -- 172.21.15.97:0/3522734845 >> v1:172.21.15.97:6789/0 conn(0x7fb43809ab50 legacy=0x7fb43812f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb42ffff640 1 -- 172.21.15.97:0/3522734845 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914549017 0 0) 0x7fb438067b30 con 0x7fb43809ab50 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.772+0000 7fb43dde3640 1 -- 172.21.15.97:0/3522734845 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438067f20 con 0x7fb43809af50 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.773+0000 7fb43dde3640 1 --2- 172.21.15.97:0/3522734845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb43809af50 0x7fb43812fde0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb430009e60 tx=0x7fb430009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fa8ca1586361bad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.773+0000 7fb42ffff640 1 -- 172.21.15.97:0/3522734845 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430007550 con 0x7fb43809af50 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.773+0000 7fb42ffff640 1 -- 172.21.15.97:0/3522734845 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43002d050 con 0x7fb43809af50 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.773+0000 7fb42ffff640 1 -- 172.21.15.97:0/3522734845 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4300078e0 con 0x7fb43809af50 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.774+0000 7fb43f846640 1 -- 172.21.15.97:0/3522734845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb43809af50 msgr2=0x7fb43812fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.774+0000 7fb43f846640 1 --2- 172.21.15.97:0/3522734845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb43809af50 0x7fb43812fde0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb430009e60 tx=0x7fb430009780 comp rx=0 tx=0).stop 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.774+0000 7fb43f846640 1 -- 172.21.15.97:0/3522734845 shutdown_connections 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.774+0000 7fb43f846640 1 --2- 172.21.15.97:0/3522734845 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb43809af50 0x7fb43812fde0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.774+0000 7fb43f846640 1 --2- 172.21.15.97:0/3522734845 >> v2:172.21.15.97:3300/0 conn(0x7fb438067110 0x7fb43809a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.774+0000 7fb43f846640 1 -- 172.21.15.97:0/3522734845 >> 172.21.15.97:0/3522734845 conn(0x7fb43809f790 msgr2=0x7fb43809fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:10.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.774+0000 7fb43f846640 1 -- 172.21.15.97:0/3522734845 shutdown_connections 2024-09-13T18:45:10.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.774+0000 7fb43f846640 1 -- 172.21.15.97:0/3522734845 wait complete. 2024-09-13T18:45:10.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.774+0000 7fb43f846640 1 Processor -- start 2024-09-13T18:45:10.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.774+0000 7fb43f846640 1 -- start start 2024-09-13T18:45:10.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43f846640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb438067110 0x7fb43813e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:10.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43f846640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb43809ab50 0x7fb43813ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:10.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43f846640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb43809af50 0x7fb43813f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:10.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43f846640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43809bb10 con 0x7fb438067110 2024-09-13T18:45:10.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43f846640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4381221c0 con 0x7fb43809ab50 2024-09-13T18:45:10.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43f846640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb438121c20 con 0x7fb43809af50 2024-09-13T18:45:10.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43d5e2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb438067110 0x7fb43813e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:10.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43cde1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb43809ab50 0x7fb43813ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:10.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43d5e2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb438067110 0x7fb43813e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60952/0 (socket says 172.21.15.97:60952) 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43cde1640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb43809ab50 0x7fb43813ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:57744/0 (socket says 172.21.15.97:57744) 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43dde3640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb43809af50 0x7fb43813f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43d5e2640 1 -- 172.21.15.97:0/541674608 learned_addr learned my addr 172.21.15.97:0/541674608 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43d5e2640 1 -- 172.21.15.97:0/541674608 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb43809af50 msgr2=0x7fb43813f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43d5e2640 1 --2- 172.21.15.97:0/541674608 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb43809af50 0x7fb43813f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43d5e2640 1 -- 172.21.15.97:0/541674608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb43809ab50 msgr2=0x7fb43813ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43d5e2640 1 --2- 172.21.15.97:0/541674608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb43809ab50 0x7fb43813ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43d5e2640 1 -- 172.21.15.97:0/541674608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb430009a20 con 0x7fb438067110 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.775+0000 7fb43cde1640 1 --2- 172.21.15.97:0/541674608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb43809ab50 0x7fb43813ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.776+0000 7fb43d5e2640 1 --2- 172.21.15.97:0/541674608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb438067110 0x7fb43813e7c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb43400e950 tx=0x7fb4340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.776+0000 7fb42d7fa640 1 -- 172.21.15.97:0/541674608 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400c8e0 con 0x7fb438067110 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.776+0000 7fb42d7fa640 1 -- 172.21.15.97:0/541674608 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400ca60 con 0x7fb438067110 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.776+0000 7fb42d7fa640 1 -- 172.21.15.97:0/541674608 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400ce20 con 0x7fb438067110 2024-09-13T18:45:10.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.776+0000 7fb43f846640 1 -- 172.21.15.97:0/541674608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb438122910 con 0x7fb438067110 2024-09-13T18:45:10.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.776+0000 7fb43f846640 1 -- 172.21.15.97:0/541674608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43811ed50 con 0x7fb438067110 2024-09-13T18:45:10.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.777+0000 7fb42d7fa640 1 -- 172.21.15.97:0/541674608 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fb434013680 con 0x7fb438067110 2024-09-13T18:45:10.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.777+0000 7fb42d7fa640 1 -- 172.21.15.97:0/541674608 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7fb4340423b0 con 0x7fb438067110 2024-09-13T18:45:10.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.777+0000 7fb43f846640 1 -- 172.21.15.97:0/541674608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb438064000 con 0x7fb438067110 2024-09-13T18:45:10.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.781+0000 7fb42d7fa640 1 -- 172.21.15.97:0/541674608 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fb434021020 con 0x7fb438067110 2024-09-13T18:45:10.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.932+0000 7fb43f846640 1 -- 172.21.15.97:0/541674608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb43806f720 con 0x7fb438067110 2024-09-13T18:45:10.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.938+0000 7fb42d7fa640 1 -- 172.21.15.97:0/541674608 <== mon.0 v2:172.21.15.97:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb434023ad0 con 0x7fb438067110 2024-09-13T18:45:10.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.938+0000 7fb42d7fa640 1 -- 172.21.15.97:0/541674608 <== mon.0 v2:172.21.15.97:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb4340234d0 con 0x7fb438067110 2024-09-13T18:45:10.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.940+0000 7fb43f846640 1 -- 172.21.15.97:0/541674608 >> v1:172.21.15.97:6816/34603 conn(0x7fb41c031160 legacy=0x7fb41c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:10.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.940+0000 7fb43f846640 1 -- 172.21.15.97:0/541674608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb438067110 msgr2=0x7fb43813e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:10.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.940+0000 7fb43f846640 1 --2- 172.21.15.97:0/541674608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb438067110 0x7fb43813e7c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb43400e950 tx=0x7fb4340091d0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.940+0000 7fb43f846640 1 -- 172.21.15.97:0/541674608 shutdown_connections 2024-09-13T18:45:10.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.940+0000 7fb43f846640 1 --2- 172.21.15.97:0/541674608 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fb43809af50 0x7fb43813f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.940+0000 7fb43f846640 1 --2- 172.21.15.97:0/541674608 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fb43809ab50 0x7fb43813ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.940+0000 7fb43f846640 1 --2- 172.21.15.97:0/541674608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb438067110 0x7fb43813e7c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:10.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.940+0000 7fb43f846640 1 -- 172.21.15.97:0/541674608 >> 172.21.15.97:0/541674608 conn(0x7fb43809f790 msgr2=0x7fb438098a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:10.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.940+0000 7fb43f846640 1 -- 172.21.15.97:0/541674608 shutdown_connections 2024-09-13T18:45:10.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:10.940+0000 7fb43f846640 1 -- 172.21.15.97:0/541674608 wait complete. 2024-09-13T18:45:10.954 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:45:10.954 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:11.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.045+0000 7f7bba51d640 1 Processor -- start 2024-09-13T18:45:11.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.045+0000 7f7bba51d640 1 -- start start 2024-09-13T18:45:11.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.045+0000 7f7bba51d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7bb409ac20 0x7f7bb4096e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.045+0000 7f7bba51d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb4131570 0x7f7bb4133950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.045+0000 7f7bba51d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb406efe0 con 0x7f7bb40969d0 2024-09-13T18:45:11.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.045+0000 7f7bba51d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb409aff0 con 0x7f7bb409ac20 2024-09-13T18:45:11.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.045+0000 7f7bba51d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb406a5e0 con 0x7f7bb4131570 2024-09-13T18:45:11.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.045+0000 7f7bb8aba640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb4131570 0x7f7bb4133950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.045+0000 7f7bb3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7bb409ac20 0x7f7bb4096e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.045+0000 7f7bb8aba640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb4131570 0x7f7bb4133950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:60660/0 (socket says 172.21.15.97:60660) 2024-09-13T18:45:11.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.045+0000 7f7bb8aba640 1 -- 172.21.15.97:0/2363666603 learned_addr learned my addr 172.21.15.97:0/2363666603 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:11.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.045+0000 7f7bb3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7bb409ac20 0x7f7bb4096e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60966/0 (socket says 172.21.15.97:60966) 2024-09-13T18:45:11.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.045+0000 7f7bb37fe640 1 --1- 172.21.15.97:0/2363666603 >> v1:172.21.15.97:6789/0 conn(0x7f7bb40969d0 0x7f7bb40973a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35450/0 (socket says 172.21.15.97:35450) 2024-09-13T18:45:11.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.046+0000 7f7bb8aba640 1 -- 172.21.15.97:0/2363666603 >> v2:172.21.15.97:3300/0 conn(0x7f7bb409ac20 msgr2=0x7f7bb4096e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:11.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.046+0000 7f7bb8aba640 1 --2- 172.21.15.97:0/2363666603 >> v2:172.21.15.97:3300/0 conn(0x7f7bb409ac20 0x7f7bb4096e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.046+0000 7f7bb8aba640 1 -- 172.21.15.97:0/2363666603 >> v1:172.21.15.97:6789/0 conn(0x7f7bb40969d0 legacy=0x7f7bb40973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.046+0000 7f7bb8aba640 1 -- 172.21.15.97:0/2363666603 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb4098b40 con 0x7f7bb4131570 2024-09-13T18:45:11.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.046+0000 7f7bb3fff640 1 --2- 172.21.15.97:0/2363666603 >> v2:172.21.15.97:3300/0 conn(0x7f7bb409ac20 0x7f7bb4096e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:11.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.046+0000 7f7bb8aba640 1 --2- 172.21.15.97:0/2363666603 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb4131570 0x7f7bb4133950 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00d1a0 tx=0x7f7bac00ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbfe878c96f42a61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:11.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.046+0000 7f7bb2ffd640 1 -- 172.21.15.97:0/2363666603 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac00b0d0 con 0x7f7bb4131570 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.046+0000 7f7bb2ffd640 1 -- 172.21.15.97:0/2363666603 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7bac00b230 con 0x7f7bb4131570 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.046+0000 7f7bb2ffd640 1 -- 172.21.15.97:0/2363666603 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac009610 con 0x7f7bb4131570 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.047+0000 7f7bba51d640 1 -- 172.21.15.97:0/2363666603 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb4131570 msgr2=0x7f7bb4133950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.047+0000 7f7bba51d640 1 --2- 172.21.15.97:0/2363666603 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb4131570 0x7f7bb4133950 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00d1a0 tx=0x7f7bac00ba50 comp rx=0 tx=0).stop 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.047+0000 7f7bba51d640 1 -- 172.21.15.97:0/2363666603 shutdown_connections 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.047+0000 7f7bba51d640 1 --2- 172.21.15.97:0/2363666603 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb4131570 0x7f7bb4133950 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.047+0000 7f7bba51d640 1 --2- 172.21.15.97:0/2363666603 >> v2:172.21.15.97:3300/0 conn(0x7f7bb409ac20 0x7f7bb4096e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.047+0000 7f7bba51d640 1 -- 172.21.15.97:0/2363666603 >> 172.21.15.97:0/2363666603 conn(0x7f7bb409e890 msgr2=0x7f7bb409ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.047+0000 7f7bba51d640 1 -- 172.21.15.97:0/2363666603 shutdown_connections 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.047+0000 7f7bba51d640 1 -- 172.21.15.97:0/2363666603 wait complete. 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.048+0000 7f7bba51d640 1 Processor -- start 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.048+0000 7f7bba51d640 1 -- start start 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.048+0000 7f7bba51d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb40969d0 0x7f7bb406ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.048+0000 7f7bba51d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb409ac20 0x7f7bb406cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.048+0000 7f7bba51d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bb4131570 0x7f7bb406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.048+0000 7f7bba51d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb41167a0 con 0x7f7bb409ac20 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.048+0000 7f7bba51d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb4117660 con 0x7f7bb4131570 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.048+0000 7f7bba51d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb409a840 con 0x7f7bb40969d0 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.048+0000 7f7bb3fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb40969d0 0x7f7bb406ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7bb37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb409ac20 0x7f7bb406cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7bb3fff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb40969d0 0x7f7bb406ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:60666/0 (socket says 172.21.15.97:60666) 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7bb3fff640 1 -- 172.21.15.97:0/1787173341 learned_addr learned my addr 172.21.15.97:0/1787173341 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7bb8aba640 1 --2- 172.21.15.97:0/1787173341 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bb4131570 0x7f7bb406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7bb3fff640 1 -- 172.21.15.97:0/1787173341 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bb4131570 msgr2=0x7f7bb406d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7bb3fff640 1 --2- 172.21.15.97:0/1787173341 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bb4131570 0x7f7bb406d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7bb3fff640 1 -- 172.21.15.97:0/1787173341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb409ac20 msgr2=0x7f7bb406cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7bb3fff640 1 --2- 172.21.15.97:0/1787173341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb409ac20 0x7f7bb406cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7bb3fff640 1 -- 172.21.15.97:0/1787173341 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba4009390 con 0x7f7bb40969d0 2024-09-13T18:45:11.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7bb37fe640 1 --2- 172.21.15.97:0/1787173341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb409ac20 0x7f7bb406cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:11.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7bb3fff640 1 --2- 172.21.15.97:0/1787173341 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb40969d0 0x7f7bb406ca30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400ec80 tx=0x7f7ba40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:11.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7b9bfff640 1 -- 172.21.15.97:0/1787173341 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba400eec0 con 0x7f7bb40969d0 2024-09-13T18:45:11.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7b9bfff640 1 -- 172.21.15.97:0/1787173341 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7ba400cbc0 con 0x7f7bb40969d0 2024-09-13T18:45:11.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7bba51d640 1 -- 172.21.15.97:0/1787173341 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac00bcf0 con 0x7f7bb40969d0 2024-09-13T18:45:11.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7b9bfff640 1 -- 172.21.15.97:0/1787173341 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4013470 con 0x7f7bb40969d0 2024-09-13T18:45:11.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.049+0000 7f7bba51d640 1 -- 172.21.15.97:0/1787173341 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb4115360 con 0x7f7bb40969d0 2024-09-13T18:45:11.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.050+0000 7f7b9bfff640 1 -- 172.21.15.97:0/1787173341 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f7ba40137e0 con 0x7f7bb40969d0 2024-09-13T18:45:11.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.050+0000 7f7b9bfff640 1 -- 172.21.15.97:0/1787173341 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f7ba40425f0 con 0x7f7bb40969d0 2024-09-13T18:45:11.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.050+0000 7f7bba51d640 1 -- 172.21.15.97:0/1787173341 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb41155e0 con 0x7f7bb40969d0 2024-09-13T18:45:11.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.055+0000 7f7b9bfff640 1 -- 172.21.15.97:0/1787173341 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f7ba4021080 con 0x7f7bb40969d0 2024-09-13T18:45:11.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.236+0000 7f7bba51d640 1 -- 172.21.15.97:0/1787173341 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bb4071440 con 0x7f7bb40969d0 2024-09-13T18:45:11.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.236+0000 7f7b9bfff640 1 -- 172.21.15.97:0/1787173341 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2264 (secure 0 0 0) 0x7f7ba4023ad0 con 0x7f7bb40969d0 2024-09-13T18:45:11.242 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:45:11.242 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:13.885647+0000","modified":"2024-09-13T18:39:16.567097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6817/3890865357","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6817","nonce":3890865357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-09-13T18:45:11.243 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 5 2024-09-13T18:45:11.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.238+0000 7f7bba51d640 1 -- 172.21.15.97:0/1787173341 >> v1:172.21.15.97:6816/34603 conn(0x7f7ba0031160 legacy=0x7f7ba0033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.238+0000 7f7bba51d640 1 -- 172.21.15.97:0/1787173341 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb40969d0 msgr2=0x7f7bb406ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.238+0000 7f7bba51d640 1 --2- 172.21.15.97:0/1787173341 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb40969d0 0x7f7bb406ca30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400ec80 tx=0x7f7ba40090f0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.238+0000 7f7bba51d640 1 -- 172.21.15.97:0/1787173341 shutdown_connections 2024-09-13T18:45:11.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.238+0000 7f7bba51d640 1 --2- 172.21.15.97:0/1787173341 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f7bb4131570 0x7f7bb406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.238+0000 7f7bba51d640 1 --2- 172.21.15.97:0/1787173341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7bb409ac20 0x7f7bb406cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.238+0000 7f7bba51d640 1 --2- 172.21.15.97:0/1787173341 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f7bb40969d0 0x7f7bb406ca30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.238+0000 7f7bba51d640 1 -- 172.21.15.97:0/1787173341 >> 172.21.15.97:0/1787173341 conn(0x7f7bb409e890 msgr2=0x7f7bb409c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:11.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.238+0000 7f7bba51d640 1 -- 172.21.15.97:0/1787173341 shutdown_connections 2024-09-13T18:45:11.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.238+0000 7f7bba51d640 1 -- 172.21.15.97:0/1787173341 wait complete. 2024-09-13T18:45:11.252 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:11.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.342+0000 7f62ef2e8640 1 Processor -- start 2024-09-13T18:45:11.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.342+0000 7f62ef2e8640 1 -- start start 2024-09-13T18:45:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.342+0000 7f62ef2e8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f62e809dfb0 0x7f62e8096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.342+0000 7f62ef2e8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 0x7f62e80974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.342+0000 7f62ef2e8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e806a190 con 0x7f62e812bf70 2024-09-13T18:45:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.342+0000 7f62ef2e8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e809e380 con 0x7f62e809dfb0 2024-09-13T18:45:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.342+0000 7f62ef2e8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8098870 con 0x7f62e80969d0 2024-09-13T18:45:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.342+0000 7f62ed084640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f62e809dfb0 0x7f62e8096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.342+0000 7f62ec883640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 0x7f62e80974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.342+0000 7f62ed084640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f62e809dfb0 0x7f62e8096f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60978/0 (socket says 172.21.15.97:60978) 2024-09-13T18:45:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.342+0000 7f62ed084640 1 -- 172.21.15.97:0/1986153472 learned_addr learned my addr 172.21.15.97:0/1986153472 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.342+0000 7f62ec883640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 0x7f62e80974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:57754/0 (socket says 172.21.15.97:57754) 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.342+0000 7f62ed885640 1 --1- 172.21.15.97:0/1986153472 >> v1:172.21.15.97:6789/0 conn(0x7f62e812bf70 0x7f62e812c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35458/0 (socket says 172.21.15.97:35458) 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.343+0000 7f62ed084640 1 -- 172.21.15.97:0/1986153472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 msgr2=0x7f62e80974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.343+0000 7f62ed084640 1 --2- 172.21.15.97:0/1986153472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 0x7f62e80974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.343+0000 7f62ed084640 1 -- 172.21.15.97:0/1986153472 >> v1:172.21.15.97:6789/0 conn(0x7f62e812bf70 legacy=0x7f62e812c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.343+0000 7f62dffff640 1 -- 172.21.15.97:0/1986153472 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892112014 0 0) 0x7f62e806a190 con 0x7f62e812bf70 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.343+0000 7f62ed084640 1 -- 172.21.15.97:0/1986153472 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e8098e10 con 0x7f62e809dfb0 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.343+0000 7f62ec883640 1 --2- 172.21.15.97:0/1986153472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 0x7f62e80974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.344+0000 7f62ed084640 1 --2- 172.21.15.97:0/1986153472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62e809dfb0 0x7f62e8096f80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f62e400ba00 tx=0x7f62e40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6801d1b4fed7f040 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.344+0000 7f62dffff640 1 -- 172.21.15.97:0/1986153472 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e402f510 con 0x7f62e809dfb0 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.344+0000 7f62dffff640 1 -- 172.21.15.97:0/1986153472 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f62e402d050 con 0x7f62e809dfb0 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.344+0000 7f62dffff640 1 -- 172.21.15.97:0/1986153472 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e402f8c0 con 0x7f62e809dfb0 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.344+0000 7f62ef2e8640 1 -- 172.21.15.97:0/1986153472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62e809dfb0 msgr2=0x7f62e8096f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.344+0000 7f62ef2e8640 1 --2- 172.21.15.97:0/1986153472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62e809dfb0 0x7f62e8096f80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f62e400ba00 tx=0x7f62e40090f0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.344+0000 7f62ef2e8640 1 -- 172.21.15.97:0/1986153472 shutdown_connections 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.344+0000 7f62ef2e8640 1 --2- 172.21.15.97:0/1986153472 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 0x7f62e80974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.344+0000 7f62ef2e8640 1 --2- 172.21.15.97:0/1986153472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62e809dfb0 0x7f62e8096f80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.344+0000 7f62ef2e8640 1 -- 172.21.15.97:0/1986153472 >> 172.21.15.97:0/1986153472 conn(0x7f62e809b200 msgr2=0x7f62e809b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.344+0000 7f62ef2e8640 1 -- 172.21.15.97:0/1986153472 shutdown_connections 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.344+0000 7f62ef2e8640 1 -- 172.21.15.97:0/1986153472 wait complete. 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.345+0000 7f62ef2e8640 1 Processor -- start 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.345+0000 7f62ef2e8640 1 -- start start 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ef2e8640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 0x7f62e8117a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ef2e8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62e809dfb0 0x7f62e8117f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ef2e8640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f62e812bf70 0x7f62e8118480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ef2e8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8119950 con 0x7f62e809dfb0 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ef2e8640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8097e10 con 0x7f62e80969d0 2024-09-13T18:45:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ef2e8640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62e811a820 con 0x7f62e812bf70 2024-09-13T18:45:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ed084640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 0x7f62e8117a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ec883640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62e809dfb0 0x7f62e8117f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ed885640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f62e812bf70 0x7f62e8118480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ed084640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 0x7f62e8117a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:57770/0 (socket says 172.21.15.97:57770) 2024-09-13T18:45:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ec883640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62e809dfb0 0x7f62e8117f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60994/0 (socket says 172.21.15.97:60994) 2024-09-13T18:45:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ed084640 1 -- 172.21.15.97:0/3400090857 learned_addr learned my addr 172.21.15.97:0/3400090857 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ed084640 1 -- 172.21.15.97:0/3400090857 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f62e812bf70 msgr2=0x7f62e8118480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ed084640 1 --2- 172.21.15.97:0/3400090857 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f62e812bf70 0x7f62e8118480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ed084640 1 -- 172.21.15.97:0/3400090857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62e809dfb0 msgr2=0x7f62e8117f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ed084640 1 --2- 172.21.15.97:0/3400090857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62e809dfb0 0x7f62e8117f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ed084640 1 -- 172.21.15.97:0/3400090857 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d800d830 con 0x7f62e80969d0 2024-09-13T18:45:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ed885640 1 --2- 172.21.15.97:0/3400090857 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f62e812bf70 0x7f62e8118480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62ed084640 1 --2- 172.21.15.97:0/3400090857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 0x7f62e8117a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f62e402ac90 tx=0x7f62e40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:11.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.346+0000 7f62dd7fa640 1 -- 172.21.15.97:0/3400090857 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4031ac0 con 0x7f62e80969d0 2024-09-13T18:45:11.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.347+0000 7f62dd7fa640 1 -- 172.21.15.97:0/3400090857 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f62e403f070 con 0x7f62e80969d0 2024-09-13T18:45:11.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.347+0000 7f62ef2e8640 1 -- 172.21.15.97:0/3400090857 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e400b510 con 0x7f62e80969d0 2024-09-13T18:45:11.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.347+0000 7f62dd7fa640 1 -- 172.21.15.97:0/3400090857 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4045430 con 0x7f62e80969d0 2024-09-13T18:45:11.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.347+0000 7f62ef2e8640 1 -- 172.21.15.97:0/3400090857 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e8118f20 con 0x7f62e80969d0 2024-09-13T18:45:11.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.347+0000 7f62dd7fa640 1 -- 172.21.15.97:0/3400090857 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f62e4045860 con 0x7f62e80969d0 2024-09-13T18:45:11.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.347+0000 7f62dd7fa640 1 -- 172.21.15.97:0/3400090857 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f62e4041070 con 0x7f62e80969d0 2024-09-13T18:45:11.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.348+0000 7f62ef2e8640 1 -- 172.21.15.97:0/3400090857 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e8064000 con 0x7f62e80969d0 2024-09-13T18:45:11.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.352+0000 7f62dd7fa640 1 -- 172.21.15.97:0/3400090857 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f62e404a020 con 0x7f62e80969d0 2024-09-13T18:45:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.536+0000 7f62ef2e8640 1 -- 172.21.15.97:0/3400090857 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62e8067670 con 0x7f62e80969d0 2024-09-13T18:45:11.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.536+0000 7f62dd7fa640 1 -- 172.21.15.97:0/3400090857 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2264 (secure 0 0 0) 0x7f62e4053070 con 0x7f62e80969d0 2024-09-13T18:45:11.539 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:45:11.539 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:13.885647+0000","modified":"2024-09-13T18:39:16.567097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4204},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4204":{"gid":4204,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6817/3890865357","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6817","nonce":3890865357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-09-13T18:45:11.539 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 5 2024-09-13T18:45:11.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.538+0000 7f62ef2e8640 1 -- 172.21.15.97:0/3400090857 >> v1:172.21.15.97:6816/34603 conn(0x7f62cc031160 legacy=0x7f62cc033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.538+0000 7f62ef2e8640 1 -- 172.21.15.97:0/3400090857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 msgr2=0x7f62e8117a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.538+0000 7f62ef2e8640 1 --2- 172.21.15.97:0/3400090857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 0x7f62e8117a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f62e402ac90 tx=0x7f62e40090f0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.538+0000 7f62ef2e8640 1 -- 172.21.15.97:0/3400090857 shutdown_connections 2024-09-13T18:45:11.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.538+0000 7f62ef2e8640 1 --2- 172.21.15.97:0/3400090857 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f62e812bf70 0x7f62e8118480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.538+0000 7f62ef2e8640 1 --2- 172.21.15.97:0/3400090857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62e809dfb0 0x7f62e8117f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.538+0000 7f62ef2e8640 1 --2- 172.21.15.97:0/3400090857 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f62e80969d0 0x7f62e8117a00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.538+0000 7f62ef2e8640 1 -- 172.21.15.97:0/3400090857 >> 172.21.15.97:0/3400090857 conn(0x7f62e809b200 msgr2=0x7f62e806a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:11.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.538+0000 7f62ef2e8640 1 -- 172.21.15.97:0/3400090857 shutdown_connections 2024-09-13T18:45:11.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.538+0000 7f62ef2e8640 1 -- 172.21.15.97:0/3400090857 wait complete. 2024-09-13T18:45:11.551 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:11.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.641+0000 7f3822cd4640 1 Processor -- start 2024-09-13T18:45:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.641+0000 7f3822cd4640 1 -- start start 2024-09-13T18:45:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f3822cd4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f381c0a32b0 0x7f381c12f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f3822cd4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f381c12fed0 0x7f381c068970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f3822cd4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381c0a3680 con 0x7f381c068eb0 2024-09-13T18:45:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f3822cd4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c097460 con 0x7f381c0a32b0 2024-09-13T18:45:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f3822cd4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c1302c0 con 0x7f381c12fed0 2024-09-13T18:45:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f381bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f381c12fed0 0x7f381c068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f3820a70640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f381c0a32b0 0x7f381c12f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f3820a70640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f381c0a32b0 0x7f381c12f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:32778/0 (socket says 172.21.15.97:32778) 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f381bfff640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f381c12fed0 0x7f381c068970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:57776/0 (socket says 172.21.15.97:57776) 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f3820a70640 1 -- 172.21.15.97:0/3052665372 learned_addr learned my addr 172.21.15.97:0/3052665372 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f3820a70640 1 -- 172.21.15.97:0/3052665372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f381c12fed0 msgr2=0x7f381c068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f3820a70640 1 --2- 172.21.15.97:0/3052665372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f381c12fed0 0x7f381c068970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f3820a70640 1 -- 172.21.15.97:0/3052665372 >> v1:172.21.15.97:6789/0 conn(0x7f381c068eb0 legacy=0x7f381c136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f3820a70640 1 -- 172.21.15.97:0/3052665372 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c12d770 con 0x7f381c0a32b0 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f381b7fe640 1 -- 172.21.15.97:0/3052665372 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491599414 0 0) 0x7f381c0a3680 con 0x7f381c068eb0 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.642+0000 7f381bfff640 1 --2- 172.21.15.97:0/3052665372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f381c12fed0 0x7f381c068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.643+0000 7f3820a70640 1 --2- 172.21.15.97:0/3052665372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c0a32b0 0x7f381c12f990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f380c009910 tx=0x7f380c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743ee446c9001102 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.643+0000 7f381b7fe640 1 -- 172.21.15.97:0/3052665372 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c02add0 con 0x7f381c0a32b0 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.643+0000 7f381b7fe640 1 -- 172.21.15.97:0/3052665372 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f380c032440 con 0x7f381c0a32b0 2024-09-13T18:45:11.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.643+0000 7f381b7fe640 1 -- 172.21.15.97:0/3052665372 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c032800 con 0x7f381c0a32b0 2024-09-13T18:45:11.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.644+0000 7f3822cd4640 1 -- 172.21.15.97:0/3052665372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c0a32b0 msgr2=0x7f381c12f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.644+0000 7f3822cd4640 1 --2- 172.21.15.97:0/3052665372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c0a32b0 0x7f381c12f990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f380c009910 tx=0x7f380c0091d0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.644+0000 7f3822cd4640 1 -- 172.21.15.97:0/3052665372 shutdown_connections 2024-09-13T18:45:11.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.644+0000 7f3822cd4640 1 --2- 172.21.15.97:0/3052665372 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f381c12fed0 0x7f381c068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.644+0000 7f3822cd4640 1 --2- 172.21.15.97:0/3052665372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c0a32b0 0x7f381c12f990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.644+0000 7f3822cd4640 1 -- 172.21.15.97:0/3052665372 >> 172.21.15.97:0/3052665372 conn(0x7f381c06eef0 msgr2=0x7f381c0a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:11.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.644+0000 7f3822cd4640 1 -- 172.21.15.97:0/3052665372 shutdown_connections 2024-09-13T18:45:11.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.644+0000 7f3822cd4640 1 -- 172.21.15.97:0/3052665372 wait complete. 2024-09-13T18:45:11.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.644+0000 7f3822cd4640 1 Processor -- start 2024-09-13T18:45:11.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3822cd4640 1 -- start start 2024-09-13T18:45:11.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3822cd4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c068eb0 0x7f381c13ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3822cd4640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f381c0a32b0 0x7f381c13f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3822cd4640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f381c12fed0 0x7f381c1190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3822cd4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c09e710 con 0x7f381c068eb0 2024-09-13T18:45:11.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3822cd4640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c11cad0 con 0x7f381c12fed0 2024-09-13T18:45:11.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3822cd4640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f381c11bc00 con 0x7f381c0a32b0 2024-09-13T18:45:11.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3820a70640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c068eb0 0x7f381c13ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3820a70640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c068eb0 0x7f381c13ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:32786/0 (socket says 172.21.15.97:32786) 2024-09-13T18:45:11.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3820a70640 1 -- 172.21.15.97:0/4279340728 learned_addr learned my addr 172.21.15.97:0/4279340728 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f381bfff640 1 --2- 172.21.15.97:0/4279340728 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f381c0a32b0 0x7f381c13f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3821271640 1 --2- 172.21.15.97:0/4279340728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f381c12fed0 0x7f381c1190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3820a70640 1 -- 172.21.15.97:0/4279340728 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f381c0a32b0 msgr2=0x7f381c13f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3820a70640 1 --2- 172.21.15.97:0/4279340728 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f381c0a32b0 0x7f381c13f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3820a70640 1 -- 172.21.15.97:0/4279340728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f381c12fed0 msgr2=0x7f381c1190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3820a70640 1 --2- 172.21.15.97:0/4279340728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f381c12fed0 0x7f381c1190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.645+0000 7f3820a70640 1 -- 172.21.15.97:0/4279340728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3810009390 con 0x7f381c068eb0 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.646+0000 7f3820a70640 1 --2- 172.21.15.97:0/4279340728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c068eb0 0x7f381c13ed30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f380c02a700 tx=0x7f380c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.646+0000 7f3818ff9640 1 -- 172.21.15.97:0/4279340728 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c030a00 con 0x7f381c068eb0 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.646+0000 7f3818ff9640 1 -- 172.21.15.97:0/4279340728 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f380c030b60 con 0x7f381c068eb0 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.646+0000 7f3818ff9640 1 -- 172.21.15.97:0/4279340728 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c03d420 con 0x7f381c068eb0 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.646+0000 7f3822cd4640 1 -- 172.21.15.97:0/4279340728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c009450 con 0x7f381c068eb0 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.646+0000 7f3822cd4640 1 -- 172.21.15.97:0/4279340728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c13e9f0 con 0x7f381c068eb0 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.647+0000 7f3818ff9640 1 -- 172.21.15.97:0/4279340728 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f380c039040 con 0x7f381c068eb0 2024-09-13T18:45:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.647+0000 7f3818ff9640 1 -- 172.21.15.97:0/4279340728 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f380c061d40 con 0x7f381c068eb0 2024-09-13T18:45:11.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.647+0000 7f3822cd4640 1 -- 172.21.15.97:0/4279340728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c11bf10 con 0x7f381c068eb0 2024-09-13T18:45:11.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.651+0000 7f3818ff9640 1 -- 172.21.15.97:0/4279340728 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f380c042020 con 0x7f381c068eb0 2024-09-13T18:45:11.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.802+0000 7f3822cd4640 1 -- 172.21.15.97:0/4279340728 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f381c064000 con 0x7f381c068eb0 2024-09-13T18:45:11.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.803+0000 7f3818ff9640 1 -- 172.21.15.97:0/4279340728 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+11626 (secure 0 0 0) 0x7f380c037070 con 0x7f381c068eb0 2024-09-13T18:45:11.805 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-13T18:45:11.806 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":23,"fsid":"26171290-0086-4a00-9403-ffac581535bf","created":"2024-09-13T18:38:50.163840+0000","modified":"2024-09-13T18:39:54.652125+0000","last_up_change":"2024-09-13T18:39:00.421488+0000","last_in_change":"2024-09-13T18:38:51.275686+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:39:01.375967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T18:39:05.732412+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:12.014248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:12.844264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e3c4b404-1f32-4298-97b5-8d4d3e2a29fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6812","nonce":35062}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6813","nonce":35062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6815","nonce":35062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6814","nonce":35062}]},"public_addr":"172.21.15.97:6812/35062","cluster_addr":"172.21.15.97:6813/35062","heartbeat_back_addr":"172.21.15.97:6815/35062","heartbeat_front_addr":"172.21.15.97:6814/35062","state":["exists","up"]},{"osd":1,"uuid":"1018877a-7ed4-40a1-bfbc-48dd46f7aeb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6808","nonce":35061}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6809","nonce":35061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6811","nonce":35061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6810","nonce":35061}]},"public_addr":"172.21.15.97:6808/35061","cluster_addr":"172.21.15.97:6809/35061","heartbeat_back_addr":"172.21.15.97:6811/35061","heartbeat_front_addr":"172.21.15.97:6810/35061","state":["exists","up"]},{"osd":2,"uuid":"482f64f7-168a-4b1c-a6d1-2eecbdc4d76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6804","nonce":35063}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6805","nonce":35063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6807","nonce":35063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6806","nonce":35063}]},"public_addr":"172.21.15.97:6804/35063","cluster_addr":"172.21.15.97:6805/35063","heartbeat_back_addr":"172.21.15.97:6807/35063","heartbeat_front_addr":"172.21.15.97:6806/35063","state":["exists","up"]},{"osd":3,"uuid":"8f56f301-77c9-400b-b5c3-aace648797a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6800","nonce":35060}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6801","nonce":35060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6803","nonce":35060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.97:6802","nonce":35060}]},"public_addr":"172.21.15.97:6800/35060","cluster_addr":"172.21.15.97:6801/35060","heartbeat_back_addr":"172.21.15.97:6803/35060","heartbeat_front_addr":"172.21.15.97:6802/35060","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.501534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.448815+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.462672+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:38:56.349351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.8","mappings":[{"from":1,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:11.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.805+0000 7f3822cd4640 1 -- 172.21.15.97:0/4279340728 >> v1:172.21.15.97:6816/34603 conn(0x7f3808031160 legacy=0x7f3808033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.805+0000 7f3822cd4640 1 -- 172.21.15.97:0/4279340728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c068eb0 msgr2=0x7f381c13ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.805+0000 7f3822cd4640 1 --2- 172.21.15.97:0/4279340728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c068eb0 0x7f381c13ed30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f380c02a700 tx=0x7f380c0091d0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.805+0000 7f3822cd4640 1 -- 172.21.15.97:0/4279340728 shutdown_connections 2024-09-13T18:45:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.805+0000 7f3822cd4640 1 --2- 172.21.15.97:0/4279340728 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f381c12fed0 0x7f381c1190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.805+0000 7f3822cd4640 1 --2- 172.21.15.97:0/4279340728 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f381c0a32b0 0x7f381c13f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.805+0000 7f3822cd4640 1 --2- 172.21.15.97:0/4279340728 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f381c068eb0 0x7f381c13ed30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.805+0000 7f3822cd4640 1 -- 172.21.15.97:0/4279340728 >> 172.21.15.97:0/4279340728 conn(0x7f381c06eef0 msgr2=0x7f381c132530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.805+0000 7f3822cd4640 1 -- 172.21.15.97:0/4279340728 shutdown_connections 2024-09-13T18:45:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.805+0000 7f3822cd4640 1 -- 172.21.15.97:0/4279340728 wait complete. 2024-09-13T18:45:11.818 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:45:11.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.909+0000 7f34716af640 1 Processor -- start 2024-09-13T18:45:11.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.909+0000 7f34716af640 1 -- start start 2024-09-13T18:45:11.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f34716af640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f346c0a32b0 0x7f346c12f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f34716af640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 0x7f346c137770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f34716af640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c096b70 con 0x7f346c12fed0 2024-09-13T18:45:11.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f34716af640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c1302f0 con 0x7f346c0a32b0 2024-09-13T18:45:11.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f34716af640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0a3680 con 0x7f346c069080 2024-09-13T18:45:11.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f346affd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f346c0a32b0 0x7f346c12f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f346b7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 0x7f346c137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f346b7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 0x7f346c137770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:60696/0 (socket says 172.21.15.97:60696) 2024-09-13T18:45:11.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f346a7fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f346c12fed0 0x7f346c068970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35470/0 (socket says 172.21.15.97:35470) 2024-09-13T18:45:11.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f346b7fe640 1 -- 172.21.15.97:0/2552230800 learned_addr learned my addr 172.21.15.97:0/2552230800 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:11.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f346affd640 1 -- 172.21.15.97:0/2552230800 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 msgr2=0x7f346c137770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:11.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f346affd640 1 --2- 172.21.15.97:0/2552230800 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 0x7f346c137770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f346affd640 1 -- 172.21.15.97:0/2552230800 >> v1:172.21.15.97:6789/0 conn(0x7f346c12fed0 legacy=0x7f346c068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f346affd640 1 -- 172.21.15.97:0/2552230800 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c097460 con 0x7f346c0a32b0 2024-09-13T18:45:11.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.910+0000 7f346b7fe640 1 --2- 172.21.15.97:0/2552230800 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 0x7f346c137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:11.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.911+0000 7f346affd640 1 --2- 172.21.15.97:0/2552230800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f346c0a32b0 0x7f346c12f990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f345c009e60 tx=0x7f345c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74579a1e7531e7e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:11.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.911+0000 7f3469ffb640 1 -- 172.21.15.97:0/2552230800 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c007550 con 0x7f346c0a32b0 2024-09-13T18:45:11.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.911+0000 7f3469ffb640 1 -- 172.21.15.97:0/2552230800 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f345c02d050 con 0x7f346c0a32b0 2024-09-13T18:45:11.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.911+0000 7f3469ffb640 1 -- 172.21.15.97:0/2552230800 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c007940 con 0x7f346c0a32b0 2024-09-13T18:45:11.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.911+0000 7f34716af640 1 -- 172.21.15.97:0/2552230800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f346c0a32b0 msgr2=0x7f346c12f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.911+0000 7f34716af640 1 --2- 172.21.15.97:0/2552230800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f346c0a32b0 0x7f346c12f990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f345c009e60 tx=0x7f345c009780 comp rx=0 tx=0).stop 2024-09-13T18:45:11.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.912+0000 7f34716af640 1 -- 172.21.15.97:0/2552230800 shutdown_connections 2024-09-13T18:45:11.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.912+0000 7f34716af640 1 --2- 172.21.15.97:0/2552230800 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 0x7f346c137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.912+0000 7f34716af640 1 --2- 172.21.15.97:0/2552230800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f346c0a32b0 0x7f346c12f990 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.912+0000 7f34716af640 1 -- 172.21.15.97:0/2552230800 >> 172.21.15.97:0/2552230800 conn(0x7f346c06eef0 msgr2=0x7f346c0a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:11.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.912+0000 7f34716af640 1 -- 172.21.15.97:0/2552230800 shutdown_connections 2024-09-13T18:45:11.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.912+0000 7f34716af640 1 -- 172.21.15.97:0/2552230800 wait complete. 2024-09-13T18:45:11.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.912+0000 7f34716af640 1 Processor -- start 2024-09-13T18:45:11.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f34716af640 1 -- start start 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f34716af640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 0x7f346c12c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f34716af640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f346c0a32b0 0x7f346c1190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f34716af640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f346c12fed0 0x7f346c1195f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f34716af640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c11a9e0 con 0x7f346c0a32b0 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f34716af640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c11b3b0 con 0x7f346c12fed0 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f34716af640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f346c11c0d0 con 0x7f346c069080 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f346affd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 0x7f346c12c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f346affd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 0x7f346c12c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:60708/0 (socket says 172.21.15.97:60708) 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f346affd640 1 -- 172.21.15.97:0/3614797900 learned_addr learned my addr 172.21.15.97:0/3614797900 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f346a7fc640 1 --2- 172.21.15.97:0/3614797900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f346c0a32b0 0x7f346c1190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f346b7fe640 1 --2- 172.21.15.97:0/3614797900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f346c12fed0 0x7f346c1195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f346affd640 1 -- 172.21.15.97:0/3614797900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f346c12fed0 msgr2=0x7f346c1195f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f346affd640 1 --2- 172.21.15.97:0/3614797900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f346c12fed0 0x7f346c1195f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f346affd640 1 -- 172.21.15.97:0/3614797900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f346c0a32b0 msgr2=0x7f346c1190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f346affd640 1 --2- 172.21.15.97:0/3614797900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f346c0a32b0 0x7f346c1190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f346affd640 1 -- 172.21.15.97:0/3614797900 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464009450 con 0x7f346c069080 2024-09-13T18:45:11.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f346a7fc640 1 --2- 172.21.15.97:0/3614797900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f346c0a32b0 0x7f346c1190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:11.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.913+0000 7f346affd640 1 --2- 172.21.15.97:0/3614797900 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 0x7f346c12c9b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f345c02ab30 tx=0x7f345c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:11.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.914+0000 7f3462ffd640 1 -- 172.21.15.97:0/3614797900 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c031750 con 0x7f346c069080 2024-09-13T18:45:11.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.914+0000 7f3462ffd640 1 -- 172.21.15.97:0/3614797900 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f345c040070 con 0x7f346c069080 2024-09-13T18:45:11.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.914+0000 7f34716af640 1 -- 172.21.15.97:0/3614797900 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345c009a20 con 0x7f346c069080 2024-09-13T18:45:11.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.914+0000 7f3462ffd640 1 -- 172.21.15.97:0/3614797900 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c031b20 con 0x7f346c069080 2024-09-13T18:45:11.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.914+0000 7f34716af640 1 -- 172.21.15.97:0/3614797900 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c11a4a0 con 0x7f346c069080 2024-09-13T18:45:11.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.915+0000 7f3462ffd640 1 -- 172.21.15.97:0/3614797900 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f345c042030 con 0x7f346c069080 2024-09-13T18:45:11.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.915+0000 7f3462ffd640 1 -- 172.21.15.97:0/3614797900 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3863+0+0 (secure 0 0 0) 0x7f345c063860 con 0x7f346c069080 2024-09-13T18:45:11.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.915+0000 7f34716af640 1 -- 172.21.15.97:0/3614797900 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346c064000 con 0x7f346c069080 2024-09-13T18:45:11.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:11.919+0000 7f3462ffd640 1 -- 172.21.15.97:0/3614797900 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f345c03b5e0 con 0x7f346c069080 2024-09-13T18:45:12.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.104+0000 7f34716af640 1 -- 172.21.15.97:0/3614797900 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f346c11bd50 con 0x7f346c069080 2024-09-13T18:45:12.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.119+0000 7f3462ffd640 1 -- 172.21.15.97:0/3614797900 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v6) v1 ==== 161+0+0 (secure 0 0 0) 0x7f345c0443d0 con 0x7f346c069080 2024-09-13T18:45:12.121 INFO:teuthology.orchestra.run.smithi097.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:45:12.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.122+0000 7f34716af640 1 -- 172.21.15.97:0/3614797900 >> v1:172.21.15.97:6816/34603 conn(0x7f344c031160 legacy=0x7f344c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:12.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.122+0000 7f34716af640 1 -- 172.21.15.97:0/3614797900 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 msgr2=0x7f346c12c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:12.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.122+0000 7f34716af640 1 --2- 172.21.15.97:0/3614797900 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 0x7f346c12c9b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f345c02ab30 tx=0x7f345c009780 comp rx=0 tx=0).stop 2024-09-13T18:45:12.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.122+0000 7f34716af640 1 -- 172.21.15.97:0/3614797900 shutdown_connections 2024-09-13T18:45:12.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.122+0000 7f34716af640 1 --2- 172.21.15.97:0/3614797900 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f346c12fed0 0x7f346c1195f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.122+0000 7f34716af640 1 --2- 172.21.15.97:0/3614797900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f346c0a32b0 0x7f346c1190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.122+0000 7f34716af640 1 --2- 172.21.15.97:0/3614797900 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f346c069080 0x7f346c12c9b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.122+0000 7f34716af640 1 -- 172.21.15.97:0/3614797900 >> 172.21.15.97:0/3614797900 conn(0x7f346c06eef0 msgr2=0x7f346c0a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:12.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.122+0000 7f34716af640 1 -- 172.21.15.97:0/3614797900 shutdown_connections 2024-09-13T18:45:12.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.122+0000 7f34716af640 1 -- 172.21.15.97:0/3614797900 wait complete. 2024-09-13T18:45:12.135 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:45:12.149 INFO:tasks.ceph.mds.a.smithi097.stdout:starting mds.a at 2024-09-13T18:45:12.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.227+0000 7fc6c5b5d640 1 Processor -- start 2024-09-13T18:45:12.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.227+0000 7fc6c5b5d640 1 -- start start 2024-09-13T18:45:12.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6c5b5d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c00688c0 0x7fc6c009d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:12.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6c5b5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6c009d2c0 0x7fc6c009dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:12.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6c5b5d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c00975a0 con 0x7fc6c012f410 2024-09-13T18:45:12.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6c5b5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0068c90 con 0x7fc6c009d2c0 2024-09-13T18:45:12.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6c5b5d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c009ceb0 con 0x7fc6c00688c0 2024-09-13T18:45:12.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6bf7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c00688c0 0x7fc6c009d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:12.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6beffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6c009d2c0 0x7fc6c009dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:12.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6bffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc6c012f410 0x7fc6c012f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35478/0 (socket says 172.21.15.97:35478) 2024-09-13T18:45:12.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6bf7fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c00688c0 0x7fc6c009d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:60720/0 (socket says 172.21.15.97:60720) 2024-09-13T18:45:12.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6bffff640 1 -- 172.21.15.97:0/3406647510 learned_addr learned my addr 172.21.15.97:0/3406647510 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:45:12.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6be7fc640 1 -- 172.21.15.97:0/3406647510 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342361137 0 0) 0x7fc6c00975a0 con 0x7fc6c012f410 2024-09-13T18:45:12.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6bf7fe640 1 -- 172.21.15.97:0/3406647510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6c009d2c0 msgr2=0x7fc6c009dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:12.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6bf7fe640 1 --2- 172.21.15.97:0/3406647510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6c009d2c0 0x7fc6c009dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6bf7fe640 1 -- 172.21.15.97:0/3406647510 >> v1:172.21.15.97:6789/0 conn(0x7fc6c012f410 legacy=0x7fc6c012f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:12.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6bf7fe640 1 -- 172.21.15.97:0/3406647510 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0069200 con 0x7fc6c00688c0 2024-09-13T18:45:12.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.228+0000 7fc6beffd640 1 --2- 172.21.15.97:0/3406647510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6c009d2c0 0x7fc6c009dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:12.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.229+0000 7fc6bf7fe640 1 --2- 172.21.15.97:0/3406647510 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c00688c0 0x7fc6c009d7c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00098b0 tx=0x7fc6b00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12ca3b856aeada04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:12.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.229+0000 7fc6be7fc640 1 -- 172.21.15.97:0/3406647510 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b002ac40 con 0x7fc6c00688c0 2024-09-13T18:45:12.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.229+0000 7fc6be7fc640 1 -- 172.21.15.97:0/3406647510 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc6b002ada0 con 0x7fc6c00688c0 2024-09-13T18:45:12.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.229+0000 7fc6be7fc640 1 -- 172.21.15.97:0/3406647510 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0032690 con 0x7fc6c00688c0 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.230+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/3406647510 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c00688c0 msgr2=0x7fc6c009d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.230+0000 7fc6c5b5d640 1 --2- 172.21.15.97:0/3406647510 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c00688c0 0x7fc6c009d7c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00098b0 tx=0x7fc6b00090f0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.230+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/3406647510 shutdown_connections 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.230+0000 7fc6c5b5d640 1 --2- 172.21.15.97:0/3406647510 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6c009d2c0 0x7fc6c009dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.230+0000 7fc6c5b5d640 1 --2- 172.21.15.97:0/3406647510 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c00688c0 0x7fc6c009d7c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.230+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/3406647510 >> 172.21.15.97:0/3406647510 conn(0x7fc6c006f310 msgr2=0x7fc6c00a29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.230+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/3406647510 shutdown_connections 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.230+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/3406647510 wait complete. 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6c5b5d640 1 Processor -- start 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6c5b5d640 1 -- start start 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6c5b5d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6c00688c0 0x7fc6c011aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6c5b5d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6c009d2c0 0x7fc6c011b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6c5b5d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c012f410 0x7fc6c013e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:12.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6c5b5d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c009e8a0 con 0x7fc6c009d2c0 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6c5b5d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c011db30 con 0x7fc6c00688c0 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6c5b5d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c011ddf0 con 0x7fc6c012f410 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6beffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6c009d2c0 0x7fc6c011b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6bffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c012f410 0x7fc6c013e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6beffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6c009d2c0 0x7fc6c011b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:32820/0 (socket says 172.21.15.97:32820) 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6bf7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6c00688c0 0x7fc6c011aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6beffd640 1 -- 172.21.15.97:0/2285734019 learned_addr learned my addr 172.21.15.97:0/2285734019 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.231+0000 7fc6bffff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c012f410 0x7fc6c013e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:60724/0 (socket says 172.21.15.97:60724) 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.232+0000 7fc6bf7fe640 1 -- 172.21.15.97:0/2285734019 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c012f410 msgr2=0x7fc6c013e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.232+0000 7fc6bf7fe640 1 --2- 172.21.15.97:0/2285734019 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c012f410 0x7fc6c013e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.232+0000 7fc6bf7fe640 1 -- 172.21.15.97:0/2285734019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6c009d2c0 msgr2=0x7fc6c011b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.232+0000 7fc6bf7fe640 1 --2- 172.21.15.97:0/2285734019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6c009d2c0 0x7fc6c011b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.232+0000 7fc6bf7fe640 1 -- 172.21.15.97:0/2285734019 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b4009390 con 0x7fc6c00688c0 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.232+0000 7fc6bffff640 1 --2- 172.21.15.97:0/2285734019 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c012f410 0x7fc6c013e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:12.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.232+0000 7fc6bf7fe640 1 --2- 172.21.15.97:0/2285734019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6c00688c0 0x7fc6c011aed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0031000 tx=0x7fc6b00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:12.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.232+0000 7fc6a77fe640 1 -- 172.21.15.97:0/2285734019 <== mon.1 v2:172.21.15.97:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b003c610 con 0x7fc6c00688c0 2024-09-13T18:45:12.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.232+0000 7fc6a77fe640 1 -- 172.21.15.97:0/2285734019 <== mon.1 v2:172.21.15.97:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc6b003c790 con 0x7fc6c00688c0 2024-09-13T18:45:12.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.232+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/2285734019 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b0009390 con 0x7fc6c00688c0 2024-09-13T18:45:12.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.232+0000 7fc6a77fe640 1 -- 172.21.15.97:0/2285734019 <== mon.1 v2:172.21.15.97:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b003cbb0 con 0x7fc6c00688c0 2024-09-13T18:45:12.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.232+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/2285734019 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c011b950 con 0x7fc6c00688c0 2024-09-13T18:45:12.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.233+0000 7fc6a77fe640 1 -- 172.21.15.97:0/2285734019 <== mon.1 v2:172.21.15.97:3301/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fc6b00443f0 con 0x7fc6c00688c0 2024-09-13T18:45:12.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.233+0000 7fc6a77fe640 1 -- 172.21.15.97:0/2285734019 <== mon.1 v2:172.21.15.97:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3906+0+0 (secure 0 0 0) 0x7fc6b0062a90 con 0x7fc6c00688c0 2024-09-13T18:45:12.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.233+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/2285734019 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c00714b0 con 0x7fc6c00688c0 2024-09-13T18:45:12.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.237+0000 7fc6a77fe640 1 -- 172.21.15.97:0/2285734019 <== mon.1 v2:172.21.15.97:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fc6b0037020 con 0x7fc6c00688c0 2024-09-13T18:45:12.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:12.419+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/2285734019 --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc6c005e0d0 con 0x7fc6c00688c0 2024-09-13T18:45:13.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.114+0000 7fc6a77fe640 1 -- 172.21.15.97:0/2285734019 <== mon.1 v2:172.21.15.97:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc6b0049070 con 0x7fc6c00688c0 2024-09-13T18:45:13.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.116+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/2285734019 >> v1:172.21.15.97:6816/34603 conn(0x7fc6ac031160 legacy=0x7fc6ac033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:13.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.117+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/2285734019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6c00688c0 msgr2=0x7fc6c011aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:13.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.117+0000 7fc6c5b5d640 1 --2- 172.21.15.97:0/2285734019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6c00688c0 0x7fc6c011aed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0031000 tx=0x7fc6b00090f0 comp rx=0 tx=0).stop 2024-09-13T18:45:13.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.117+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/2285734019 shutdown_connections 2024-09-13T18:45:13.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.117+0000 7fc6c5b5d640 1 --2- 172.21.15.97:0/2285734019 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc6c012f410 0x7fc6c013e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:13.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.117+0000 7fc6c5b5d640 1 --2- 172.21.15.97:0/2285734019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6c009d2c0 0x7fc6c011b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:13.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.117+0000 7fc6c5b5d640 1 --2- 172.21.15.97:0/2285734019 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc6c00688c0 0x7fc6c011aed0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:13.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.117+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/2285734019 >> 172.21.15.97:0/2285734019 conn(0x7fc6c006f310 msgr2=0x7fc6c01324a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:13.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.117+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/2285734019 shutdown_connections 2024-09-13T18:45:13.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.117+0000 7fc6c5b5d640 1 -- 172.21.15.97:0/2285734019 wait complete. 2024-09-13T18:45:13.132 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:45:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.273+0000 7f6ce955d640 1 Processor -- start 2024-09-13T18:45:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.273+0000 7f6ce955d640 1 -- start start 2024-09-13T18:45:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.273+0000 7f6ce955d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6ce412fbc0 0x7f6ce41346f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.273+0000 7f6ce955d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6ce412ffc0 0x7f6ce4136c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.273+0000 7f6ce955d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce4068d60 con 0x7f6ce40a1250 2024-09-13T18:45:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.273+0000 7f6ce955d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce40a1620 con 0x7f6ce412fbc0 2024-09-13T18:45:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.273+0000 7f6ce955d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4069000 con 0x7f6ce412ffc0 2024-09-13T18:45:13.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.273+0000 7f6ce27fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6ce412fbc0 0x7f6ce41346f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:13.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.273+0000 7f6ce37fe640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6ce412ffc0 0x7f6ce4136c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:13.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.273+0000 7f6ce2ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6ce40a1250 0x7f6ce412f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35494/0 (socket says 172.21.15.97:35494) 2024-09-13T18:45:13.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.273+0000 7f6ce2ffd640 1 -- 172.21.15.97:0/2969404342 learned_addr learned my addr 172.21.15.97:0/2969404342 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:45:13.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.274+0000 7f6ce27fc640 1 -- 172.21.15.97:0/2969404342 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6ce412ffc0 msgr2=0x7f6ce4136c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:13.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.274+0000 7f6ce27fc640 1 --2- 172.21.15.97:0/2969404342 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6ce412ffc0 0x7f6ce4136c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:13.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.274+0000 7f6ce27fc640 1 -- 172.21.15.97:0/2969404342 >> v1:172.21.15.97:6789/0 conn(0x7f6ce40a1250 legacy=0x7f6ce412f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:13.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.274+0000 7f6ce27fc640 1 -- 172.21.15.97:0/2969404342 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce4068220 con 0x7f6ce412fbc0 2024-09-13T18:45:13.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.274+0000 7f6ce1ffb640 1 -- 172.21.15.97:0/2969404342 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330249870 0 0) 0x7f6ce4068d60 con 0x7f6ce40a1250 2024-09-13T18:45:13.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.274+0000 7f6ce37fe640 1 --2- 172.21.15.97:0/2969404342 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6ce412ffc0 0x7f6ce4136c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:13.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.274+0000 7f6ce27fc640 1 --2- 172.21.15.97:0/2969404342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ce412fbc0 0x7f6ce41346f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009880 tx=0x7f6ccc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20932701b77fafa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:13.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.274+0000 7f6ce1ffb640 1 -- 172.21.15.97:0/2969404342 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc02ac50 con 0x7f6ce412fbc0 2024-09-13T18:45:13.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.274+0000 7f6ce1ffb640 1 -- 172.21.15.97:0/2969404342 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6ccc02adb0 con 0x7f6ce412fbc0 2024-09-13T18:45:13.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.274+0000 7f6ce1ffb640 1 -- 172.21.15.97:0/2969404342 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc032690 con 0x7f6ce412fbc0 2024-09-13T18:45:13.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.275+0000 7f6ce955d640 1 -- 172.21.15.97:0/2969404342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ce412fbc0 msgr2=0x7f6ce41346f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:13.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.275+0000 7f6ce955d640 1 --2- 172.21.15.97:0/2969404342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ce412fbc0 0x7f6ce41346f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009880 tx=0x7f6ccc0090f0 comp rx=0 tx=0).stop 2024-09-13T18:45:13.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.275+0000 7f6ce955d640 1 -- 172.21.15.97:0/2969404342 shutdown_connections 2024-09-13T18:45:13.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.275+0000 7f6ce955d640 1 --2- 172.21.15.97:0/2969404342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ce412fbc0 0x7f6ce41346f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:13.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.275+0000 7f6ce955d640 1 --2- 172.21.15.97:0/2969404342 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6ce412ffc0 0x7f6ce4136c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:13.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.275+0000 7f6ce955d640 1 -- 172.21.15.97:0/2969404342 >> 172.21.15.97:0/2969404342 conn(0x7f6ce4067b30 msgr2=0x7f6ce40a0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:13.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.275+0000 7f6ce955d640 1 -- 172.21.15.97:0/2969404342 shutdown_connections 2024-09-13T18:45:13.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.275+0000 7f6ce955d640 1 -- 172.21.15.97:0/2969404342 wait complete. 2024-09-13T18:45:13.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.276+0000 7f6ce955d640 1 Processor -- start 2024-09-13T18:45:13.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.276+0000 7f6ce955d640 1 -- start start 2024-09-13T18:45:13.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.276+0000 7f6ce955d640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ce40a1250 0x7f6ce4116fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:13.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.276+0000 7f6ce955d640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6ce412fbc0 0x7f6ce41174e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.276+0000 7f6ce955d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ce412ffc0 0x7f6ce4117a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.276+0000 7f6ce955d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4118d70 con 0x7f6ce412ffc0 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.276+0000 7f6ce955d640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce41197b0 con 0x7f6ce40a1250 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.276+0000 7f6ce955d640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4118830 con 0x7f6ce412fbc0 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.276+0000 7f6ce27fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6ce412fbc0 0x7f6ce41174e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6ce2ffd640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ce40a1250 0x7f6ce4116fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6ce37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ce412ffc0 0x7f6ce4117a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6ce27fc640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6ce412fbc0 0x7f6ce41174e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3302/0 says I am v2:172.21.15.97:60742/0 (socket says 172.21.15.97:60742) 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6ce27fc640 1 -- 172.21.15.97:0/400721558 learned_addr learned my addr 172.21.15.97:0/400721558 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6ce27fc640 1 -- 172.21.15.97:0/400721558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ce40a1250 msgr2=0x7f6ce4116fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6ce27fc640 1 --2- 172.21.15.97:0/400721558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ce40a1250 0x7f6ce4116fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6ce27fc640 1 -- 172.21.15.97:0/400721558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ce412ffc0 msgr2=0x7f6ce4117a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6ce27fc640 1 --2- 172.21.15.97:0/400721558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ce412ffc0 0x7f6ce4117a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:13.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6ce27fc640 1 -- 172.21.15.97:0/400721558 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc009a20 con 0x7f6ce412fbc0 2024-09-13T18:45:13.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6ce27fc640 1 --2- 172.21.15.97:0/400721558 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6ce412fbc0 0x7f6ce41174e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc02a5c0 tx=0x7f6ccc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:13.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6cdaffd640 1 -- 172.21.15.97:0/400721558 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc03d650 con 0x7f6ce412fbc0 2024-09-13T18:45:13.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6cdaffd640 1 -- 172.21.15.97:0/400721558 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6ccc03d7b0 con 0x7f6ce412fbc0 2024-09-13T18:45:13.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6ce955d640 1 -- 172.21.15.97:0/400721558 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc009390 con 0x7f6ce412fbc0 2024-09-13T18:45:13.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6cdaffd640 1 -- 172.21.15.97:0/400721558 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc03db90 con 0x7f6ce412fbc0 2024-09-13T18:45:13.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.277+0000 7f6ce955d640 1 -- 172.21.15.97:0/400721558 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce4118fb0 con 0x7f6ce412fbc0 2024-09-13T18:45:13.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.278+0000 7f6cdaffd640 1 -- 172.21.15.97:0/400721558 <== mon.2 v2:172.21.15.97:3302/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7f6ccc039040 con 0x7f6ce412fbc0 2024-09-13T18:45:13.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.278+0000 7f6cdaffd640 1 -- 172.21.15.97:0/400721558 <== mon.2 v2:172.21.15.97:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3906+0+0 (secure 0 0 0) 0x7f6ccc061c80 con 0x7f6ce412fbc0 2024-09-13T18:45:13.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.278+0000 7f6ce955d640 1 -- 172.21.15.97:0/400721558 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce4064000 con 0x7f6ce412fbc0 2024-09-13T18:45:13.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.282+0000 7f6cdaffd640 1 -- 172.21.15.97:0/400721558 <== mon.2 v2:172.21.15.97:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7f6ccc03b3f0 con 0x7f6ce412fbc0 2024-09-13T18:45:13.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:13.435+0000 7f6ce955d640 1 -- 172.21.15.97:0/400721558 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ce405e0f0 con 0x7f6ce412fbc0 2024-09-13T18:45:14.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.128+0000 7f6cdaffd640 1 -- 172.21.15.97:0/400721558 <== mon.2 v2:172.21.15.97:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6ccc042070 con 0x7f6ce412fbc0 2024-09-13T18:45:14.131 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:45:14.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.132+0000 7f6ce955d640 1 -- 172.21.15.97:0/400721558 >> v1:172.21.15.97:6816/34603 conn(0x7f6cc4031160 legacy=0x7f6cc4033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:14.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.132+0000 7f6ce955d640 1 -- 172.21.15.97:0/400721558 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6ce412fbc0 msgr2=0x7f6ce41174e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:14.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.132+0000 7f6ce955d640 1 --2- 172.21.15.97:0/400721558 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6ce412fbc0 0x7f6ce41174e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc02a5c0 tx=0x7f6ccc0090f0 comp rx=0 tx=0).stop 2024-09-13T18:45:14.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.132+0000 7f6ce955d640 1 -- 172.21.15.97:0/400721558 shutdown_connections 2024-09-13T18:45:14.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.132+0000 7f6ce955d640 1 --2- 172.21.15.97:0/400721558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ce412ffc0 0x7f6ce4117a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:14.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.132+0000 7f6ce955d640 1 --2- 172.21.15.97:0/400721558 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7f6ce412fbc0 0x7f6ce41174e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:14.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.132+0000 7f6ce955d640 1 --2- 172.21.15.97:0/400721558 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f6ce40a1250 0x7f6ce4116fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:14.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.132+0000 7f6ce955d640 1 -- 172.21.15.97:0/400721558 >> 172.21.15.97:0/400721558 conn(0x7f6ce4067b30 msgr2=0x7f6ce406e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:14.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.132+0000 7f6ce955d640 1 -- 172.21.15.97:0/400721558 shutdown_connections 2024-09-13T18:45:14.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.133+0000 7f6ce955d640 1 -- 172.21.15.97:0/400721558 wait complete. 2024-09-13T18:45:14.150 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:45:14.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.243+0000 7fc4b5d09640 1 Processor -- start 2024-09-13T18:45:14.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4b5d09640 1 -- start start 2024-09-13T18:45:14.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4b5d09640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4b0097020 0x7fc4b0068e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:14.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4b5d09640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc4b00693b0 0x7fc4b0069780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:14.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4b5d09640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b00973f0 con 0x7fc4b012f490 2024-09-13T18:45:14.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4b5d09640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b009dc30 con 0x7fc4b0097020 2024-09-13T18:45:14.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4b5d09640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b009e5e0 con 0x7fc4b00693b0 2024-09-13T18:45:14.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4aeffd640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc4b00693b0 0x7fc4b0069780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:14.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4af7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4b0097020 0x7fc4b0068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:14.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4affff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc4b012f490 0x7fc4b012f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35500/0 (socket says 172.21.15.97:35500) 2024-09-13T18:45:14.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4affff640 1 -- 172.21.15.97:0/1162911854 learned_addr learned my addr 172.21.15.97:0/1162911854 (peer_addr_for_me v1:172.21.15.97:0/0) 2024-09-13T18:45:14.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4ae7fc640 1 -- 172.21.15.97:0/1162911854 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613919119 0 0) 0x7fc4b00973f0 con 0x7fc4b012f490 2024-09-13T18:45:14.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4aeffd640 1 -- 172.21.15.97:0/1162911854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4b0097020 msgr2=0x7fc4b0068e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:14.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4aeffd640 1 --2- 172.21.15.97:0/1162911854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4b0097020 0x7fc4b0068e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:14.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4aeffd640 1 -- 172.21.15.97:0/1162911854 >> v1:172.21.15.97:6789/0 conn(0x7fc4b012f490 legacy=0x7fc4b012f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:14.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4aeffd640 1 -- 172.21.15.97:0/1162911854 --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b009f320 con 0x7fc4b00693b0 2024-09-13T18:45:14.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.244+0000 7fc4af7fe640 1 --2- 172.21.15.97:0/1162911854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4b0097020 0x7fc4b0068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.245+0000 7fc4aeffd640 1 --2- 172.21.15.97:0/1162911854 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc4b00693b0 0x7fc4b0069780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009880 tx=0x7fc4a40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a56eb6c1f988d0f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.245+0000 7fc4ae7fc640 1 -- 172.21.15.97:0/1162911854 <== mon.2 v2:172.21.15.97:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a402ac50 con 0x7fc4b00693b0 2024-09-13T18:45:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.245+0000 7fc4ae7fc640 1 -- 172.21.15.97:0/1162911854 <== mon.2 v2:172.21.15.97:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc4a402adb0 con 0x7fc4b00693b0 2024-09-13T18:45:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.245+0000 7fc4ae7fc640 1 -- 172.21.15.97:0/1162911854 <== mon.2 v2:172.21.15.97:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4032690 con 0x7fc4b00693b0 2024-09-13T18:45:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.246+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1162911854 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc4b00693b0 msgr2=0x7fc4b0069780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.246+0000 7fc4b5d09640 1 --2- 172.21.15.97:0/1162911854 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc4b00693b0 0x7fc4b0069780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009880 tx=0x7fc4a40090f0 comp rx=0 tx=0).stop 2024-09-13T18:45:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.246+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1162911854 shutdown_connections 2024-09-13T18:45:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.246+0000 7fc4b5d09640 1 --2- 172.21.15.97:0/1162911854 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc4b00693b0 0x7fc4b0069780 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.246+0000 7fc4b5d09640 1 --2- 172.21.15.97:0/1162911854 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4b0097020 0x7fc4b0068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.246+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1162911854 >> 172.21.15.97:0/1162911854 conn(0x7fc4b006f2e0 msgr2=0x7fc4b00a2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.246+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1162911854 shutdown_connections 2024-09-13T18:45:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.246+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1162911854 wait complete. 2024-09-13T18:45:14.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.247+0000 7fc4b5d09640 1 Processor -- start 2024-09-13T18:45:14.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.247+0000 7fc4b5d09640 1 -- start start 2024-09-13T18:45:14.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.247+0000 7fc4b5d09640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4b00693b0 0x7fc4b011e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:14.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.247+0000 7fc4b5d09640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4b0097020 0x7fc4b011ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:14.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.247+0000 7fc4b5d09640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc4b012f490 0x7fc4b011b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:14.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.247+0000 7fc4b5d09640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b011db50 con 0x7fc4b0097020 2024-09-13T18:45:14.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.247+0000 7fc4b5d09640 1 -- --> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b009ffb0 con 0x7fc4b00693b0 2024-09-13T18:45:14.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.247+0000 7fc4b5d09640 1 -- --> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b011c9d0 con 0x7fc4b012f490 2024-09-13T18:45:14.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.247+0000 7fc4af7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4b00693b0 0x7fc4b011e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:14.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.247+0000 7fc4aeffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4b0097020 0x7fc4b011ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:14.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.247+0000 7fc4affff640 1 --2- >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc4b012f490 0x7fc4b011b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:14.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.247+0000 7fc4af7fe640 1 --2- >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4b00693b0 0x7fc4b011e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3301/0 says I am v2:172.21.15.97:57862/0 (socket says 172.21.15.97:57862) 2024-09-13T18:45:14.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.247+0000 7fc4af7fe640 1 -- 172.21.15.97:0/1797134978 learned_addr learned my addr 172.21.15.97:0/1797134978 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.248+0000 7fc4aeffd640 1 -- 172.21.15.97:0/1797134978 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc4b012f490 msgr2=0x7fc4b011b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.248+0000 7fc4aeffd640 1 --2- 172.21.15.97:0/1797134978 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc4b012f490 0x7fc4b011b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.248+0000 7fc4aeffd640 1 -- 172.21.15.97:0/1797134978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4b00693b0 msgr2=0x7fc4b011e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.248+0000 7fc4aeffd640 1 --2- 172.21.15.97:0/1797134978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4b00693b0 0x7fc4b011e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.248+0000 7fc4aeffd640 1 -- 172.21.15.97:0/1797134978 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a0009390 con 0x7fc4b0097020 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.248+0000 7fc4af7fe640 1 --2- 172.21.15.97:0/1797134978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4b00693b0 0x7fc4b011e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.248+0000 7fc4affff640 1 --2- 172.21.15.97:0/1797134978 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc4b012f490 0x7fc4b011b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.248+0000 7fc4aeffd640 1 --2- 172.21.15.97:0/1797134978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4b0097020 0x7fc4b011ae70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0096db0 tx=0x7fc4a40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.248+0000 7fc4977fe640 1 -- 172.21.15.97:0/1797134978 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a403d650 con 0x7fc4b0097020 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.248+0000 7fc4977fe640 1 -- 172.21.15.97:0/1797134978 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc4a403d7d0 con 0x7fc4b0097020 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.248+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1797134978 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a4009390 con 0x7fc4b0097020 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.248+0000 7fc4977fe640 1 -- 172.21.15.97:0/1797134978 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a403dbb0 con 0x7fc4b0097020 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.248+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1797134978 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b011b8f0 con 0x7fc4b0097020 2024-09-13T18:45:14.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.249+0000 7fc4977fe640 1 -- 172.21.15.97:0/1797134978 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 36646+0+0 (secure 0 0 0) 0x7fc4a4039040 con 0x7fc4b0097020 2024-09-13T18:45:14.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.249+0000 7fc4977fe640 1 -- 172.21.15.97:0/1797134978 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3468+0+0 (secure 0 0 0) 0x7fc4a40619e0 con 0x7fc4b0097020 2024-09-13T18:45:14.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.249+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1797134978 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b011dd70 con 0x7fc4b0097020 2024-09-13T18:45:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.253+0000 7fc4977fe640 1 -- 172.21.15.97:0/1797134978 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170909 (secure 0 0 0) 0x7fc4a4037080 con 0x7fc4b0097020 2024-09-13T18:45:14.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:14.407+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1797134978 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc4b011bba0 con 0x7fc4b0097020 2024-09-13T18:45:15.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:15.130+0000 7fc4977fe640 1 -- 172.21.15.97:0/1797134978 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc4a4042070 con 0x7fc4b0097020 2024-09-13T18:45:15.135 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' removed 2024-09-13T18:45:15.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:15.138+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1797134978 >> v1:172.21.15.97:6816/34603 conn(0x7fc49c031160 legacy=0x7fc49c033610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:15.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:15.138+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1797134978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4b0097020 msgr2=0x7fc4b011ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:15.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:15.138+0000 7fc4b5d09640 1 --2- 172.21.15.97:0/1797134978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4b0097020 0x7fc4b011ae70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0096db0 tx=0x7fc4a40090f0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:15.138+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1797134978 shutdown_connections 2024-09-13T18:45:15.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:15.138+0000 7fc4b5d09640 1 --2- 172.21.15.97:0/1797134978 >> [v2:172.21.15.97:3302/0,v1:172.21.15.97:6791/0] conn(0x7fc4b012f490 0x7fc4b011b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:15.138+0000 7fc4b5d09640 1 --2- 172.21.15.97:0/1797134978 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4b0097020 0x7fc4b011ae70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:15.138+0000 7fc4b5d09640 1 --2- 172.21.15.97:0/1797134978 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7fc4b00693b0 0x7fc4b011e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:15.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:15.138+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1797134978 >> 172.21.15.97:0/1797134978 conn(0x7fc4b006f2e0 msgr2=0x7fc4b0132520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:15.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:15.144+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1797134978 shutdown_connections 2024-09-13T18:45:15.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-13T18:45:15.144+0000 7fc4b5d09640 1 -- 172.21.15.97:0/1797134978 wait complete. 2024-09-13T18:45:15.168 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T18:45:15.168 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:45:15.168 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:15.179 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:45:15.179 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T18:45:15.180 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T18:45:15.180 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:15.251 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T18:45:15.252 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T18:45:15.252 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:15.328 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T18:45:15.328 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T18:45:15.328 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:15.403 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T18:45:15.403 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T18:45:15.403 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:15.476 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T18:45:15.476 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T18:45:15.476 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T18:45:15.476 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:15.540 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T18:45:15.541 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T18:45:15.541 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T18:45:15.541 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:15.591 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T18:45:15.591 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T18:45:15.591 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:15.642 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T18:45:15.642 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T18:45:15.642 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:15.693 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T18:45:15.693 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T18:45:15.693 DEBUG:teuthology.orchestra.run.smithi097:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T18:45:15.773 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-13T18:45:15.773 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T18:45:16.040 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-13T18:45:16.040 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T18:45:16.119 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-13T18:45:16.119 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T18:45:16.176 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-13T18:45:16.177 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T18:45:16.219 INFO:tasks.ceph:Archiving mon data... 2024-09-13T18:45:16.220 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904000/data/mon.a.tgz 2024-09-13T18:45:16.220 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-13T18:45:16.274 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.U3mnOJlkpe 2024-09-13T18:45:16.275 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.U3mnOJlkpe 2024-09-13T18:45:16.401 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.U3mnOJlkpe 2024-09-13T18:45:16.484 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.U3mnOJlkpe is 222KB 2024-09-13T18:45:16.578 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.U3mnOJlkpe 2024-09-13T18:45:16.593 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904000/data/mon.b.tgz 2024-09-13T18:45:16.594 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-13T18:45:16.647 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.aBSQk1WQ4E 2024-09-13T18:45:16.647 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.aBSQk1WQ4E 2024-09-13T18:45:16.773 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.aBSQk1WQ4E 2024-09-13T18:45:16.856 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.aBSQk1WQ4E is 284KB 2024-09-13T18:45:16.950 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.aBSQk1WQ4E 2024-09-13T18:45:16.964 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904000/data/mon.c.tgz 2024-09-13T18:45:16.965 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-13T18:45:17.019 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.se7hYBzemW 2024-09-13T18:45:17.020 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.se7hYBzemW 2024-09-13T18:45:17.145 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.se7hYBzemW 2024-09-13T18:45:17.227 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.se7hYBzemW is 284KB 2024-09-13T18:45:17.320 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.se7hYBzemW 2024-09-13T18:45:17.335 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T18:45:17.335 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:45:17.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:45:17.412 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T18:45:17.412 DEBUG:teuthology.orchestra.run.smithi097:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:45:17.442 DEBUG:teuthology.orchestra.run.smithi142:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:45:17.466 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:45:17.484 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:45:17.489 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T18:45:17.491 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904000/remote/smithi097/crash 2024-09-13T18:45:17.491 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:45:17.535 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904000/remote/smithi142/crash 2024-09-13T18:45:17.536 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:45:17.579 INFO:tasks.ceph:Compressing logs... 2024-09-13T18:45:17.579 DEBUG:teuthology.orchestra.run.smithi097:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:45:17.582 DEBUG:teuthology.orchestra.run.smithi142:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:45:26.051 INFO:tasks.ceph:Archiving logs... 2024-09-13T18:45:26.052 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904000/remote/smithi097/log 2024-09-13T18:45:26.053 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:45:26.753 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904000/remote/smithi142/log 2024-09-13T18:45:26.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:45:27.440 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T18:45:27.453 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T18:45:27.454 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:45:27.456 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:45:27.561 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T18:45:27.573 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T18:45:27.574 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:45:27.576 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:45:27.591 INFO:teuthology.orchestra.run.smithi097.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:45:27.592 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:45:27.596 INFO:teuthology.orchestra.run.smithi097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:45:27.596 INFO:teuthology.orchestra.run.smithi097.stdout:=============================================================================== 2024-09-13T18:45:27.596 INFO:teuthology.orchestra.run.smithi097.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 -1150us[-1140us] +/- 63ms 2024-09-13T18:45:27.596 INFO:teuthology.orchestra.run.smithi097.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 +3102us[+3102us] +/- 81ms 2024-09-13T18:45:27.596 INFO:teuthology.orchestra.run.smithi097.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 -1364us[-1354us] +/- 65ms 2024-09-13T18:45:27.596 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:45:27.601 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:45:27.601 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-13T18:45:27.601 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 -1148us[-1145us] +/- 63ms 2024-09-13T18:45:27.602 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 +3095us[+3098us] +/- 81ms 2024-09-13T18:45:27.602 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 -1366us[-1363us] +/- 65ms 2024-09-13T18:45:27.602 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:45:27.602 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T18:45:27.615 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T18:45:27.615 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T18:45:27.630 DEBUG:teuthology.orchestra.run.smithi097:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:45:27.711 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:45:27.777 DEBUG:teuthology.orchestra.run.smithi097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:45:27.808 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:45:27.808 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:45:27.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:45:27.837 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T18:45:27.852 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T18:45:27.866 INFO:teuthology.task.internal:Duration was 727.726946 seconds 2024-09-13T18:45:27.867 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T18:45:27.881 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T18:45:27.881 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:45:27.884 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:45:27.923 INFO:teuthology.orchestra.run.smithi097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:45:27.923 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:45:28.134 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T18:45:28.134 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2024-09-13T18:45:28.134 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:45:28.195 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-09-13T18:45:28.196 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:45:28.274 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T18:45:28.274 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:45:28.277 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:45:28.304 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T18:45:28.305 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:45:28.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:45:28.448 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T18:45:28.472 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T18:45:28.472 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:45:28.497 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:45:28.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T18:45:28.536 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:45:28.540 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:45:28.561 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2024-09-13T18:45:28.586 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-09-13T18:45:28.600 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:45:28.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:45:28.637 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:45:28.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:45:28.655 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T18:45:28.667 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T18:45:28.668 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904000/remote/smithi097 2024-09-13T18:45:28.668 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:45:28.711 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904000/remote/smithi142 2024-09-13T18:45:28.712 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:45:28.746 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T18:45:28.746 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:45:28.749 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:45:28.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T18:45:28.810 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T18:45:28.810 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T18:45:28.822 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T18:45:28.823 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:45:28.825 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:45:28.838 INFO:teuthology.orchestra.run.smithi097.stdout: 265628 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:45 /home/ubuntu/cephtest 2024-09-13T18:45:28.852 INFO:teuthology.orchestra.run.smithi142.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:45 /home/ubuntu/cephtest 2024-09-13T18:45:28.853 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T18:45:28.867 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T18:45:28.895 INFO:teuthology.run:Summary data: description: fs/upgrade/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/quincy 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/iozone}} duration: 727.7269456386566 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T18:45:28.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:45:28.978 INFO:teuthology.run:pass